[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:22:21.224498 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:35907
I20260709 12:22:21.226037 29732 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:22:21.227056 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:21.243106 29739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:21.243785 29738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:21.244078 29741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:21.245369 29732 server_base.cc:1061] running on GCE node
I20260709 12:22:22.352324 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:22.352540 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:22.352735 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599742352708 us; error 0 us; skew 500 ppm
I20260709 12:22:22.353554 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:22.358716 29732 webserver.cc:533] Webserver started at http://127.29.9.62:35291/ using document root <none> and password file <none>
I20260709 12:22:22.359553 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:22.359782 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:22.360195 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:22.365979 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "c12ef1968b584962b56d9c5fa14f281f"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-ftzc"
I20260709 12:22:22.373652 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:22:22.378641 29747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.379809 29732 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:22.380129 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "c12ef1968b584962b56d9c5fa14f281f"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-ftzc"
I20260709 12:22:22.380460 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:22.425962 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:22.427429 29732 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:22:22.427898 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:22.496158 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:35907
I20260709 12:22:22.496227 29798 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:35907 every 8 connection(s)
I20260709 12:22:22.503767 29799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:22.525103 29799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f: Bootstrap starting.
I20260709 12:22:22.530856 29799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:22.532714 29799 log.cc:826] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f: Log is configured to *not* fsync() on all Append() calls
I20260709 12:22:22.537127 29799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f: No bootstrap required, opened a new log
I20260709 12:22:22.557817 29799 raft_consensus.cc:359] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c12ef1968b584962b56d9c5fa14f281f" member_type: VOTER }
I20260709 12:22:22.558373 29799 raft_consensus.cc:385] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:22.558655 29799 raft_consensus.cc:740] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c12ef1968b584962b56d9c5fa14f281f, State: Initialized, Role: FOLLOWER
I20260709 12:22:22.559643 29799 consensus_queue.cc:260] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c12ef1968b584962b56d9c5fa14f281f" member_type: VOTER }
I20260709 12:22:22.560364 29799 raft_consensus.cc:399] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:22.560712 29799 raft_consensus.cc:493] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:22.561058 29799 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:22.565163 29799 raft_consensus.cc:515] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c12ef1968b584962b56d9c5fa14f281f" member_type: VOTER }
I20260709 12:22:22.565936 29799 leader_election.cc:304] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c12ef1968b584962b56d9c5fa14f281f; no voters: 
I20260709 12:22:22.567581 29799 leader_election.cc:290] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:22.567934 29802 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:22.570255 29802 raft_consensus.cc:697] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 1 LEADER]: Becoming Leader. State: Replica: c12ef1968b584962b56d9c5fa14f281f, State: Running, Role: LEADER
I20260709 12:22:22.571090 29802 consensus_queue.cc:237] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c12ef1968b584962b56d9c5fa14f281f" member_type: VOTER }
I20260709 12:22:22.572189 29799 sys_catalog.cc:565] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:22.581866 29803 sys_catalog.cc:455] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c12ef1968b584962b56d9c5fa14f281f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c12ef1968b584962b56d9c5fa14f281f" member_type: VOTER } }
I20260709 12:22:22.581993 29804 sys_catalog.cc:455] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c12ef1968b584962b56d9c5fa14f281f. Latest consensus state: current_term: 1 leader_uuid: "c12ef1968b584962b56d9c5fa14f281f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c12ef1968b584962b56d9c5fa14f281f" member_type: VOTER } }
I20260709 12:22:22.582692 29803 sys_catalog.cc:458] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:22.582695 29804 sys_catalog.cc:458] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:22.586090 29812 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:22.597869 29812 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:22.600086 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:22.614319 29812 catalog_manager.cc:1383] Generated new cluster ID: 404c07e48c84408da9ee89ced8bbc593
I20260709 12:22:22.614763 29812 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:22.633666 29812 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:22.635166 29812 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:22.653514 29812 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f: Generated new TSK 0
I20260709 12:22:22.654429 29812 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:22.666822 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:22.675016 29821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.676855 29822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:22.679067 29732 server_base.cc:1061] running on GCE node
W20260709 12:22:22.679457 29824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:22.680473 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:22.680759 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:22.680964 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599742680946 us; error 0 us; skew 500 ppm
I20260709 12:22:22.681778 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:22.685947 29732 webserver.cc:533] Webserver started at http://127.29.9.1:39795/ using document root <none> and password file <none>
I20260709 12:22:22.686659 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:22.686910 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:22.687240 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:22.688803 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "a430268b4aa945bb8d2883c7a240cc24"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-ftzc"
I20260709 12:22:22.695636 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:22.703403 29829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.704437 29732 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:22.704867 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "a430268b4aa945bb8d2883c7a240cc24"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-ftzc"
I20260709 12:22:22.705267 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:22.732192 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:22.733918 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:22.736685 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:22.742012 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:22.742327 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.742640 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:22.742858 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.830307 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:38091
I20260709 12:22:22.830341 29891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:38091 every 8 connection(s)
I20260709 12:22:22.839200 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:22.848130 29896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:22.852676 29897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:22.859618 29892 heartbeater.cc:344] Connected to a master server at 127.29.9.62:35907
I20260709 12:22:22.860152 29892 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:22.861289 29892 heartbeater.cc:507] Master 127.29.9.62:35907 requested a full tablet report, sending...
I20260709 12:22:22.864990 29764 ts_manager.cc:194] Registered new tserver with Master: a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091)
I20260709 12:22:22.865576 29732 server_base.cc:1061] running on GCE node
W20260709 12:22:22.866376 29899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:22.867311 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:22.867515 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:22.867699 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599742867678 us; error 0 us; skew 500 ppm
I20260709 12:22:22.868330 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:22.868186 29764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48188
I20260709 12:22:22.874329 29732 webserver.cc:533] Webserver started at http://127.29.9.2:39015/ using document root <none> and password file <none>
I20260709 12:22:22.874832 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:22.875012 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:22.875283 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:22.876461 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "f8d677b486f34453b7a31079f8968377"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-ftzc"
I20260709 12:22:22.881088 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:22:22.885090 29904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.885905 29732 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:22:22.886226 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "f8d677b486f34453b7a31079f8968377"
format_stamp: "Formatted at 2026-07-09 12:22:22 on dist-test-slave-ftzc"
I20260709 12:22:22.886583 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:22.905716 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:22.907389 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:22.909914 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:22.913630 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:22.913898 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.914178 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:22.914382 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:22.998376 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:42093
I20260709 12:22:22.998445 29966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:42093 every 8 connection(s)
I20260709 12:22:23.005407 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:23.014649 29970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:23.016327 29971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:23.020074 29967 heartbeater.cc:344] Connected to a master server at 127.29.9.62:35907
I20260709 12:22:23.020385 29967 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:23.021126 29967 heartbeater.cc:507] Master 127.29.9.62:35907 requested a full tablet report, sending...
I20260709 12:22:23.022889 29764 ts_manager.cc:194] Registered new tserver with Master: f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:23.024307 29764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48202
I20260709 12:22:23.024899 29732 server_base.cc:1061] running on GCE node
W20260709 12:22:23.025849 29974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:23.026934 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:23.027179 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:23.027339 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599743027324 us; error 0 us; skew 500 ppm
I20260709 12:22:23.027906 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:23.030247 29732 webserver.cc:533] Webserver started at http://127.29.9.3:46423/ using document root <none> and password file <none>
I20260709 12:22:23.030738 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:23.030926 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:23.031175 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:23.032282 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "38532dcf484240af9bb948d2ae8dc973"
format_stamp: "Formatted at 2026-07-09 12:22:23 on dist-test-slave-ftzc"
I20260709 12:22:23.036878 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:23.040225 29978 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:23.041033 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:23.041364 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "38532dcf484240af9bb948d2ae8dc973"
format_stamp: "Formatted at 2026-07-09 12:22:23 on dist-test-slave-ftzc"
I20260709 12:22:23.041759 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:23.083678 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:23.085018 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:23.086385 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:23.088482 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:23.088711 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:23.088972 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:23.089114 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:23.170536 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:39509
I20260709 12:22:23.170761 30040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:39509 every 8 connection(s)
I20260709 12:22:23.187197 30041 heartbeater.cc:344] Connected to a master server at 127.29.9.62:35907
I20260709 12:22:23.187640 30041 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:23.188658 30041 heartbeater.cc:507] Master 127.29.9.62:35907 requested a full tablet report, sending...
I20260709 12:22:23.190785 29764 ts_manager.cc:194] Registered new tserver with Master: 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:23.191244 29732 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016090174s
I20260709 12:22:23.192687 29764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48206
I20260709 12:22:23.248895 29764 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48212:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:23.253897 29764 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:23.351797 30006 tablet_service.cc:1511] Processing CreateTablet for tablet 85ac7d1e0cff4e1885f755f9f55ad272 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:23.352298 30005 tablet_service.cc:1511] Processing CreateTablet for tablet 3f706f032a934de18368dbda3524b16f (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:23.354363 30006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ac7d1e0cff4e1885f755f9f55ad272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.355103 30004 tablet_service.cc:1511] Processing CreateTablet for tablet 22dd2cae09f447689e52e15534fd2a83 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:23.358685 30005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f706f032a934de18368dbda3524b16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.359583 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dd2cae09f447689e52e15534fd2a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.379156 29929 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef9f3cfb4e445ce8a7f5670b8e4c3ab (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:23.380266 29931 tablet_service.cc:1511] Processing CreateTablet for tablet 3f706f032a934de18368dbda3524b16f (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:23.381973 29930 tablet_service.cc:1511] Processing CreateTablet for tablet 22dd2cae09f447689e52e15534fd2a83 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:23.373339 30003 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef9f3cfb4e445ce8a7f5670b8e4c3ab (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:23.381700 29932 tablet_service.cc:1511] Processing CreateTablet for tablet 85ac7d1e0cff4e1885f755f9f55ad272 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:23.385037 29929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef9f3cfb4e445ce8a7f5670b8e4c3ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.382825 29928 tablet_service.cc:1511] Processing CreateTablet for tablet 8845bdc59f9649d0b722e61fdbde6151 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:23.386850 29931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f706f032a934de18368dbda3524b16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.388388 30002 tablet_service.cc:1511] Processing CreateTablet for tablet 8845bdc59f9649d0b722e61fdbde6151 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:23.389618 30003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef9f3cfb4e445ce8a7f5670b8e4c3ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.391453 30002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8845bdc59f9649d0b722e61fdbde6151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.393718 29928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8845bdc59f9649d0b722e61fdbde6151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.397959 29932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ac7d1e0cff4e1885f755f9f55ad272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.399008 29930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dd2cae09f447689e52e15534fd2a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.412776 29927 tablet_service.cc:1511] Processing CreateTablet for tablet fb8e929cbe384787bec03b8cff1770ac (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:23.414371 29927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8e929cbe384787bec03b8cff1770ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.429397 29857 tablet_service.cc:1511] Processing CreateTablet for tablet 85ac7d1e0cff4e1885f755f9f55ad272 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:23.430866 29857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ac7d1e0cff4e1885f755f9f55ad272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.433035 29854 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef9f3cfb4e445ce8a7f5670b8e4c3ab (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:23.434523 29854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef9f3cfb4e445ce8a7f5670b8e4c3ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.433092 29852 tablet_service.cc:1511] Processing CreateTablet for tablet fb8e929cbe384787bec03b8cff1770ac (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:23.436975 29853 tablet_service.cc:1511] Processing CreateTablet for tablet 8845bdc59f9649d0b722e61fdbde6151 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:23.439230 29856 tablet_service.cc:1511] Processing CreateTablet for tablet 3f706f032a934de18368dbda3524b16f (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:23.431106 29855 tablet_service.cc:1511] Processing CreateTablet for tablet 22dd2cae09f447689e52e15534fd2a83 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:23.441135 29852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8e929cbe384787bec03b8cff1770ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.444109 29853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8845bdc59f9649d0b722e61fdbde6151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.448040 29856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f706f032a934de18368dbda3524b16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.452692 29855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22dd2cae09f447689e52e15534fd2a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.480927 30059 tablet_bootstrap.cc:492] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:23.483319 30002 tablet_service.cc:1511] Processing CreateTablet for tablet fb8e929cbe384787bec03b8cff1770ac (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:23.484822 30061 tablet_bootstrap.cc:492] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:23.484850 30002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8e929cbe384787bec03b8cff1770ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.492255 30060 tablet_bootstrap.cc:492] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:23.497239 29932 tablet_service.cc:1511] Processing CreateTablet for tablet d87f9655a57b4727afbf6ff7fee7e67c (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:23.498588 29932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87f9655a57b4727afbf6ff7fee7e67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.498477 29854 tablet_service.cc:1511] Processing CreateTablet for tablet d87f9655a57b4727afbf6ff7fee7e67c (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:23.499845 29854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87f9655a57b4727afbf6ff7fee7e67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.520890 30004 tablet_service.cc:1511] Processing CreateTablet for tablet d87f9655a57b4727afbf6ff7fee7e67c (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:23.522183 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87f9655a57b4727afbf6ff7fee7e67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.527096 29857 tablet_service.cc:1511] Processing CreateTablet for tablet 5d34d6cfa0c34381ae8695c6428ecdf4 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:23.528283 29857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34d6cfa0c34381ae8695c6428ecdf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.541531 29929 tablet_service.cc:1511] Processing CreateTablet for tablet 5d34d6cfa0c34381ae8695c6428ecdf4 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:23.542773 29929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34d6cfa0c34381ae8695c6428ecdf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.551431 30060 tablet_bootstrap.cc:654] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.553936 30059 tablet_bootstrap.cc:654] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.557878 30005 tablet_service.cc:1511] Processing CreateTablet for tablet 5d34d6cfa0c34381ae8695c6428ecdf4 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:23.559188 30005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34d6cfa0c34381ae8695c6428ecdf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.560870 29852 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:23.562009 29852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb9bd61f81b42e6aa2bcee8b5d0ebe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.563905 30006 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:23.565064 30006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb9bd61f81b42e6aa2bcee8b5d0ebe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.569001 29932 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 (DEFAULT_TABLE table=test-workload [id=d5aa831ebe2347d785a48c2aa058bf17]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:23.584009 29932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb9bd61f81b42e6aa2bcee8b5d0ebe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:23.586642 30061 tablet_bootstrap.cc:654] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:23.588043 29811 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:23.615798 30060 tablet_bootstrap.cc:492] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:23.616303 30060 ts_tablet_manager.cc:1403] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.126s	user 0.026s	sys 0.011s
I20260709 12:22:23.616379 30061 tablet_bootstrap.cc:492] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:23.616858 30061 ts_tablet_manager.cc:1403] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.009s
I20260709 12:22:23.619835 30059 tablet_bootstrap.cc:492] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:23.619604 30061 raft_consensus.cc:359] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.620374 30059 ts_tablet_manager.cc:1403] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.015s
I20260709 12:22:23.620386 30061 raft_consensus.cc:385] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.620878 30061 raft_consensus.cc:740] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.621654 30061 consensus_queue.cc:260] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.621778 30060 raft_consensus.cc:359] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.622550 30060 raft_consensus.cc:385] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.622848 30060 raft_consensus.cc:740] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.623566 30060 consensus_queue.cc:260] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.623687 30059 raft_consensus.cc:359] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:23.624589 30059 raft_consensus.cc:385] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.624960 30059 raft_consensus.cc:740] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.625769 30059 consensus_queue.cc:260] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:23.632072 30061 ts_tablet_manager.cc:1434] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.009s
I20260709 12:22:23.632931 29892 heartbeater.cc:499] Master 127.29.9.62:35907 was elected leader, sending a full tablet report...
I20260709 12:22:23.633097 30060 ts_tablet_manager.cc:1434] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 12:22:23.633762 29967 heartbeater.cc:499] Master 127.29.9.62:35907 was elected leader, sending a full tablet report...
I20260709 12:22:23.645161 30061 tablet_bootstrap.cc:492] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:23.648375 30060 tablet_bootstrap.cc:492] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:23.652174 30041 heartbeater.cc:499] Master 127.29.9.62:35907 was elected leader, sending a full tablet report...
I20260709 12:22:23.652667 30059 ts_tablet_manager.cc:1434] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.032s	user 0.017s	sys 0.013s
I20260709 12:22:23.653553 30059 tablet_bootstrap.cc:492] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:23.659933 30059 tablet_bootstrap.cc:654] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.661245 30061 tablet_bootstrap.cc:654] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.655567 30060 tablet_bootstrap.cc:654] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.670485 30061 tablet_bootstrap.cc:492] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:23.670998 30061 ts_tablet_manager.cc:1403] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:22:23.674458 30061 raft_consensus.cc:359] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
W20260709 12:22:23.676133 30042 tablet.cc:2406] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:23.676560 30061 raft_consensus.cc:385] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.676908 30061 raft_consensus.cc:740] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.677698 30061 consensus_queue.cc:260] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:23.680260 30059 tablet_bootstrap.cc:492] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:23.680724 30059 ts_tablet_manager.cc:1403] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.012s
I20260709 12:22:23.682845 30061 ts_tablet_manager.cc:1434] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:22:23.683918 30061 tablet_bootstrap.cc:492] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:23.683704 30059 raft_consensus.cc:359] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.684468 30059 raft_consensus.cc:385] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.684778 30059 raft_consensus.cc:740] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.685495 30059 consensus_queue.cc:260] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.688265 30059 ts_tablet_manager.cc:1434] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:23.689254 30059 tablet_bootstrap.cc:492] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:23.693255 30061 tablet_bootstrap.cc:654] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.695389 30059 tablet_bootstrap.cc:654] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.699047 30060 tablet_bootstrap.cc:492] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:23.699508 30060 ts_tablet_manager.cc:1403] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.008s
I20260709 12:22:23.702370 30060 raft_consensus.cc:359] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:23.705137 30060 raft_consensus.cc:385] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.705446 30060 raft_consensus.cc:740] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.706171 30060 consensus_queue.cc:260] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:23.708436 30060 ts_tablet_manager.cc:1434] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:22:23.709280 30060 tablet_bootstrap.cc:492] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:23.719275 30060 tablet_bootstrap.cc:654] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.731300 30059 tablet_bootstrap.cc:492] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:23.731820 30059 ts_tablet_manager.cc:1403] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.043s	user 0.030s	sys 0.008s
I20260709 12:22:23.732113 30061 tablet_bootstrap.cc:492] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:23.732509 30061 ts_tablet_manager.cc:1403] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.010s
I20260709 12:22:23.734946 30061 raft_consensus.cc:359] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.734812 30059 raft_consensus.cc:359] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.735478 30061 raft_consensus.cc:385] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.735571 30059 raft_consensus.cc:385] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.735771 30061 raft_consensus.cc:740] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.735946 30059 raft_consensus.cc:740] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.736480 30061 consensus_queue.cc:260] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.736730 30059 consensus_queue.cc:260] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.738473 30061 ts_tablet_manager.cc:1434] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:22:23.738868 30059 ts_tablet_manager.cc:1434] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:23.739390 30061 tablet_bootstrap.cc:492] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:23.739801 30059 tablet_bootstrap.cc:492] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:23.744946 30060 tablet_bootstrap.cc:492] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:23.745410 30060 ts_tablet_manager.cc:1403] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 12:22:23.746054 30059 tablet_bootstrap.cc:654] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.748188 30060 raft_consensus.cc:359] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.748837 30060 raft_consensus.cc:385] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.749130 30060 raft_consensus.cc:740] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.749799 30060 consensus_queue.cc:260] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.752101 30060 ts_tablet_manager.cc:1434] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:23.755615 30061 tablet_bootstrap.cc:654] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.757298 30060 tablet_bootstrap.cc:492] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:23.766350 30060 tablet_bootstrap.cc:654] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.769497 30059 tablet_bootstrap.cc:492] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:23.769979 30059 ts_tablet_manager.cc:1403] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.030s	user 0.000s	sys 0.021s
I20260709 12:22:23.772845 30059 raft_consensus.cc:359] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.773620 30059 raft_consensus.cc:385] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.773907 30059 raft_consensus.cc:740] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.776764 30059 consensus_queue.cc:260] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.779186 30059 ts_tablet_manager.cc:1434] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:22:23.779976 30061 tablet_bootstrap.cc:492] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:23.780063 30059 tablet_bootstrap.cc:492] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:23.780622 30061 ts_tablet_manager.cc:1403] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.001s
I20260709 12:22:23.783460 30061 raft_consensus.cc:359] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.784231 30061 raft_consensus.cc:385] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.784588 30061 raft_consensus.cc:740] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.786808 30059 tablet_bootstrap.cc:654] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.786751 30061 consensus_queue.cc:260] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.791689 30061 ts_tablet_manager.cc:1434] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:22:23.793022 30061 tablet_bootstrap.cc:492] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:23.798707 30059 tablet_bootstrap.cc:492] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:23.799192 30059 ts_tablet_manager.cc:1403] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 12:22:23.799567 30061 tablet_bootstrap.cc:654] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.800314 30067 raft_consensus.cc:493] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.800776 30067 raft_consensus.cc:515] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.801992 30060 tablet_bootstrap.cc:492] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:23.802439 30060 ts_tablet_manager.cc:1403] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.003s
I20260709 12:22:23.803771 30067 leader_election.cc:290] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:23.811924 30065 raft_consensus.cc:493] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.812407 30065 raft_consensus.cc:515] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.813807 30060 raft_consensus.cc:359] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.814570 30060 raft_consensus.cc:385] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.814854 30060 raft_consensus.cc:740] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.815021 30065 leader_election.cc:290] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:23.816898 30059 raft_consensus.cc:359] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.817827 30059 raft_consensus.cc:385] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.818105 30059 raft_consensus.cc:740] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.818797 30059 consensus_queue.cc:260] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.816921 30060 consensus_queue.cc:260] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.823534 30059 ts_tablet_manager.cc:1434] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 12:22:23.824481 30059 tablet_bootstrap.cc:492] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:23.844450 30061 tablet_bootstrap.cc:492] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:23.844980 30061 ts_tablet_manager.cc:1403] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.010s
I20260709 12:22:23.850417 30060 ts_tablet_manager.cc:1434] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.002s
I20260709 12:22:23.852037 30065 raft_consensus.cc:493] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.853029 30060 tablet_bootstrap.cc:492] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:23.852797 30065 raft_consensus.cc:515] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.854768 30065 leader_election.cc:290] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:23.858515 30059 tablet_bootstrap.cc:654] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.861235 30067 raft_consensus.cc:493] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.861699 30067 raft_consensus.cc:515] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.864684 30067 leader_election.cc:290] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:23.867594 30061 raft_consensus.cc:359] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.877447 30065 raft_consensus.cc:493] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.877907 30060 tablet_bootstrap.cc:654] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.879179 29867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24" is_pre_election: true
I20260709 12:22:23.878641 30061 raft_consensus.cc:385] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.879186 30065 raft_consensus.cc:515] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:23.881091 30061 raft_consensus.cc:740] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.883582 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24" is_pre_election: true
I20260709 12:22:23.884583 30065 leader_election.cc:290] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:23.884799 29866 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 0.
W20260709 12:22:23.884121 29980 leader_election.cc:343] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:23.887089 29980 leader_election.cc:304] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:23.888293 30067 raft_consensus.cc:2804] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:23.888876 30067 raft_consensus.cc:493] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.889336 30067 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.892477 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:23.893213 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:23.887373 30061 consensus_queue.cc:260] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.895776 30059 tablet_bootstrap.cc:492] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
W20260709 12:22:23.896502 29979 leader_election.cc:343] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:23.897505 29979 leader_election.cc:343] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:23.897761 30061 ts_tablet_manager.cc:1434] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 12:22:23.896232 30059 ts_tablet_manager.cc:1403] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.010s
I20260709 12:22:23.898662 30061 tablet_bootstrap.cc:492] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:23.915484 30067 raft_consensus.cc:515] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.918463 30067 leader_election.cc:290] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:23.899801 29979 leader_election.cc:304] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973; no voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377
I20260709 12:22:23.919292 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:23.919893 29866 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.920971 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:23.922313 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:23.922446 30067 raft_consensus.cc:2749] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:23.923974 29941 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
I20260709 12:22:23.924422 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:23.922740 29940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:23.926246 29940 raft_consensus.cc:2468] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
W20260709 12:22:23.926680 29979 leader_election.cc:343] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:23.928447 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:23.929111 30015 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
W20260709 12:22:23.930980 29830 leader_election.cc:343] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:23.932248 29831 leader_election.cc:304] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:23.925347 30059 raft_consensus.cc:359] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.931275 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:23.936615 30061 tablet_bootstrap.cc:654] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:23.931787 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:23.933859 30059 raft_consensus.cc:385] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.937145 30014 raft_consensus.cc:2468] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
I20260709 12:22:23.937719 30059 raft_consensus.cc:740] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.938725 30065 raft_consensus.cc:2804] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:23.938472 30059 consensus_queue.cc:260] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.939121 30065 raft_consensus.cc:493] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.939502 30065 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.936546 29830 leader_election.cc:304] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:23.945569 30059 ts_tablet_manager.cc:1434] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:22:23.948191 30067 raft_consensus.cc:493] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.948727 30059 tablet_bootstrap.cc:492] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:23.948625 30067 raft_consensus.cc:515] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.950570 30067 leader_election.cc:290] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:23.951799 29940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:23.952426 29940 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 0.
I20260709 12:22:23.953585 29979 leader_election.cc:304] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:23.954339 30067 raft_consensus.cc:2804] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:23.954674 30067 raft_consensus.cc:493] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.954993 30067 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.955873 30065 raft_consensus.cc:515] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.957768 30065 leader_election.cc:290] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:23.958230 30065 raft_consensus.cc:493] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.956300 30016 raft_consensus.cc:2393] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a430268b4aa945bb8d2883c7a240cc24 in current term 1: Already voted for candidate 38532dcf484240af9bb948d2ae8dc973 in this term.
I20260709 12:22:23.958575 29866 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 1.
I20260709 12:22:23.958621 30065 raft_consensus.cc:515] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.961225 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:23.961817 30016 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.968691 29831 leader_election.cc:304] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24; no voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377
I20260709 12:22:23.968544 30067 raft_consensus.cc:515] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.973224 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:23.973922 30067 leader_election.cc:290] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:23.974459 30014 raft_consensus.cc:2393] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a430268b4aa945bb8d2883c7a240cc24 in current term 1: Already voted for candidate 38532dcf484240af9bb948d2ae8dc973 in this term.
I20260709 12:22:23.975446 29940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:23.976022 29940 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.988842 30065 leader_election.cc:290] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:23.989409 30065 raft_consensus.cc:2804] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:23.989770 30065 raft_consensus.cc:493] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.990100 30065 raft_consensus.cc:3060] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:23.989195 29830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:42093, user_credentials={real_user=slave}} blocked reactor thread for 52688.8us
I20260709 12:22:23.991410 30060 tablet_bootstrap.cc:492] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:23.992211 30060 ts_tablet_manager.cc:1403] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.021s
I20260709 12:22:23.992465 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:23.993145 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:23.993780 29942 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:23.994915 30087 raft_consensus.cc:2749] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:23.997450 30060 raft_consensus.cc:359] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.998160 30060 raft_consensus.cc:385] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:23.998454 30060 raft_consensus.cc:740] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:23.999131 30060 consensus_queue.cc:260] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:23.996522 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24" is_pre_election: true
I20260709 12:22:24.000355 29866 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 0.
I20260709 12:22:24.001082 30060 ts_tablet_manager.cc:1434] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:24.003156 30060 tablet_bootstrap.cc:492] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:24.004570 29830 leader_election.cc:304] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24; no voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377
I20260709 12:22:24.005347 29940 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 1.
I20260709 12:22:24.006206 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:24.006721 29979 leader_election.cc:304] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.007555 30067 raft_consensus.cc:2804] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.006747 29866 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.008008 30059 tablet_bootstrap.cc:654] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.020207 29942 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.020651 29866 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 1.
I20260709 12:22:24.022305 30016 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.023088 30086 raft_consensus.cc:2749] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:23.995514 29980 leader_election.cc:304] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: f8d677b486f34453b7a31079f8968377
I20260709 12:22:24.025650 29831 leader_election.cc:304] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:24.024591 30067 raft_consensus.cc:697] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:24.027792 30087 raft_consensus.cc:2804] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.028898 30067 consensus_queue.cc:237] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.028975 30065 raft_consensus.cc:515] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:24.039565 30066 raft_consensus.cc:493] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.032130 30089 raft_consensus.cc:2804] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.040377 30066 raft_consensus.cc:515] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.042284 30087 raft_consensus.cc:697] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:24.045219 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:24.044636 30065 leader_election.cc:290] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Requested vote from peers 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:24.046136 30016 raft_consensus.cc:3060] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.048537 30066 leader_election.cc:290] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.052513 30059 tablet_bootstrap.cc:492] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:24.053331 30059 ts_tablet_manager.cc:1403] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.010s
I20260709 12:22:24.059058 30059 raft_consensus.cc:359] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.059760 30059 raft_consensus.cc:385] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.060052 30059 raft_consensus.cc:740] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.060767 30059 consensus_queue.cc:260] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.054888 30060 tablet_bootstrap.cc:654] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.052728 30087 consensus_queue.cc:237] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.068221 30016 raft_consensus.cc:2468] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.066537 30061 tablet_bootstrap.cc:492] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:24.070032 30061 ts_tablet_manager.cc:1403] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.172s	user 0.022s	sys 0.026s
I20260709 12:22:24.071118 29831 leader_election.cc:304] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:24.072013 30065 raft_consensus.cc:2804] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.072484 30065 raft_consensus.cc:697] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:24.074339 30065 consensus_queue.cc:237] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:24.080235 29764 catalog_manager.cc:5697] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:24.082005 30089 raft_consensus.cc:697] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:24.082845 30089 consensus_queue.cc:237] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.083369 30059 ts_tablet_manager.cc:1434] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:22:24.087189 30059 tablet_bootstrap.cc:492] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:24.089375 30060 tablet_bootstrap.cc:492] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:24.091694 30060 ts_tablet_manager.cc:1403] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.000s
I20260709 12:22:24.108065 30060 raft_consensus.cc:359] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.110612 30060 raft_consensus.cc:385] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.110941 30060 raft_consensus.cc:740] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.112181 30066 raft_consensus.cc:493] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.106840 30061 raft_consensus.cc:359] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.112351 30060 consensus_queue.cc:260] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.112653 30066 raft_consensus.cc:515] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.113783 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:24.114390 29942 raft_consensus.cc:3060] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.112910 30061 raft_consensus.cc:385] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.114486 30066 leader_election.cc:290] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.115263 30061 raft_consensus.cc:740] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.121701 30061 consensus_queue.cc:260] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.124007 30061 ts_tablet_manager.cc:1434] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.002s
I20260709 12:22:24.124922 30061 tablet_bootstrap.cc:492] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:24.127681 30059 tablet_bootstrap.cc:654] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.141090 29942 raft_consensus.cc:2468] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.145857 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24" is_pre_election: true
I20260709 12:22:24.146121 29867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24" is_pre_election: true
I20260709 12:22:24.146957 29867 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 0.
I20260709 12:22:24.147374 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:24.147840 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:24.148694 30014 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 0.
I20260709 12:22:24.149761 29866 raft_consensus.cc:2393] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8d677b486f34453b7a31079f8968377 in current term 1: Already voted for candidate 38532dcf484240af9bb948d2ae8dc973 in this term.
I20260709 12:22:24.154690 29906 leader_election.cc:304] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.154690 29761 catalog_manager.cc:5697] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.156217 30060 ts_tablet_manager.cc:1434] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.064s	user 0.013s	sys 0.003s
I20260709 12:22:24.156937 30102 raft_consensus.cc:2804] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:24.157323 30102 raft_consensus.cc:493] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.157473 30060 tablet_bootstrap.cc:492] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:24.157697 30102 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.158833 30089 raft_consensus.cc:493] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.159468 30089 raft_consensus.cc:515] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.162093 30089 leader_election.cc:290] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:24.163285 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:24.163906 29942 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 0.
I20260709 12:22:24.163951 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24" is_pre_election: true
I20260709 12:22:24.164564 29866 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 0.
I20260709 12:22:24.165163 29979 leader_election.cc:304] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.166687 30089 raft_consensus.cc:2804] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:24.159466 29906 leader_election.cc:304] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d677b486f34453b7a31079f8968377; no voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:24.167229 30089 raft_consensus.cc:493] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.167678 30066 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.167582 30089 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.166424 30102 raft_consensus.cc:515] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.180223 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:24.180914 29866 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.181573 30060 tablet_bootstrap.cc:654] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.183472 30089 raft_consensus.cc:515] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.184973 30066 raft_consensus.cc:2749] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:24.185463 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:24.187168 30014 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.186080 30102 leader_election.cc:290] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.192708 30089 leader_election.cc:290] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:24.194348 29867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:24.194963 29867 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.195504 30014 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 1.
I20260709 12:22:24.196599 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:24.197196 29942 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.199381 30061 tablet_bootstrap.cc:654] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.204241 30059 tablet_bootstrap.cc:492] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:24.204006 29906 leader_election.cc:304] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.204788 30059 ts_tablet_manager.cc:1403] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.014s
I20260709 12:22:24.206244 30066 raft_consensus.cc:2804] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.207126 30066 raft_consensus.cc:697] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:24.207923 30066 consensus_queue.cc:237] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.188464 29866 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 1.
I20260709 12:22:24.217481 29942 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 1.
I20260709 12:22:24.218760 29979 leader_election.cc:304] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.220027 30089 raft_consensus.cc:2804] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.220494 30089 raft_consensus.cc:697] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:24.221241 30059 raft_consensus.cc:359] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.221884 30059 raft_consensus.cc:385] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.221261 30089 consensus_queue.cc:237] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.222126 30059 raft_consensus.cc:740] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.222765 30059 consensus_queue.cc:260] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.216744 29867 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 1.
I20260709 12:22:24.225626 30059 ts_tablet_manager.cc:1434] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:22:24.227010 30059 tablet_bootstrap.cc:492] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973: Bootstrap starting.
I20260709 12:22:24.230216 30060 tablet_bootstrap.cc:492] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:24.232225 30060 ts_tablet_manager.cc:1403] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.024s
I20260709 12:22:24.236090 30060 raft_consensus.cc:359] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.236919 30060 raft_consensus.cc:385] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.238396 30060 raft_consensus.cc:740] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.242432 30060 consensus_queue.cc:260] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.243901 30059 tablet_bootstrap.cc:654] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.242166 29761 catalog_manager.cc:5697] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:24.245548 30060 ts_tablet_manager.cc:1434] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:22:24.246501 30060 tablet_bootstrap.cc:492] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:24.244323 29764 catalog_manager.cc:5697] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:24.256327 30066 raft_consensus.cc:493] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.259553 30066 raft_consensus.cc:515] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.260640 30061 tablet_bootstrap.cc:492] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:24.261116 30061 ts_tablet_manager.cc:1403] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.136s	user 0.009s	sys 0.004s
I20260709 12:22:24.265064 30060 tablet_bootstrap.cc:654] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.265872 30061 raft_consensus.cc:359] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.266625 30061 raft_consensus.cc:385] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.266968 30061 raft_consensus.cc:740] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.275002 29764 catalog_manager.cc:5697] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:24.282300 30061 consensus_queue.cc:260] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.281957 29763 catalog_manager.cc:5697] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.284451 29867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24" is_pre_election: true
I20260709 12:22:24.285091 30061 ts_tablet_manager.cc:1434] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
W20260709 12:22:24.285804 29906 leader_election.cc:343] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:24.286706 30066 leader_election.cc:290] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.288062 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:24.288645 30014 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 0.
I20260709 12:22:24.289824 29906 leader_election.cc:304] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:24.290518 30066 raft_consensus.cc:2804] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:24.291260 30066 raft_consensus.cc:493] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.291443 30061 tablet_bootstrap.cc:492] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:24.291709 30066 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.286832 30059 tablet_bootstrap.cc:492] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973: No bootstrap required, opened a new log
I20260709 12:22:24.296468 30059 ts_tablet_manager.cc:1403] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.000s
I20260709 12:22:24.299005 30059 raft_consensus.cc:359] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.299623 30059 raft_consensus.cc:385] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.299904 30059 raft_consensus.cc:740] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.300585 30066 raft_consensus.cc:515] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.302765 30061 tablet_bootstrap.cc:654] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.304085 29867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:24.304435 30066 leader_election.cc:290] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.304638 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:24.305233 30014 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:24.305774 29906 leader_election.cc:343] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:24.319792 30060 tablet_bootstrap.cc:492] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:24.323045 30014 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 1.
I20260709 12:22:24.323302 30060 ts_tablet_manager.cc:1403] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.016s
I20260709 12:22:24.300563 30059 consensus_queue.cc:260] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.324220 29906 leader_election.cc:304] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:24.324972 30066 raft_consensus.cc:2804] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.326114 30066 raft_consensus.cc:697] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:24.326948 30066 consensus_queue.cc:237] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.331192 30060 raft_consensus.cc:359] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.331903 30060 raft_consensus.cc:385] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.332197 30060 raft_consensus.cc:740] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.331843 30059 ts_tablet_manager.cc:1434] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:22:24.332752 30060 consensus_queue.cc:260] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.334465 30060 ts_tablet_manager.cc:1434] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:22:24.335206 30060 tablet_bootstrap.cc:492] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377: Bootstrap starting.
I20260709 12:22:24.337690 30061 tablet_bootstrap.cc:492] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:24.338186 30061 ts_tablet_manager.cc:1403] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 12:22:24.340873 30060 tablet_bootstrap.cc:654] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.341539 30061 raft_consensus.cc:359] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.342371 30061 raft_consensus.cc:385] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.342741 30061 raft_consensus.cc:740] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.343856 30061 consensus_queue.cc:260] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.346662 30061 ts_tablet_manager.cc:1434] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:24.347841 30061 tablet_bootstrap.cc:492] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24: Bootstrap starting.
I20260709 12:22:24.352507 30060 tablet_bootstrap.cc:492] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377: No bootstrap required, opened a new log
I20260709 12:22:24.352954 30060 ts_tablet_manager.cc:1403] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:22:24.353619 30061 tablet_bootstrap.cc:654] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:24.354872 30087 raft_consensus.cc:493] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.355290 30087 raft_consensus.cc:515] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.355417 30060 raft_consensus.cc:359] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.356019 30060 raft_consensus.cc:385] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.356283 30060 raft_consensus.cc:740] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.357084 30060 consensus_queue.cc:260] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.357414 30087 leader_election.cc:290] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.359369 30060 ts_tablet_manager.cc:1434] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:24.359666 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:24.360061 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:24.361618 30014 raft_consensus.cc:2393] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a430268b4aa945bb8d2883c7a240cc24 in current term 1: Already voted for candidate f8d677b486f34453b7a31079f8968377 in this term.
I20260709 12:22:24.362648 29831 leader_election.cc:304] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24; no voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377
I20260709 12:22:24.363816 30087 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.365163 29764 catalog_manager.cc:5697] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.370654 30087 raft_consensus.cc:2749] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:24.374084 30061 tablet_bootstrap.cc:492] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24: No bootstrap required, opened a new log
I20260709 12:22:24.374503 30061 ts_tablet_manager.cc:1403] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.006s
I20260709 12:22:24.376500 30061 raft_consensus.cc:359] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.376955 30061 raft_consensus.cc:385] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:24.377125 30061 raft_consensus.cc:740] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Initialized, Role: FOLLOWER
I20260709 12:22:24.377736 30061 consensus_queue.cc:260] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.379865 30061 ts_tablet_manager.cc:1434] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:24.420141 30087 raft_consensus.cc:493] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.420572 30087 raft_consensus.cc:515] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.422492 30087 leader_election.cc:290] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.423300 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:24.423676 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:24.423862 29942 raft_consensus.cc:2468] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
I20260709 12:22:24.424320 30014 raft_consensus.cc:2468] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
I20260709 12:22:24.424787 29830 leader_election.cc:304] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.425529 30087 raft_consensus.cc:2804] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:24.425890 30087 raft_consensus.cc:493] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.426216 30087 raft_consensus.cc:3060] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.432662 30087 raft_consensus.cc:515] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.435036 30087 leader_election.cc:290] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.435328 29942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:24.435623 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:24.435956 29942 raft_consensus.cc:3060] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.436136 30014 raft_consensus.cc:3060] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.442162 30014 raft_consensus.cc:2468] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.442162 29942 raft_consensus.cc:2468] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.443362 29830 leader_election.cc:304] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.444064 30087 raft_consensus.cc:2804] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.444471 30087 raft_consensus.cc:697] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:24.445161 30087 consensus_queue.cc:237] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.452937 29763 catalog_manager.cc:5697] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.461526 30087 consensus_queue.cc:1048] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.471299 30089 consensus_queue.cc:1048] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.487989 30087 raft_consensus.cc:493] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.488490 30087 raft_consensus.cc:515] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.490478 30087 leader_election.cc:290] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.492054 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973" is_pre_election: true
I20260709 12:22:24.492756 30014 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
I20260709 12:22:24.493041 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377" is_pre_election: true
I20260709 12:22:24.493844 29831 leader_election.cc:304] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:24.493870 29941 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 0.
I20260709 12:22:24.494669 30087 raft_consensus.cc:2804] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:24.495175 30087 raft_consensus.cc:493] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.495502 30087 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.505702 30095 consensus_queue.cc:1048] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:24.506969 30087 raft_consensus.cc:515] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.509099 30087 leader_election.cc:290] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.512477 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:24.513288 30016 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.514125 30087 consensus_queue.cc:1048] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.514367 29940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:24.514881 29940 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:24.523663 30016 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.524663 29831 leader_election.cc:304] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:24.525553 30087 raft_consensus.cc:2804] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:24.526062 30087 raft_consensus.cc:697] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:24.526813 30087 consensus_queue.cc:237] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.531064 29940 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 1.
I20260709 12:22:24.541754 29761 catalog_manager.cc:5697] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 0 to 1, leader changed from <none> to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.617026 30095 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.627310 30067 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.644973 30067 consensus_queue.cc:1048] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.654706 30094 consensus_queue.cc:1048] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:24.667011 30066 consensus_queue.cc:1048] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.675930 30102 consensus_queue.cc:1048] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.678282 30087 consensus_queue.cc:1048] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.686625 30087 consensus_queue.cc:1048] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.737989 30066 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.751991 30066 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.779709 29941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f706f032a934de18368dbda3524b16f"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
mode: GRACEFUL
new_leader_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:48262
I20260709 12:22:24.780316 29941 raft_consensus.cc:606] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Received request to transfer leadership to TS a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:24.794018 30014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
mode: GRACEFUL
new_leader_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:49042
I20260709 12:22:24.794544 30014 raft_consensus.cc:606] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Received request to transfer leadership to TS a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:24.802604 30014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:49042
I20260709 12:22:24.803067 30014 raft_consensus.cc:606] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:24.810463 30014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:49042
I20260709 12:22:24.810925 30014 raft_consensus.cc:606] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:24.824051 29866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:22:24.824520 29866 raft_consensus.cc:606] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:24.829656 29866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
mode: GRACEFUL
new_leader_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:22:24.830111 29866 raft_consensus.cc:606] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Received request to transfer leadership to TS 38532dcf484240af9bb948d2ae8dc973
I20260709 12:22:24.872977 30089 raft_consensus.cc:993] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:24.873431 30094 raft_consensus.cc:1081] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:24.874847 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:22:24.875285 29941 raft_consensus.cc:493] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:24.875564 29941 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.879926 29941 raft_consensus.cc:515] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.881450 29941 leader_election.cc:290] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.882378 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:24.882927 29866 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.882814 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:24.883423 30014 raft_consensus.cc:3055] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:24.883776 30014 raft_consensus.cc:740] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:24.884666 30014 consensus_queue.cc:260] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.886042 30014 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.887492 29866 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:24.888492 29906 leader_election.cc:304] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.889119 30066 raft_consensus.cc:2804] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:24.889482 30066 raft_consensus.cc:697] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:24.890236 30066 consensus_queue.cc:237] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.892562 30014 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:24.896878 29763 catalog_manager.cc:5697] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 1 to 2, leader changed from 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:24.944631 30086 consensus_queue.cc:1048] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.957433 30065 consensus_queue.cc:1048] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:24.966280 30087 raft_consensus.cc:993] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:24.966759 30087 raft_consensus.cc:1081] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:24.968463 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48260
I20260709 12:22:24.969029 29941 raft_consensus.cc:493] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:24.969394 29941 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.974043 29941 raft_consensus.cc:515] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.975625 29941 leader_election.cc:290] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:24.976681 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:24.976948 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:24.977278 30016 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.977450 29866 raft_consensus.cc:3055] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:24.977806 29866 raft_consensus.cc:740] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:24.978590 29866 consensus_queue.cc:260] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.979687 29866 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.983852 30016 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:24.985149 29906 leader_election.cc:304] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:24.985954 30066 raft_consensus.cc:2804] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:24.986063 29866 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:24.986459 30066 raft_consensus.cc:697] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:24.987282 30066 consensus_queue.cc:237] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:24.993877 29761 catalog_manager.cc:5697] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 1 to 2, leader changed from a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.015268 30087 consensus_queue.cc:1048] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:25.026582 30091 consensus_queue.cc:1048] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:25.036724 30091 raft_consensus.cc:993] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24: : Instructing follower 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:25.037184 30091 raft_consensus.cc:1081] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Signalling peer 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:25.038972 30016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:49028
I20260709 12:22:25.039554 30016 raft_consensus.cc:493] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.039994 30016 raft_consensus.cc:3060] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.046520 30016 raft_consensus.cc:515] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.049124 30016 leader_election.cc:290] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 2 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:25.049397 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:25.049726 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb9bd61f81b42e6aa2bcee8b5d0ebe2" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:25.050027 29866 raft_consensus.cc:3055] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.050239 29941 raft_consensus.cc:3060] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.050369 29866 raft_consensus.cc:740] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:25.051179 29866 consensus_queue.cc:260] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.052402 29866 raft_consensus.cc:3060] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.056790 29941 raft_consensus.cc:2468] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 2.
I20260709 12:22:25.058080 29979 leader_election.cc:304] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:25.058763 29866 raft_consensus.cc:2468] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 2.
I20260709 12:22:25.058928 30094 raft_consensus.cc:2804] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.059453 30094 raft_consensus.cc:697] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:25.060303 30094 consensus_queue.cc:237] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.067214 29761 catalog_manager.cc:5697] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 1 to 2, leader changed from a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1) to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:25.171173 30135 raft_consensus.cc:993] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: : Instructing follower a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:25.171600 30066 raft_consensus.cc:1081] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Signalling peer a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:25.173056 29866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f706f032a934de18368dbda3524b16f"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:42210
I20260709 12:22:25.173537 29866 raft_consensus.cc:493] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.173830 29866 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.178321 29866 raft_consensus.cc:515] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.180042 29866 leader_election.cc:290] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 2 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:25.180928 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:25.181216 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:25.181505 29941 raft_consensus.cc:3055] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.181802 29941 raft_consensus.cc:740] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:25.181831 30016 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.182523 29941 consensus_queue.cc:260] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.183413 29941 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.187822 29941 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 2.
I20260709 12:22:25.188587 30016 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 2.
I20260709 12:22:25.188743 29830 leader_election.cc:304] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:25.189471 30091 raft_consensus.cc:2804] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.189926 30091 raft_consensus.cc:697] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:25.190716 30091 consensus_queue.cc:237] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.198294 29761 catalog_manager.cc:5697] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 1 to 2, leader changed from f8d677b486f34453b7a31079f8968377 (127.29.9.2) to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.216780 30089 raft_consensus.cc:993] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973: : Instructing follower a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:25.217267 30094 raft_consensus.cc:1081] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Signalling peer a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:25.218815 29866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:42196
I20260709 12:22:25.219254 29866 raft_consensus.cc:493] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.219553 29866 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.223757 29866 raft_consensus.cc:515] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.225317 29866 leader_election.cc:290] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 2 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:25.226234 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:25.226402 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:25.226750 29941 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.226982 30016 raft_consensus.cc:3055] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.227356 30016 raft_consensus.cc:740] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:25.228149 30016 consensus_queue.cc:260] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.229290 30016 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.231247 29941 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 2.
I20260709 12:22:25.232174 29830 leader_election.cc:304] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:25.232784 30091 raft_consensus.cc:2804] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.233152 30091 raft_consensus.cc:697] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:25.233917 30091 consensus_queue.cc:237] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.235569 30016 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 2.
I20260709 12:22:25.241586 29761 catalog_manager.cc:5697] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 1 to 2, leader changed from 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3) to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.276167 30067 raft_consensus.cc:993] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:25.276652 30094 raft_consensus.cc:1081] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:25.278093 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:22:25.278574 29941 raft_consensus.cc:493] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.278872 29941 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.284806 29941 raft_consensus.cc:515] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.286754 29941 leader_election.cc:290] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:25.287824 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:25.288583 29866 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.288578 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:25.290261 30016 raft_consensus.cc:3055] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.290650 30016 raft_consensus.cc:740] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:25.291594 30016 consensus_queue.cc:260] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.292800 30016 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.295547 29866 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:25.295970 30014 raft_consensus.cc:1275] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.297039 29906 leader_election.cc:304] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:25.297679 30135 raft_consensus.cc:2804] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.298097 30145 consensus_queue.cc:1048] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.298111 30135 raft_consensus.cc:697] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:25.299145 30135 consensus_queue.cc:237] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:25.299921 30016 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:25.309819 29866 raft_consensus.cc:1275] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.311415 30145 consensus_queue.cc:1048] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.311034 29761 catalog_manager.cc:5697] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 1 to 2, leader changed from 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.403034 29866 raft_consensus.cc:1275] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.404265 30145 consensus_queue.cc:1048] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.411809 30014 raft_consensus.cc:1275] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.415696 30066 consensus_queue.cc:1048] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.612694 29866 raft_consensus.cc:1275] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.613961 30094 consensus_queue.cc:1048] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.621206 29941 raft_consensus.cc:1275] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.622781 30094 consensus_queue.cc:1048] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.644389 30014 raft_consensus.cc:1275] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.645757 30091 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.654039 29941 raft_consensus.cc:1275] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.655438 30147 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.758553 30014 raft_consensus.cc:1275] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.759713 30147 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.768816 29941 raft_consensus.cc:1275] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.770156 30147 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.866427 29866 raft_consensus.cc:1275] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.867700 30146 consensus_queue.cc:1048] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.876381 30014 raft_consensus.cc:1275] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:25.878351 30135 consensus_queue.cc:1048] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.859050 29732 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:22:27.859860 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.875270 29866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
mode: GRACEFUL
new_leader_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:42224
I20260709 12:22:27.875922 29866 raft_consensus.cc:606] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Received request to transfer leadership to TS 38532dcf484240af9bb948d2ae8dc973
I20260709 12:22:27.885982 29940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
mode: GRACEFUL
new_leader_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:48272
I20260709 12:22:27.886492 29940 raft_consensus.cc:606] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Received request to transfer leadership to TS 38532dcf484240af9bb948d2ae8dc973
I20260709 12:22:27.887571 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:27.888080 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:28.026327 30147 raft_consensus.cc:993] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24: : Instructing follower 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:28.026714 30157 raft_consensus.cc:1081] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Signalling peer 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:28.028203 30014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:49028
I20260709 12:22:28.028656 30014 raft_consensus.cc:493] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.028929 30014 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.033703 30014 raft_consensus.cc:515] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:28.035177 30014 leader_election.cc:290] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 2 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:28.036028 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:28.036198 29940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:28.036679 29866 raft_consensus.cc:3055] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.036676 29940 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.037153 29866 raft_consensus.cc:740] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:28.037971 29866 consensus_queue.cc:260] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:28.039088 29866 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.043298 29940 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 2.
I20260709 12:22:28.044552 29979 leader_election.cc:304] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:28.044690 29866 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 2.
I20260709 12:22:28.045223 30153 raft_consensus.cc:2804] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.046376 30153 raft_consensus.cc:697] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:28.047091 30153 consensus_queue.cc:237] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:28.053462 29763 catalog_manager.cc:5697] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 1 to 2, leader changed from a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1) to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:28.329674 30164 raft_consensus.cc:993] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377: : Instructing follower 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:28.330109 30135 raft_consensus.cc:1081] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Signalling peer 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:28.331559 30014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:49038
I20260709 12:22:28.332106 30014 raft_consensus.cc:493] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.332407 30014 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.337078 30014 raft_consensus.cc:515] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:28.338564 30014 leader_election.cc:290] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 2 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:28.339425 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:28.339594 29940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:28.339931 29866 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.340135 29940 raft_consensus.cc:3055] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.340420 29940 raft_consensus.cc:740] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:28.341002 29940 consensus_queue.cc:260] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:28.341876 29940 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.343912 29866 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 2.
I20260709 12:22:28.344795 29980 leader_election.cc:304] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:28.345616 30153 raft_consensus.cc:2804] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.346118 30153 raft_consensus.cc:697] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:28.346865 29940 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 2.
I20260709 12:22:28.346925 30153 consensus_queue.cc:237] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:28.356084 29763 catalog_manager.cc:5697] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 1 to 2, leader changed from f8d677b486f34453b7a31079f8968377 (127.29.9.2) to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:28.452277 29866 raft_consensus.cc:1275] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.453452 30153 consensus_queue.cc:1048] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.462894 29940 raft_consensus.cc:1275] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.464438 30153 consensus_queue.cc:1048] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.748874 29940 raft_consensus.cc:1275] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.750073 30153 consensus_queue.cc:1048] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.758754 29866 raft_consensus.cc:1275] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.761834 30158 consensus_queue.cc:1048] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.888990 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:28.893927 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:28.894332 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.895133 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.900102 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:29.900501 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.901407 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.906550 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:30.906934 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:31.908174 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:31.913220 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:31.913679 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:32.914590 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:32.919762 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:32.920145 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:33.921012 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.926085 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:33.926465 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:34.927320 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:34.932130 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:34.932523 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:35.933408 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.938144 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:35.938552 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:36.939460 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.944195 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:36.944569 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:37.971968 29732 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:22:37.976824 29866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:22:37.977418 29866 raft_consensus.cc:606] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:37.982086 29866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f706f032a934de18368dbda3524b16f"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:22:37.982546 29866 raft_consensus.cc:606] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:37.986761 29866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:42220
I20260709 12:22:37.987187 29866 raft_consensus.cc:606] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:37.991994 30016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:49042
I20260709 12:22:37.992573 30016 raft_consensus.cc:606] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:38.000106 30016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
mode: GRACEFUL
new_leader_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:49042
I20260709 12:22:38.000654 30016 raft_consensus.cc:606] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Received request to transfer leadership to TS f8d677b486f34453b7a31079f8968377
I20260709 12:22:38.242419 30181 raft_consensus.cc:993] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.242924 30181 raft_consensus.cc:1081] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.244421 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f706f032a934de18368dbda3524b16f"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48260
I20260709 12:22:38.244946 29941 raft_consensus.cc:493] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:38.245223 29941 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.250620 29941 raft_consensus.cc:515] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.252264 29941 leader_election.cc:290] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:38.253054 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:38.253235 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:38.253717 29866 raft_consensus.cc:3055] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:38.253770 30016 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.253981 29866 raft_consensus.cc:740] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:38.254623 29866 consensus_queue.cc:260] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.255571 29866 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.258247 30016 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.259788 29906 leader_election.cc:304] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:38.260219 29866 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.260584 30135 raft_consensus.cc:2804] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:38.261952 30135 raft_consensus.cc:697] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:38.262821 30135 consensus_queue.cc:237] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.264153 30177 raft_consensus.cc:993] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.264550 30181 raft_consensus.cc:1081] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.266212 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48260
I20260709 12:22:38.266728 29941 raft_consensus.cc:493] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:38.267132 29941 raft_consensus.cc:3060] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.270664 29763 catalog_manager.cc:5697] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 2 to 3, leader changed from a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.272614 29941 raft_consensus.cc:515] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:38.274542 29941 leader_election.cc:290] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Requested vote from peers 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509), a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091)
I20260709 12:22:38.275410 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:38.275699 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85ac7d1e0cff4e1885f755f9f55ad272" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:38.276036 30016 raft_consensus.cc:3060] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.276244 29866 raft_consensus.cc:3055] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:38.276557 29866 raft_consensus.cc:740] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:38.277273 29866 consensus_queue.cc:260] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:38.278429 29866 raft_consensus.cc:3060] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:38.282191 30016 raft_consensus.cc:2468] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:38.283526 29906 leader_election.cc:304] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:38.284353 30135 raft_consensus.cc:2804] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:38.284660 29866 raft_consensus.cc:2468] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 2.
I20260709 12:22:38.284834 30135 raft_consensus.cc:697] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:38.285707 30135 consensus_queue.cc:237] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } }
I20260709 12:22:38.294515 29763 catalog_manager.cc:5697] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 1 to 2, leader changed from a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.382148 30158 raft_consensus.cc:993] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.382521 30158 raft_consensus.cc:1081] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.383770 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:22:38.384186 29941 raft_consensus.cc:493] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:38.384438 29941 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.388268 29941 raft_consensus.cc:515] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.389621 29941 leader_election.cc:290] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:38.390439 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:38.390606 30016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef9f3cfb4e445ce8a7f5670b8e4c3ab" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:38.390908 29866 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.391060 30016 raft_consensus.cc:3055] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:38.391389 30016 raft_consensus.cc:740] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:38.392076 30016 consensus_queue.cc:260] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.393213 30016 raft_consensus.cc:3060] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.395576 29866 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.396513 29906 leader_election.cc:304] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:38.397189 30135 raft_consensus.cc:2804] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:38.397526 30135 raft_consensus.cc:697] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:38.397814 30016 raft_consensus.cc:2468] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.398257 30135 consensus_queue.cc:237] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.404209 29763 catalog_manager.cc:5697] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 2 to 3, leader changed from 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.408521 30189 raft_consensus.cc:993] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.409000 30158 raft_consensus.cc:1081] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.410406 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48250
I20260709 12:22:38.410980 29941 raft_consensus.cc:493] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:38.411267 29941 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.415812 29941 raft_consensus.cc:515] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.417248 29941 leader_election.cc:290] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:38.417943 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:38.418256 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8e929cbe384787bec03b8cff1770ac" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:38.418498 29866 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.418890 30014 raft_consensus.cc:3055] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:38.419215 30014 raft_consensus.cc:740] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:38.419898 30014 consensus_queue.cc:260] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.420737 30014 raft_consensus.cc:3060] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.422891 29866 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.423775 29906 leader_election.cc:304] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a430268b4aa945bb8d2883c7a240cc24, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:38.424341 30135 raft_consensus.cc:2804] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:38.424665 30135 raft_consensus.cc:697] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:38.425089 30014 raft_consensus.cc:2468] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.425359 30135 consensus_queue.cc:237] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.431499 29763 catalog_manager.cc:5697] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 2 to 3, leader changed from 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.446143 30177 raft_consensus.cc:993] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24: : Instructing follower f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.446561 30181 raft_consensus.cc:1081] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Signalling peer f8d677b486f34453b7a31079f8968377 to start an election
I20260709 12:22:38.447902 29941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
 from {username='slave'} at 127.0.0.1:48260
I20260709 12:22:38.448315 29941 raft_consensus.cc:493] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:38.448565 29941 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.452440 29941 raft_consensus.cc:515] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.453779 29941 leader_election.cc:290] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:38.454612 29866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:38.454785 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "f8d677b486f34453b7a31079f8968377" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:38.455051 29866 raft_consensus.cc:3055] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:38.455232 30014 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.455332 29866 raft_consensus.cc:740] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:38.455961 29866 consensus_queue.cc:260] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.456727 29866 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:38.459335 30014 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.460248 29906 leader_election.cc:304] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, f8d677b486f34453b7a31079f8968377; no voters: 
I20260709 12:22:38.460747 29866 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d677b486f34453b7a31079f8968377 in term 3.
I20260709 12:22:38.460868 30135 raft_consensus.cc:2804] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:38.461264 30135 raft_consensus.cc:697] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Becoming Leader. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:38.462004 30135 consensus_queue.cc:237] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:38.467998 29763 catalog_manager.cc:5697] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 reported cstate change: term changed from 2 to 3, leader changed from a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1) to f8d677b486f34453b7a31079f8968377 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "f8d677b486f34453b7a31079f8968377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.724795 29866 raft_consensus.cc:1275] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:38.726286 30135 consensus_queue.cc:1048] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:38.729607 29867 raft_consensus.cc:1275] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.732869 30182 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:38.739861 30014 raft_consensus.cc:1275] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:38.741513 30182 consensus_queue.cc:1048] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:22:38.753613 30016 raft_consensus.cc:1275] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.755862 30194 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:38.840759 29866 raft_consensus.cc:1275] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.842140 30135 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:38.850854 30016 raft_consensus.cc:1275] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.852221 30182 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:38.857990 30014 raft_consensus.cc:1275] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.859844 30135 consensus_queue.cc:1048] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:38.871078 29866 raft_consensus.cc:1275] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.872702 30182 consensus_queue.cc:1048] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:38.874670 30016 raft_consensus.cc:1275] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.875999 30182 consensus_queue.cc:1048] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:38.887949 29867 raft_consensus.cc:1275] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Refusing update from remote peer f8d677b486f34453b7a31079f8968377: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:38.889621 30135 consensus_queue.cc:1048] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:41.036938 29732 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:22:41.037658 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.044644 29941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
mode: GRACEFUL
new_leader_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:48272
I20260709 12:22:41.045125 29941 raft_consensus.cc:606] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Received request to transfer leadership to TS a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:41.047504 29941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f706f032a934de18368dbda3524b16f"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
mode: GRACEFUL
new_leader_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:48272
I20260709 12:22:41.047950 29941 raft_consensus.cc:606] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Received request to transfer leadership to TS 38532dcf484240af9bb948d2ae8dc973
I20260709 12:22:41.050072 29941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
mode: GRACEFUL
new_leader_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:48272
I20260709 12:22:41.050508 29941 raft_consensus.cc:606] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Received request to transfer leadership to TS a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:41.052482 29941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
mode: GRACEFUL
new_leader_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:48272
I20260709 12:22:41.052865 29941 raft_consensus.cc:606] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Received request to transfer leadership to TS 38532dcf484240af9bb948d2ae8dc973
I20260709 12:22:41.054986 29941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c"
dest_uuid: "f8d677b486f34453b7a31079f8968377"
mode: GRACEFUL
new_leader_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:48272
I20260709 12:22:41.055513 29941 raft_consensus.cc:606] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Received request to transfer leadership to TS a430268b4aa945bb8d2883c7a240cc24
I20260709 12:22:41.056423 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:41.056818 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:41.078562 30194 raft_consensus.cc:993] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: : Instructing follower 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:41.078996 30208 raft_consensus.cc:1081] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Signalling peer 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:41.080247 30014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f706f032a934de18368dbda3524b16f"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:49038
I20260709 12:22:41.080631 30014 raft_consensus.cc:493] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:41.080845 30014 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.084602 30014 raft_consensus.cc:515] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.086424 30014 leader_election.cc:290] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 4 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:41.087133 29867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:41.087323 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706f032a934de18368dbda3524b16f" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:41.087711 29867 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.087821 29941 raft_consensus.cc:3055] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.088105 29941 raft_consensus.cc:740] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:41.088759 29941 consensus_queue.cc:260] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.089545 29941 raft_consensus.cc:3060] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.092339 29867 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 4.
I20260709 12:22:41.093441 29941 raft_consensus.cc:2468] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 4.
I20260709 12:22:41.093434 29980 leader_election.cc:304] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:41.094311 30158 raft_consensus.cc:2804] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:41.095278 30158 raft_consensus.cc:697] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 4 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:41.096010 30158 consensus_queue.cc:237] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.101533 29761 catalog_manager.cc:5697] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 3 to 4, leader changed from f8d677b486f34453b7a31079f8968377 (127.29.9.2) to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 4 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.109584 30208 raft_consensus.cc:993] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377: : Instructing follower 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:41.110065 30208 raft_consensus.cc:1081] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Signalling peer 38532dcf484240af9bb948d2ae8dc973 to start an election
I20260709 12:22:41.111590 30014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151"
dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
 from {username='slave'} at 127.0.0.1:49038
I20260709 12:22:41.112047 30014 raft_consensus.cc:493] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:41.112349 30014 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.116739 30014 raft_consensus.cc:515] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.118185 30014 leader_election.cc:290] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 3 election: Requested vote from peers a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091), f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093)
I20260709 12:22:41.118884 29867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
I20260709 12:22:41.119105 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8845bdc59f9649d0b722e61fdbde6151" candidate_uuid: "38532dcf484240af9bb948d2ae8dc973" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:41.119495 29867 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.119585 29941 raft_consensus.cc:3055] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:41.119923 29941 raft_consensus.cc:740] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:41.120600 29941 consensus_queue.cc:260] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.121742 29941 raft_consensus.cc:3060] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.125939 29867 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 3.
I20260709 12:22:41.127059 29980 leader_election.cc:304] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:41.127266 29941 raft_consensus.cc:2468] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38532dcf484240af9bb948d2ae8dc973 in term 3.
I20260709 12:22:41.127703 30158 raft_consensus.cc:2804] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:41.128157 30158 raft_consensus.cc:697] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 3 LEADER]: Becoming Leader. State: Replica: 38532dcf484240af9bb948d2ae8dc973, State: Running, Role: LEADER
I20260709 12:22:41.128795 30158 consensus_queue.cc:237] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.135115 29761 catalog_manager.cc:5697] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 reported cstate change: term changed from 2 to 3, leader changed from f8d677b486f34453b7a31079f8968377 (127.29.9.2) to 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "38532dcf484240af9bb948d2ae8dc973" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.211535 30213 raft_consensus.cc:993] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377: : Instructing follower a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:41.211966 30208 raft_consensus.cc:1081] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Signalling peer a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:41.213258 29867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:42210
I20260709 12:22:41.213709 29867 raft_consensus.cc:493] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:41.213995 29867 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.218286 29867 raft_consensus.cc:515] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.220265 29867 leader_election.cc:290] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 3 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:41.220971 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:41.221280 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87f9655a57b4727afbf6ff7fee7e67c" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:41.221506 29941 raft_consensus.cc:3055] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:41.221745 30014 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.221774 29941 raft_consensus.cc:740] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:41.222587 29941 consensus_queue.cc:260] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.223379 29941 raft_consensus.cc:3060] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.225863 30014 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 3.
I20260709 12:22:41.226922 29831 leader_election.cc:304] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:41.227248 29941 raft_consensus.cc:2468] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 3.
I20260709 12:22:41.228714 30217 raft_consensus.cc:2804] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:41.229643 30217 raft_consensus.cc:697] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 3 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:41.230376 30217 consensus_queue.cc:237] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.236837 29761 catalog_manager.cc:5697] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 2 to 3, leader changed from f8d677b486f34453b7a31079f8968377 (127.29.9.2) to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.259255 30213 raft_consensus.cc:993] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377: : Instructing follower a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:41.259644 30208 raft_consensus.cc:1081] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Signalling peer a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:41.260996 29867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:42210
I20260709 12:22:41.261416 29867 raft_consensus.cc:493] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:41.261674 29867 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.266044 29867 raft_consensus.cc:515] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.267630 29867 leader_election.cc:290] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 3 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:41.268379 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:41.268697 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d34d6cfa0c34381ae8695c6428ecdf4" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:41.268842 29941 raft_consensus.cc:3055] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:41.269104 29941 raft_consensus.cc:740] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:41.269137 30014 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.269848 29941 consensus_queue.cc:260] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.270792 29941 raft_consensus.cc:3060] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:41.274430 30014 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 3.
I20260709 12:22:41.275257 29831 leader_election.cc:304] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:41.275892 30217 raft_consensus.cc:2804] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:41.275887 29941 raft_consensus.cc:2468] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 3.
I20260709 12:22:41.276469 30217 raft_consensus.cc:697] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 3 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:41.277236 30217 consensus_queue.cc:237] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.300688 29761 catalog_manager.cc:5697] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 2 to 3, leader changed from f8d677b486f34453b7a31079f8968377 (127.29.9.2) to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.316574 30208 raft_consensus.cc:993] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377: : Instructing follower a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:41.317078 30213 raft_consensus.cc:1081] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Signalling peer a430268b4aa945bb8d2883c7a240cc24 to start an election
I20260709 12:22:41.318553 29867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83"
dest_uuid: "a430268b4aa945bb8d2883c7a240cc24"
 from {username='slave'} at 127.0.0.1:42210
I20260709 12:22:41.319053 29867 raft_consensus.cc:493] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:41.319329 29867 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.324612 29867 raft_consensus.cc:515] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.326375 29867 leader_election.cc:290] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 4 election: Requested vote from peers f8d677b486f34453b7a31079f8968377 (127.29.9.2:42093), 38532dcf484240af9bb948d2ae8dc973 (127.29.9.3:39509)
I20260709 12:22:41.327654 29941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f8d677b486f34453b7a31079f8968377"
I20260709 12:22:41.327795 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22dd2cae09f447689e52e15534fd2a83" candidate_uuid: "a430268b4aa945bb8d2883c7a240cc24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "38532dcf484240af9bb948d2ae8dc973"
I20260709 12:22:41.328212 29941 raft_consensus.cc:3055] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.328316 30014 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.328464 29941 raft_consensus.cc:740] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f8d677b486f34453b7a31079f8968377, State: Running, Role: LEADER
I20260709 12:22:41.329205 29941 consensus_queue.cc:260] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.330090 29941 raft_consensus.cc:3060] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.333040 30014 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 4.
I20260709 12:22:41.334208 29831 leader_election.cc:304] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38532dcf484240af9bb948d2ae8dc973, a430268b4aa945bb8d2883c7a240cc24; no voters: 
I20260709 12:22:41.334765 29941 raft_consensus.cc:2468] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a430268b4aa945bb8d2883c7a240cc24 in term 4.
I20260709 12:22:41.335222 30217 raft_consensus.cc:2804] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:41.335630 30217 raft_consensus.cc:697] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 4 LEADER]: Becoming Leader. State: Replica: a430268b4aa945bb8d2883c7a240cc24, State: Running, Role: LEADER
I20260709 12:22:41.336551 30217 consensus_queue.cc:237] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } }
I20260709 12:22:41.343812 29761 catalog_manager.cc:5697] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 reported cstate change: term changed from 3 to 4, leader changed from f8d677b486f34453b7a31079f8968377 (127.29.9.2) to a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1). New cstate: current_term: 4 leader_uuid: "a430268b4aa945bb8d2883c7a240cc24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.537535 29867 raft_consensus.cc:1275] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 4 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:41.539042 30158 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:41.549929 29941 raft_consensus.cc:1275] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:41.552151 30158 consensus_queue.cc:1048] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:41.650338 30014 raft_consensus.cc:1275] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:41.651422 30217 consensus_queue.cc:1048] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:41.659894 29941 raft_consensus.cc:1275] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:41.661923 30230 consensus_queue.cc:1048] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:41.663573 29867 raft_consensus.cc:1275] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:41.665891 30209 consensus_queue.cc:1048] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a430268b4aa945bb8d2883c7a240cc24" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:41.680333 29941 raft_consensus.cc:1275] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Refusing update from remote peer 38532dcf484240af9bb948d2ae8dc973: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:41.682078 30158 consensus_queue.cc:1048] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:41.770723 29941 raft_consensus.cc:1275] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:41.771996 30230 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:41.780158 30014 raft_consensus.cc:1275] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 4 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:41.781873 30217 consensus_queue.cc:1048] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:41.796669 29941 raft_consensus.cc:1275] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:41.797621 30217 consensus_queue.cc:1048] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d677b486f34453b7a31079f8968377" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 42093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:41.806972 30014 raft_consensus.cc:1275] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Refusing update from remote peer a430268b4aa945bb8d2883c7a240cc24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:41.808596 30230 consensus_queue.cc:1048] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38532dcf484240af9bb948d2ae8dc973" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:42.058145 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:42.062942 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:42.063352 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.064529 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.069226 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:43.069630 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.070690 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.075541 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:44.075932 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:45.076884 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.082767 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:45.083160 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.084194 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.088956 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:46.089310 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:47.090261 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.094986 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:47.095353 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:48.096333 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.100955 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:48.101295 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:49.102252 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.108428 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:49.108881 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.109848 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.115038 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:50.115437 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.142792 29732 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:22:51.143388 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
W20260709 12:22:51.152993 29980 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:51.158063 29980 consensus_peers.cc:597] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 -> Peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Couldn't send request to peer a430268b4aa945bb8d2883c7a240cc24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:51.167838 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:51.168555 29732 tablet_replica.cc:333] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.169167 29732 raft_consensus.cc:2243] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.169667 29732 raft_consensus.cc:2272] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.171823 29732 tablet_replica.cc:333] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.172313 29732 raft_consensus.cc:2243] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.173004 29732 raft_consensus.cc:2272] T 5d34d6cfa0c34381ae8695c6428ecdf4 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.174640 29732 tablet_replica.cc:333] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.175076 29732 raft_consensus.cc:2243] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.175427 29732 raft_consensus.cc:2272] T 3f706f032a934de18368dbda3524b16f P a430268b4aa945bb8d2883c7a240cc24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.177112 29732 tablet_replica.cc:333] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.177821 29732 raft_consensus.cc:2243] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.178730 29732 raft_consensus.cc:2272] T d87f9655a57b4727afbf6ff7fee7e67c P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.180680 29732 tablet_replica.cc:333] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
W20260709 12:22:51.180764 29906 consensus_peers.cc:597] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 -> Peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Couldn't send request to peer a430268b4aa945bb8d2883c7a240cc24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:51.181159 29732 raft_consensus.cc:2243] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.181605 29732 raft_consensus.cc:2272] T fb8e929cbe384787bec03b8cff1770ac P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:51.182125 29906 consensus_peers.cc:597] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 -> Peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Couldn't send request to peer a430268b4aa945bb8d2883c7a240cc24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:51.183522 29732 tablet_replica.cc:333] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.184038 29732 raft_consensus.cc:2243] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.184432 29732 raft_consensus.cc:2272] T 8845bdc59f9649d0b722e61fdbde6151 P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.186208 29732 tablet_replica.cc:333] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.186698 29732 raft_consensus.cc:2243] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.187348 29732 raft_consensus.cc:2272] T 22dd2cae09f447689e52e15534fd2a83 P a430268b4aa945bb8d2883c7a240cc24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.188935 29732 tablet_replica.cc:333] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.189349 29732 raft_consensus.cc:2243] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.189724 29732 raft_consensus.cc:2272] T 85ac7d1e0cff4e1885f755f9f55ad272 P a430268b4aa945bb8d2883c7a240cc24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.191246 29732 tablet_replica.cc:333] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24: stopping tablet replica
I20260709 12:22:51.191648 29732 raft_consensus.cc:2243] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.192080 29732 raft_consensus.cc:2272] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P a430268b4aa945bb8d2883c7a240cc24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.275193 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
W20260709 12:22:51.278734 29980 consensus_peers.cc:597] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 -> Peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Couldn't send request to peer a430268b4aa945bb8d2883c7a240cc24. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:38091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:51.294669 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
I20260709 12:22:51.332821 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:51.333818 29732 tablet_replica.cc:333] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.334861 29732 raft_consensus.cc:2243] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.335523 29732 raft_consensus.cc:2272] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.337579 29732 tablet_replica.cc:333] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.338267 29732 raft_consensus.cc:2243] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.338758 29732 raft_consensus.cc:2272] T 5d34d6cfa0c34381ae8695c6428ecdf4 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.340583 29732 tablet_replica.cc:333] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.341100 29732 raft_consensus.cc:2243] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.341600 29732 raft_consensus.cc:2272] T 3f706f032a934de18368dbda3524b16f P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.343393 29732 tablet_replica.cc:333] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.344180 29732 raft_consensus.cc:2243] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.344745 29732 raft_consensus.cc:2272] T d87f9655a57b4727afbf6ff7fee7e67c P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.346556 29732 tablet_replica.cc:333] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.347044 29732 raft_consensus.cc:2243] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.348440 29732 raft_consensus.cc:2272] T fb8e929cbe384787bec03b8cff1770ac P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.350286 29732 tablet_replica.cc:333] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.350762 29732 raft_consensus.cc:2243] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.351675 29732 raft_consensus.cc:2272] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.353500 29732 tablet_replica.cc:333] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.353961 29732 raft_consensus.cc:2243] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.354831 29732 raft_consensus.cc:2272] T 85ac7d1e0cff4e1885f755f9f55ad272 P f8d677b486f34453b7a31079f8968377 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.356535 29732 tablet_replica.cc:333] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.356976 29732 raft_consensus.cc:2243] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.357409 29732 raft_consensus.cc:2272] T 22dd2cae09f447689e52e15534fd2a83 P f8d677b486f34453b7a31079f8968377 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.358875 29732 tablet_replica.cc:333] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377: stopping tablet replica
I20260709 12:22:51.359297 29732 raft_consensus.cc:2243] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.359768 29732 raft_consensus.cc:2272] T 8845bdc59f9649d0b722e61fdbde6151 P f8d677b486f34453b7a31079f8968377 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.388569 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
W20260709 12:22:51.398478 29980 consensus_peers.cc:597] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 -> Peer a430268b4aa945bb8d2883c7a240cc24 (127.29.9.1:38091): Couldn't send request to peer a430268b4aa945bb8d2883c7a240cc24. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:38091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:51.408991 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
I20260709 12:22:51.429147 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:51.429976 29732 tablet_replica.cc:333] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.431056 29732 raft_consensus.cc:2243] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.431782 29732 raft_consensus.cc:2272] T 5d34d6cfa0c34381ae8695c6428ecdf4 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.433656 29732 tablet_replica.cc:333] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.434120 29732 raft_consensus.cc:2243] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.435031 29732 raft_consensus.cc:2272] T 6eb9bd61f81b42e6aa2bcee8b5d0ebe2 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.436827 29732 tablet_replica.cc:333] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.437377 29732 raft_consensus.cc:2243] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.437831 29732 raft_consensus.cc:2272] T fb8e929cbe384787bec03b8cff1770ac P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.439419 29732 tablet_replica.cc:333] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.439962 29732 raft_consensus.cc:2243] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.440778 29732 raft_consensus.cc:2272] T 8845bdc59f9649d0b722e61fdbde6151 P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.442584 29732 tablet_replica.cc:333] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.443104 29732 raft_consensus.cc:2243] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.443552 29732 raft_consensus.cc:2272] T 85ac7d1e0cff4e1885f755f9f55ad272 P 38532dcf484240af9bb948d2ae8dc973 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.445282 29732 tablet_replica.cc:333] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.445731 29732 raft_consensus.cc:2243] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.446211 29732 raft_consensus.cc:2272] T 22dd2cae09f447689e52e15534fd2a83 P 38532dcf484240af9bb948d2ae8dc973 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.447974 29732 tablet_replica.cc:333] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.448436 29732 raft_consensus.cc:2243] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.448884 29732 raft_consensus.cc:2272] T d87f9655a57b4727afbf6ff7fee7e67c P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.450538 29732 tablet_replica.cc:333] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.450991 29732 raft_consensus.cc:2243] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.451825 29732 raft_consensus.cc:2272] T 3f706f032a934de18368dbda3524b16f P 38532dcf484240af9bb948d2ae8dc973 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.453437 29732 tablet_replica.cc:333] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973: stopping tablet replica
I20260709 12:22:51.453919 29732 raft_consensus.cc:2243] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.454341 29732 raft_consensus.cc:2272] T 5ef9f3cfb4e445ce8a7f5670b8e4c3ab P 38532dcf484240af9bb948d2ae8dc973 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.480708 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
I20260709 12:22:51.498215 29732 master.cc:562] Master@127.29.9.62:35907 shutting down...
I20260709 12:22:51.520087 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.520735 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.521061 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P c12ef1968b584962b56d9c5fa14f281f: stopping tablet replica
I20260709 12:22:51.539625 29732 master.cc:584] Master@127.29.9.62:35907 shutdown complete.
38532dcf484240af9bb948d2ae8dc973  1
a430268b4aa945bb8d2883c7a240cc24  4
f8d677b486f34453b7a31079f8968377  4
38532dcf484240af9bb948d2ae8dc973  3
a430268b4aa945bb8d2883c7a240cc24  3
f8d677b486f34453b7a31079f8968377  3
38532dcf484240af9bb948d2ae8dc973  1
a430268b4aa945bb8d2883c7a240cc24  0
f8d677b486f34453b7a31079f8968377  8
38532dcf484240af9bb948d2ae8dc973  3
a430268b4aa945bb8d2883c7a240cc24  3
f8d677b486f34453b7a31079f8968377  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30356 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:22:51.578697 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:32829
I20260709 12:22:51.579787 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.584880 30249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.585742 30250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.586148 30252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.587201 29732 server_base.cc:1061] running on GCE node
I20260709 12:22:51.588219 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:51.588428 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.588542 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599771588526 us; error 0 us; skew 500 ppm
I20260709 12:22:51.588994 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.591326 29732 webserver.cc:533] Webserver started at http://127.29.9.62:41503/ using document root <none> and password file <none>
I20260709 12:22:51.591830 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.591995 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.592207 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.593372 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "9794bbfe7a8240118743f17a687e321e"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.597957 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:22:51.601189 30257 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.601961 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:22:51.602228 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "9794bbfe7a8240118743f17a687e321e"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.602507 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.611971 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.613173 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.650031 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:32829
I20260709 12:22:51.650108 30308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:32829 every 8 connection(s)
I20260709 12:22:51.653954 30309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:51.663067 30309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e: Bootstrap starting.
I20260709 12:22:51.667562 30309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.671504 30309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e: No bootstrap required, opened a new log
I20260709 12:22:51.673604 30309 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9794bbfe7a8240118743f17a687e321e" member_type: VOTER }
I20260709 12:22:51.674021 30309 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.674232 30309 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9794bbfe7a8240118743f17a687e321e, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.674752 30309 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9794bbfe7a8240118743f17a687e321e" member_type: VOTER }
I20260709 12:22:51.675186 30309 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:51.675410 30309 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:51.675657 30309 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.679461 30309 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9794bbfe7a8240118743f17a687e321e" member_type: VOTER }
I20260709 12:22:51.679978 30309 leader_election.cc:304] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9794bbfe7a8240118743f17a687e321e; no voters: 
I20260709 12:22:51.680981 30309 leader_election.cc:290] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:51.681384 30312 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.682559 30312 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 1 LEADER]: Becoming Leader. State: Replica: 9794bbfe7a8240118743f17a687e321e, State: Running, Role: LEADER
I20260709 12:22:51.683223 30312 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9794bbfe7a8240118743f17a687e321e" member_type: VOTER }
I20260709 12:22:51.683668 30309 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:51.689571 30313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9794bbfe7a8240118743f17a687e321e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9794bbfe7a8240118743f17a687e321e" member_type: VOTER } }
I20260709 12:22:51.689607 30314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9794bbfe7a8240118743f17a687e321e. Latest consensus state: current_term: 1 leader_uuid: "9794bbfe7a8240118743f17a687e321e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9794bbfe7a8240118743f17a687e321e" member_type: VOTER } }
I20260709 12:22:51.690461 30313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:51.690515 30314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:51.692451 30322 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:51.697474 30322 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:51.698486 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:51.706409 30322 catalog_manager.cc:1383] Generated new cluster ID: f4a3d59a0b944505b182f8a7f80f2045
I20260709 12:22:51.706715 30322 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:51.728197 30322 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:51.729418 30322 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:51.741288 30322 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e: Generated new TSK 0
I20260709 12:22:51.741884 30322 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:51.765424 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.771652 30330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.772354 30331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.773723 30333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.774149 29732 server_base.cc:1061] running on GCE node
I20260709 12:22:51.774935 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:51.775102 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.775218 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599771775207 us; error 0 us; skew 500 ppm
I20260709 12:22:51.775676 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.777853 29732 webserver.cc:533] Webserver started at http://127.29.9.1:42377/ using document root <none> and password file <none>
I20260709 12:22:51.778338 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.778491 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.778693 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.779656 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "88e01eb7e17e478cb41a6b289f539040"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.783963 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:51.786978 30338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.787673 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:51.788018 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "88e01eb7e17e478cb41a6b289f539040"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.788286 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.800427 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.801749 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.803193 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:51.805560 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:51.805770 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.805985 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:51.806141 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.843361 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:38165
I20260709 12:22:51.843459 30400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:38165 every 8 connection(s)
I20260709 12:22:51.848086 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.855104 30405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.856606 30406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.858237 29732 server_base.cc:1061] running on GCE node
W20260709 12:22:51.858343 30408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.859395 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:51.859593 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.859800 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599771859779 us; error 0 us; skew 500 ppm
I20260709 12:22:51.860491 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.862023 30401 heartbeater.cc:344] Connected to a master server at 127.29.9.62:32829
I20260709 12:22:51.862339 30401 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:51.862983 30401 heartbeater.cc:507] Master 127.29.9.62:32829 requested a full tablet report, sending...
I20260709 12:22:51.863157 29732 webserver.cc:533] Webserver started at http://127.29.9.2:44499/ using document root <none> and password file <none>
I20260709 12:22:51.863662 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.863891 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.864193 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.865077 30274 ts_manager.cc:194] Registered new tserver with Master: 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165)
I20260709 12:22:51.865398 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "d6e34823cd7341ceb7718ac70ef79508"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.866816 30274 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53290
I20260709 12:22:51.870232 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:22:51.873570 30413 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.874246 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:22:51.874542 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "d6e34823cd7341ceb7718ac70ef79508"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.874810 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.890410 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.891616 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.893071 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:51.895251 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:51.895452 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.895684 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:51.895850 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:51.933755 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:37729
I20260709 12:22:51.933846 30475 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:37729 every 8 connection(s)
I20260709 12:22:51.938118 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.945659 30480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.945607 30479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.948355 29732 server_base.cc:1061] running on GCE node
W20260709 12:22:51.949502 30482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.950568 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:51.950830 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.951030 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599771951013 us; error 0 us; skew 500 ppm
I20260709 12:22:51.951615 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.951953 30476 heartbeater.cc:344] Connected to a master server at 127.29.9.62:32829
I20260709 12:22:51.952284 30476 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:51.953153 30476 heartbeater.cc:507] Master 127.29.9.62:32829 requested a full tablet report, sending...
I20260709 12:22:51.954170 29732 webserver.cc:533] Webserver started at http://127.29.9.3:44115/ using document root <none> and password file <none>
I20260709 12:22:51.954653 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.954833 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.954985 30274 ts_manager.cc:194] Registered new tserver with Master: d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:51.955073 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.956312 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "641f517d83c347a390a75c7744c293e8"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.956368 30274 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53298
I20260709 12:22:51.960819 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:22:51.964152 30487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.964921 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:22:51.965236 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "641f517d83c347a390a75c7744c293e8"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-ftzc"
I20260709 12:22:51.965514 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.978658 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.979872 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.981251 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:51.983351 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:51.983543 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.983777 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:51.983933 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:52.021200 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:44915
I20260709 12:22:52.021317 30549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:44915 every 8 connection(s)
I20260709 12:22:52.034149 30550 heartbeater.cc:344] Connected to a master server at 127.29.9.62:32829
I20260709 12:22:52.034543 30550 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:52.035326 30550 heartbeater.cc:507] Master 127.29.9.62:32829 requested a full tablet report, sending...
I20260709 12:22:52.037305 30274 ts_manager.cc:194] Registered new tserver with Master: 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.037415 29732 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013306134s
I20260709 12:22:52.038625 30274 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53304
I20260709 12:22:52.061892 30274 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53318:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:52.064719 30274 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:52.136309 30515 tablet_service.cc:1511] Processing CreateTablet for tablet 9b27da61aaf34884923faa7f2574251e (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:52.136765 30514 tablet_service.cc:1511] Processing CreateTablet for tablet fb56271011824a0e8ce6c6ab393ef6a0 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:52.137809 30515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b27da61aaf34884923faa7f2574251e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.138370 30514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb56271011824a0e8ce6c6ab393ef6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.140084 30513 tablet_service.cc:1511] Processing CreateTablet for tablet 920bd8cab74646e79972859bb87ded4c (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:52.141219 30513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920bd8cab74646e79972859bb87ded4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.144228 30512 tablet_service.cc:1511] Processing CreateTablet for tablet 151d51bac3f6483e8bf730de881fcf16 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:52.145601 30512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151d51bac3f6483e8bf730de881fcf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.149432 30511 tablet_service.cc:1511] Processing CreateTablet for tablet 7985e70a06dd436883ec1289807cfa8e (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:52.150792 30511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7985e70a06dd436883ec1289807cfa8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.157437 30510 tablet_service.cc:1511] Processing CreateTablet for tablet c24a727a611d4cf597902aa75f5f3813 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:52.158782 30510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24a727a611d4cf597902aa75f5f3813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.162581 30509 tablet_service.cc:1511] Processing CreateTablet for tablet 3c802fb55c484341b1a09ef24085d9e8 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:52.163940 30509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c802fb55c484341b1a09ef24085d9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.179965 30515 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3ac604384f419eb15d2ee5058e4c3a (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:52.181326 30515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3ac604384f419eb15d2ee5058e4c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.176429 30513 tablet_service.cc:1511] Processing CreateTablet for tablet 14feb88ffafe4dbe94f6c8581945f738 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:52.185418 30513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14feb88ffafe4dbe94f6c8581945f738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.185447 30508 tablet_service.cc:1511] Processing CreateTablet for tablet d9fcbf8d97ca4c9c98be4ddbcd5cc95f (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:52.186833 30508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9fcbf8d97ca4c9c98be4ddbcd5cc95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.204836 30362 tablet_service.cc:1511] Processing CreateTablet for tablet 7985e70a06dd436883ec1289807cfa8e (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:52.205472 30360 tablet_service.cc:1511] Processing CreateTablet for tablet 3c802fb55c484341b1a09ef24085d9e8 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:52.206223 30362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7985e70a06dd436883ec1289807cfa8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.206514 30366 tablet_service.cc:1511] Processing CreateTablet for tablet 9b27da61aaf34884923faa7f2574251e (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:52.207826 30366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b27da61aaf34884923faa7f2574251e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.207682 30359 tablet_service.cc:1511] Processing CreateTablet for tablet 14feb88ffafe4dbe94f6c8581945f738 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:52.208853 30441 tablet_service.cc:1511] Processing CreateTablet for tablet 9b27da61aaf34884923faa7f2574251e (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:52.210225 30441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b27da61aaf34884923faa7f2574251e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.209874 30358 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3ac604384f419eb15d2ee5058e4c3a (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:52.211190 30358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3ac604384f419eb15d2ee5058e4c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.212134 30360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c802fb55c484341b1a09ef24085d9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.214623 30364 tablet_service.cc:1511] Processing CreateTablet for tablet 920bd8cab74646e79972859bb87ded4c (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:52.215548 30359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14feb88ffafe4dbe94f6c8581945f738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.218036 30439 tablet_service.cc:1511] Processing CreateTablet for tablet 920bd8cab74646e79972859bb87ded4c (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:52.219340 30439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920bd8cab74646e79972859bb87ded4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.224188 30361 tablet_service.cc:1511] Processing CreateTablet for tablet c24a727a611d4cf597902aa75f5f3813 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:52.227536 30363 tablet_service.cc:1511] Processing CreateTablet for tablet 151d51bac3f6483e8bf730de881fcf16 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:52.212980 30440 tablet_service.cc:1511] Processing CreateTablet for tablet fb56271011824a0e8ce6c6ab393ef6a0 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:52.228983 30357 tablet_service.cc:1511] Processing CreateTablet for tablet d9fcbf8d97ca4c9c98be4ddbcd5cc95f (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:52.229471 30436 tablet_service.cc:1511] Processing CreateTablet for tablet c24a727a611d4cf597902aa75f5f3813 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:52.230145 30440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb56271011824a0e8ce6c6ab393ef6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.212980 30365 tablet_service.cc:1511] Processing CreateTablet for tablet fb56271011824a0e8ce6c6ab393ef6a0 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:52.233018 30437 tablet_service.cc:1511] Processing CreateTablet for tablet 7985e70a06dd436883ec1289807cfa8e (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:52.235023 30438 tablet_service.cc:1511] Processing CreateTablet for tablet 151d51bac3f6483e8bf730de881fcf16 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:52.236088 30436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24a727a611d4cf597902aa75f5f3813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.236760 30438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151d51bac3f6483e8bf730de881fcf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.237435 30437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7985e70a06dd436883ec1289807cfa8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.239161 30364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920bd8cab74646e79972859bb87ded4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.241367 30365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb56271011824a0e8ce6c6ab393ef6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.244155 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9fcbf8d97ca4c9c98be4ddbcd5cc95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.249668 30363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151d51bac3f6483e8bf730de881fcf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.253232 30435 tablet_service.cc:1511] Processing CreateTablet for tablet 3c802fb55c484341b1a09ef24085d9e8 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:52.254251 30361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24a727a611d4cf597902aa75f5f3813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.256647 30434 tablet_service.cc:1511] Processing CreateTablet for tablet 14feb88ffafe4dbe94f6c8581945f738 (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:52.259287 30433 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3ac604384f419eb15d2ee5058e4c3a (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:52.262715 30432 tablet_service.cc:1511] Processing CreateTablet for tablet d9fcbf8d97ca4c9c98be4ddbcd5cc95f (DEFAULT_TABLE table=test-workload [id=dd831b1806d9436493e9256252d1d94a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:52.263172 30435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c802fb55c484341b1a09ef24085d9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.264546 30432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9fcbf8d97ca4c9c98be4ddbcd5cc95f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.266407 30433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3ac604384f419eb15d2ee5058e4c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.272119 30434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14feb88ffafe4dbe94f6c8581945f738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.290724 30565 tablet_bootstrap.cc:492] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.336905 30566 tablet_bootstrap.cc:492] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.342501 30567 tablet_bootstrap.cc:492] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.349583 30566 tablet_bootstrap.cc:654] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.358516 30567 tablet_bootstrap.cc:654] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.364084 30566 tablet_bootstrap.cc:492] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.364550 30566 ts_tablet_manager.cc:1403] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 12:22:52.365006 30565 tablet_bootstrap.cc:654] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.365646 30567 tablet_bootstrap.cc:492] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.366113 30567 ts_tablet_manager.cc:1403] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:22:52.366824 30566 raft_consensus.cc:359] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.367431 30566 raft_consensus.cc:385] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.367828 30566 raft_consensus.cc:740] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.368707 30566 consensus_queue.cc:260] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.368947 30567 raft_consensus.cc:359] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.369526 30567 raft_consensus.cc:385] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.369735 30567 raft_consensus.cc:740] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.370334 30567 consensus_queue.cc:260] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.371120 30401 heartbeater.cc:499] Master 127.29.9.62:32829 was elected leader, sending a full tablet report...
I20260709 12:22:52.371708 30566 ts_tablet_manager.cc:1434] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:52.372419 30476 heartbeater.cc:499] Master 127.29.9.62:32829 was elected leader, sending a full tablet report...
I20260709 12:22:52.372659 30566 tablet_bootstrap.cc:492] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.372898 30567 ts_tablet_manager.cc:1434] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:22:52.373764 30567 tablet_bootstrap.cc:492] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.379005 30566 tablet_bootstrap.cc:654] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.380295 30567 tablet_bootstrap.cc:654] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.370324 30565 tablet_bootstrap.cc:492] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.383567 30565 ts_tablet_manager.cc:1403] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.006s
I20260709 12:22:52.386334 30566 tablet_bootstrap.cc:492] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.386267 30565 raft_consensus.cc:359] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.386857 30566 ts_tablet_manager.cc:1403] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 12:22:52.387027 30565 raft_consensus.cc:385] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.387338 30565 raft_consensus.cc:740] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.388221 30565 consensus_queue.cc:260] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.389762 30566 raft_consensus.cc:359] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.390594 30566 raft_consensus.cc:385] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.390877 30566 raft_consensus.cc:740] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.391673 30566 consensus_queue.cc:260] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.391711 30567 tablet_bootstrap.cc:492] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.392977 30550 heartbeater.cc:499] Master 127.29.9.62:32829 was elected leader, sending a full tablet report...
I20260709 12:22:52.393256 30567 ts_tablet_manager.cc:1403] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.003s
I20260709 12:22:52.394130 30566 ts_tablet_manager.cc:1434] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:52.395016 30566 tablet_bootstrap.cc:492] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.396166 30567 raft_consensus.cc:359] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.396880 30567 raft_consensus.cc:385] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.397193 30567 raft_consensus.cc:740] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.398068 30567 consensus_queue.cc:260] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.400377 30567 ts_tablet_manager.cc:1434] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:52.401289 30567 tablet_bootstrap.cc:492] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.401404 30566 tablet_bootstrap.cc:654] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.407759 30567 tablet_bootstrap.cc:654] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.414836 30567 tablet_bootstrap.cc:492] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.415308 30566 tablet_bootstrap.cc:492] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.415374 30567 ts_tablet_manager.cc:1403] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:22:52.415781 30566 ts_tablet_manager.cc:1403] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 12:22:52.417860 30566 raft_consensus.cc:359] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.418381 30566 raft_consensus.cc:385] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.418659 30566 raft_consensus.cc:740] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.418262 30567 raft_consensus.cc:359] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.419049 30567 raft_consensus.cc:385] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.419355 30567 raft_consensus.cc:740] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.419318 30566 consensus_queue.cc:260] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.420527 30565 ts_tablet_manager.cc:1434] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:22:52.420346 30567 consensus_queue.cc:260] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.421397 30566 ts_tablet_manager.cc:1434] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:52.421593 30565 tablet_bootstrap.cc:492] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.422318 30566 tablet_bootstrap.cc:492] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.422762 30567 ts_tablet_manager.cc:1434] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:52.423612 30567 tablet_bootstrap.cc:492] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.428267 30565 tablet_bootstrap.cc:654] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.428711 30566 tablet_bootstrap.cc:654] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.429463 30567 tablet_bootstrap.cc:654] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.444872 30566 tablet_bootstrap.cc:492] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.445381 30566 ts_tablet_manager.cc:1403] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 12:22:52.446965 30565 tablet_bootstrap.cc:492] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.446990 30567 tablet_bootstrap.cc:492] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.447618 30565 ts_tablet_manager.cc:1403] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.009s
I20260709 12:22:52.447676 30567 ts_tablet_manager.cc:1403] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.013s
I20260709 12:22:52.448249 30566 raft_consensus.cc:359] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.448971 30566 raft_consensus.cc:385] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.449263 30566 raft_consensus.cc:740] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.450054 30566 consensus_queue.cc:260] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.450760 30565 raft_consensus.cc:359] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.450968 30567 raft_consensus.cc:359] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.451505 30565 raft_consensus.cc:385] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.451606 30567 raft_consensus.cc:385] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.451960 30565 raft_consensus.cc:740] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.452019 30567 raft_consensus.cc:740] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.452656 30566 ts_tablet_manager.cc:1434] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:22:52.452884 30565 consensus_queue.cc:260] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.452931 30567 consensus_queue.cc:260] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.453599 30566 tablet_bootstrap.cc:492] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.455147 30565 ts_tablet_manager.cc:1434] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:52.456084 30565 tablet_bootstrap.cc:492] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.460069 30566 tablet_bootstrap.cc:654] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.462087 30565 tablet_bootstrap.cc:654] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.463209 30567 ts_tablet_manager.cc:1434] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:52.470391 30567 tablet_bootstrap.cc:492] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.471817 30572 raft_consensus.cc:493] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.472292 30572 raft_consensus.cc:515] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.473799 30565 tablet_bootstrap.cc:492] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.473925 30566 tablet_bootstrap.cc:492] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.474336 30566 ts_tablet_manager.cc:1403] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 12:22:52.474284 30565 ts_tablet_manager.cc:1403] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:22:52.474857 30572 leader_election.cc:290] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915), 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165)
I20260709 12:22:52.482566 30565 raft_consensus.cc:359] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.483353 30565 raft_consensus.cc:385] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.483680 30565 raft_consensus.cc:740] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.483956 30567 tablet_bootstrap.cc:654] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.484597 30565 consensus_queue.cc:260] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.486515 30565 ts_tablet_manager.cc:1434] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:22:52.481328 30566 raft_consensus.cc:359] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.487982 30566 raft_consensus.cc:385] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.488289 30566 raft_consensus.cc:740] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.488767 30565 tablet_bootstrap.cc:492] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.489289 30566 consensus_queue.cc:260] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.492588 30566 ts_tablet_manager.cc:1434] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:22:52.493573 30566 tablet_bootstrap.cc:492] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.495512 30572 raft_consensus.cc:493] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.496021 30572 raft_consensus.cc:515] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.497989 30572 leader_election.cc:290] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.499778 30566 tablet_bootstrap.cc:654] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.489667 30567 tablet_bootstrap.cc:492] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.500586 30567 ts_tablet_manager.cc:1403] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:22:52.501432 30376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:52.502182 30376 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 0.
I20260709 12:22:52.503178 30375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151d51bac3f6483e8bf730de881fcf16" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:52.503844 30415 leader_election.cc:304] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:52.504194 30565 tablet_bootstrap.cc:654] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.504657 30572 raft_consensus.cc:2804] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.505002 30572 raft_consensus.cc:493] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.505360 30572 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.505607 30567 raft_consensus.cc:359] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.506352 30567 raft_consensus.cc:385] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:52.507463 30415 leader_election.cc:343] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.506657 30567 raft_consensus.cc:740] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.509069 30567 consensus_queue.cc:260] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.515019 30566 tablet_bootstrap.cc:492] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.515550 30566 ts_tablet_manager.cc:1403] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:22:52.518308 30566 raft_consensus.cc:359] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.519037 30566 raft_consensus.cc:385] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.519388 30566 raft_consensus.cc:740] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.518752 30572 raft_consensus.cc:515] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.520185 30566 consensus_queue.cc:260] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.521595 30572 leader_election.cc:290] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 election: Requested vote from peers 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915), 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165)
I20260709 12:22:52.522485 30566 ts_tablet_manager.cc:1434] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:52.523563 30566 tablet_bootstrap.cc:492] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.526281 30565 tablet_bootstrap.cc:492] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.526767 30565 ts_tablet_manager.cc:1403] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.016s
I20260709 12:22:52.529624 30565 raft_consensus.cc:359] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.530076 30566 tablet_bootstrap.cc:654] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.530392 30565 raft_consensus.cc:385] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.530373 30375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:52.530920 30565 raft_consensus.cc:740] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.531062 30375 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.531926 30565 consensus_queue.cc:260] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.536775 30565 ts_tablet_manager.cc:1434] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:22:52.537770 30565 tablet_bootstrap.cc:492] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.543926 30565 tablet_bootstrap.cc:654] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.546195 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:52.546962 30525 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 0.
I20260709 12:22:52.548182 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:52.548818 30523 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.549166 30566 tablet_bootstrap.cc:492] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.549669 30566 ts_tablet_manager.cc:1403] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 12:22:52.551328 30565 tablet_bootstrap.cc:492] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.551808 30565 ts_tablet_manager.cc:1403] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:22:52.552682 30566 raft_consensus.cc:359] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.553442 30566 raft_consensus.cc:385] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.553823 30566 raft_consensus.cc:740] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.554527 30565 raft_consensus.cc:359] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.553016 30375 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 1.
I20260709 12:22:52.555289 30565 raft_consensus.cc:385] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.555575 30565 raft_consensus.cc:740] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.554710 30566 consensus_queue.cc:260] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.556126 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151d51bac3f6483e8bf730de881fcf16" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:52.556324 30415 leader_election.cc:304] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:52.556604 30565 consensus_queue.cc:260] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.557504 30566 ts_tablet_manager.cc:1434] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:22:52.558382 30414 leader_election.cc:343] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.558542 30566 tablet_bootstrap.cc:492] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.558827 30414 leader_election.cc:304] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6e34823cd7341ceb7718ac70ef79508; no voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040
I20260709 12:22:52.559875 30572 raft_consensus.cc:2804] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.561200 30565 ts_tablet_manager.cc:1434] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:52.562142 30565 tablet_bootstrap.cc:492] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.555507 30523 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 1.
I20260709 12:22:52.565027 30566 tablet_bootstrap.cc:654] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.568137 30565 tablet_bootstrap.cc:654] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.569133 30567 ts_tablet_manager.cc:1434] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.024s
I20260709 12:22:52.570230 30567 tablet_bootstrap.cc:492] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.576807 30565 tablet_bootstrap.cc:492] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.577297 30565 ts_tablet_manager.cc:1403] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:22:52.577755 30588 raft_consensus.cc:2749] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.579067 30572 raft_consensus.cc:697] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:52.579883 30572 consensus_queue.cc:237] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:52.580188 30565 raft_consensus.cc:359] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.580901 30565 raft_consensus.cc:385] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.581182 30565 raft_consensus.cc:740] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.582257 30565 consensus_queue.cc:260] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.583377 30566 tablet_bootstrap.cc:492] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.583853 30566 ts_tablet_manager.cc:1403] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.011s
I20260709 12:22:52.584281 30567 tablet_bootstrap.cc:654] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.584570 30565 ts_tablet_manager.cc:1434] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:22:52.585592 30565 tablet_bootstrap.cc:492] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.586288 30566 raft_consensus.cc:359] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.586935 30566 raft_consensus.cc:385] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.587195 30566 raft_consensus.cc:740] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.587816 30566 consensus_queue.cc:260] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.589789 30566 ts_tablet_manager.cc:1434] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:52.590700 30566 tablet_bootstrap.cc:492] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.596351 30565 tablet_bootstrap.cc:654] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.597581 30566 tablet_bootstrap.cc:654] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.602633 30273 catalog_manager.cc:5697] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.609256 30566 tablet_bootstrap.cc:492] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.609822 30566 ts_tablet_manager.cc:1403] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 12:22:52.613283 30566 raft_consensus.cc:359] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.614130 30566 raft_consensus.cc:385] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.614450 30566 raft_consensus.cc:740] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.615272 30566 consensus_queue.cc:260] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.617727 30566 ts_tablet_manager.cc:1434] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:52.618718 30566 tablet_bootstrap.cc:492] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040: Bootstrap starting.
I20260709 12:22:52.624670 30566 tablet_bootstrap.cc:654] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.636545 30571 raft_consensus.cc:493] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.636709 30565 tablet_bootstrap.cc:492] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.636860 30566 tablet_bootstrap.cc:492] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040: No bootstrap required, opened a new log
I20260709 12:22:52.637287 30565 ts_tablet_manager.cc:1403] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.020s
I20260709 12:22:52.637073 30571 raft_consensus.cc:515] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.637398 30566 ts_tablet_manager.cc:1403] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:22:52.640174 30565 raft_consensus.cc:359] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.640360 30566 raft_consensus.cc:359] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.641052 30566 raft_consensus.cc:385] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.641319 30566 raft_consensus.cc:740] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.640897 30565 raft_consensus.cc:385] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.642009 30565 raft_consensus.cc:740] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.641990 30566 consensus_queue.cc:260] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.642999 30565 consensus_queue.cc:260] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.645848 30571 leader_election.cc:290] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.646399 30571 raft_consensus.cc:493] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.646872 30575 raft_consensus.cc:493] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.647336 30575 raft_consensus.cc:515] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.646845 30571 raft_consensus.cc:515] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.653752 30575 leader_election.cc:290] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.654912 30606 raft_consensus.cc:493] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.657907 30606 raft_consensus.cc:515] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.651444 30571 leader_election.cc:290] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.658401 30575 raft_consensus.cc:493] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.665473 30575 raft_consensus.cc:515] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.662935 30567 tablet_bootstrap.cc:492] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.667500 30567 ts_tablet_manager.cc:1403] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.097s	user 0.047s	sys 0.007s
I20260709 12:22:52.667546 30575 leader_election.cc:290] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.668224 30575 raft_consensus.cc:493] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.668624 30575 raft_consensus.cc:515] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.670632 30575 leader_election.cc:290] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.670763 30567 raft_consensus.cc:359] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.675899 30601 raft_consensus.cc:493] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.679522 30601 raft_consensus.cc:515] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.680579 30606 leader_election.cc:290] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.681912 30565 ts_tablet_manager.cc:1434] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:22:52.682690 30565 tablet_bootstrap.cc:492] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.671533 30567 raft_consensus.cc:385] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.689040 30567 raft_consensus.cc:740] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.693128 30567 consensus_queue.cc:260] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.689127 30601 leader_election.cc:290] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.697003 30567 ts_tablet_manager.cc:1434] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:22:52.698616 30566 ts_tablet_manager.cc:1434] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040: Time spent starting tablet: real 0.061s	user 0.017s	sys 0.041s
I20260709 12:22:52.702870 30451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.703576 30451 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 0.
I20260709 12:22:52.704929 30450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.705364 30567 tablet_bootstrap.cc:492] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.705586 30450 raft_consensus.cc:2468] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 0.
I20260709 12:22:52.706645 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.706168 30565 tablet_bootstrap.cc:654] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.710458 30341 leader_election.cc:304] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:52.711884 30604 raft_consensus.cc:2804] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.712414 30341 leader_election.cc:304] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:52.712395 30604 raft_consensus.cc:493] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.713088 30604 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.713546 30601 raft_consensus.cc:2804] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.714066 30601 raft_consensus.cc:493] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.714401 30601 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:52.715014 30341 leader_election.cc:343] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.723599 30376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:52.724105 30375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:52.724299 30376 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 0.
I20260709 12:22:52.724712 30375 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 0.
I20260709 12:22:52.726341 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:52.727708 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9fcbf8d97ca4c9c98be4ddbcd5cc95f" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:52.727758 30489 leader_election.cc:304] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:52.728883 30373 raft_consensus.cc:2468] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 0.
W20260709 12:22:52.730406 30321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:52.735129 30601 raft_consensus.cc:515] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.736006 30374 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 0.
I20260709 12:22:52.737864 30489 leader_election.cc:304] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:52.739001 30606 raft_consensus.cc:2804] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.739344 30606 raft_consensus.cc:493] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.739686 30606 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.740046 30489 leader_election.cc:304] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:52.741031 30575 raft_consensus.cc:2804] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.741232 30489 leader_election.cc:304] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:52.741411 30575 raft_consensus.cc:493] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.741914 30575 raft_consensus.cc:3060] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.742974 30609 raft_consensus.cc:2804] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.748746 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:52.747545 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:52.749404 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:52.749836 30523 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 0.
I20260709 12:22:52.749963 30525 raft_consensus.cc:2468] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 0.
I20260709 12:22:52.751235 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:52.752014 30449 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.749235 30609 raft_consensus.cc:493] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.752102 30339 leader_election.cc:304] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:52.755573 30571 raft_consensus.cc:2804] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.756279 30571 raft_consensus.cc:493] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.756397 30450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.756690 30571 raft_consensus.cc:3060] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:52.756716 30339 leader_election.cc:343] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.757180 30451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.752616 30601 leader_election.cc:290] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.757993 30448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.754380 30609 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.760317 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9fcbf8d97ca4c9c98be4ddbcd5cc95f" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.761139 30451 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 0.
I20260709 12:22:52.763672 30447 raft_consensus.cc:2468] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 0.
I20260709 12:22:52.763824 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:52.767256 30567 tablet_bootstrap.cc:654] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.767441 30604 raft_consensus.cc:515] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
W20260709 12:22:52.768108 30339 leader_election.cc:343] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.770952 30612 raft_consensus.cc:2804] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.771097 30451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:52.771418 30612 raft_consensus.cc:493] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.770751 30575 raft_consensus.cc:515] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.771878 30612 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.772838 30451 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.772881 30604 leader_election.cc:290] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.773475 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:52.774338 30565 tablet_bootstrap.cc:492] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.770200 30606 raft_consensus.cc:515] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.776440 30565 ts_tablet_manager.cc:1403] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.010s
I20260709 12:22:52.779408 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9fcbf8d97ca4c9c98be4ddbcd5cc95f" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:52.779764 30565 raft_consensus.cc:359] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.780159 30374 raft_consensus.cc:3060] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.780093 30609 raft_consensus.cc:515] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.781143 30565 raft_consensus.cc:385] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.781450 30565 raft_consensus.cc:740] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.779304 30524 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.783188 30565 consensus_queue.cc:260] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.787770 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:52.788515 30449 raft_consensus.cc:2468] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 1.
I20260709 12:22:52.788848 30373 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.786835 30575 leader_election.cc:290] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.787955 30609 leader_election.cc:290] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.790777 30341 leader_election.cc:304] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 641f517d83c347a390a75c7744c293e8
I20260709 12:22:52.792337 30604 raft_consensus.cc:2804] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.792768 30604 raft_consensus.cc:697] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:52.793591 30604 consensus_queue.cc:237] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.800820 30374 raft_consensus.cc:2468] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 1.
I20260709 12:22:52.801908 30524 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 1.
I20260709 12:22:52.802913 30489 leader_election.cc:304] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:52.803041 30373 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 1.
I20260709 12:22:52.803054 30339 leader_election.cc:304] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:52.803928 30601 raft_consensus.cc:2804] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.804262 30489 leader_election.cc:304] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:52.805387 30575 raft_consensus.cc:2804] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.808952 30571 raft_consensus.cc:515] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.810021 30606 leader_election.cc:290] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.810302 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:52.811673 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:52.810559 30606 raft_consensus.cc:2804] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.812335 30567 tablet_bootstrap.cc:492] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.812391 30606 raft_consensus.cc:697] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:52.812906 30567 ts_tablet_manager.cc:1403] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.005s
W20260709 12:22:52.812942 30341 leader_election.cc:343] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.813627 30606 consensus_queue.cc:237] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.815050 30612 raft_consensus.cc:515] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.815351 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:52.812045 30373 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:52.799199 30490 leader_election.cc:343] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.815982 30524 raft_consensus.cc:3060] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.813731 30575 raft_consensus.cc:697] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
W20260709 12:22:52.816675 30490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:37729, user_credentials={real_user=slave}} blocked reactor thread for 54655.6us
I20260709 12:22:52.817157 30575 consensus_queue.cc:237] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.816484 30567 raft_consensus.cc:359] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.819172 30567 raft_consensus.cc:385] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.818977 30450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:52.819015 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:52.819828 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9fcbf8d97ca4c9c98be4ddbcd5cc95f" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:52.819954 30447 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.820210 30571 leader_election.cc:290] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.819550 30567 raft_consensus.cc:740] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
W20260709 12:22:52.820307 30490 leader_election.cc:343] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.821903 30567 consensus_queue.cc:260] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.822748 30450 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.826623 30567 ts_tablet_manager.cc:1434] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:52.823572 30449 raft_consensus.cc:3060] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.830194 30448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
W20260709 12:22:52.831745 30490 leader_election.cc:343] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.831849 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:52.832468 30374 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.833916 30450 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 1.
I20260709 12:22:52.838660 30490 leader_election.cc:304] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:52.843451 30609 raft_consensus.cc:2804] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.839213 30567 tablet_bootstrap.cc:492] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.843993 30609 raft_consensus.cc:697] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:52.845611 30609 consensus_queue.cc:237] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.828817 30612 leader_election.cc:290] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.849157 30601 raft_consensus.cc:697] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:52.851095 30374 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 1.
I20260709 12:22:52.868763 30601 consensus_queue.cc:237] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.866533 30271 catalog_manager.cc:5697] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.872051 30604 raft_consensus.cc:493] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.866106 30451 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 1.
I20260709 12:22:52.877720 30489 leader_election.cc:304] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:52.874991 30604 raft_consensus.cc:515] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.878778 30612 raft_consensus.cc:2804] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.879559 30612 raft_consensus.cc:697] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:52.880388 30612 consensus_queue.cc:237] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.881111 30604 leader_election.cc:290] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.882858 30567 tablet_bootstrap.cc:654] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.883005 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151d51bac3f6483e8bf730de881fcf16" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:52.884080 30450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151d51bac3f6483e8bf730de881fcf16" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.884691 30450 raft_consensus.cc:2468] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 0.
I20260709 12:22:52.872676 30524 raft_consensus.cc:2468] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 1.
I20260709 12:22:52.872359 30373 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 1.
I20260709 12:22:52.888453 30341 leader_election.cc:304] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:52.887841 30447 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 1.
W20260709 12:22:52.889953 30339 leader_election.cc:343] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.895795 30339 leader_election.cc:304] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:52.892273 30604 raft_consensus.cc:2804] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.896800 30449 raft_consensus.cc:2468] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 1.
I20260709 12:22:52.897720 30614 raft_consensus.cc:2804] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.899554 30614 raft_consensus.cc:697] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:52.901190 30565 ts_tablet_manager.cc:1434] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.124s	user 0.021s	sys 0.016s
I20260709 12:22:52.901319 30567 tablet_bootstrap.cc:492] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.901844 30567 ts_tablet_manager.cc:1403] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 12:22:52.902099 30565 tablet_bootstrap.cc:492] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.900439 30614 consensus_queue.cc:237] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.897915 30604 raft_consensus.cc:493] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.905653 30604 raft_consensus.cc:3060] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.905761 30271 catalog_manager.cc:5697] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.907711 30271 catalog_manager.cc:5697] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.908639 30565 tablet_bootstrap.cc:654] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.912163 30571 raft_consensus.cc:493] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.912642 30571 raft_consensus.cc:515] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.914909 30571 leader_election.cc:290] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.917902 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
W20260709 12:22:52.921320 30341 leader_election.cc:343] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.922740 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:52.923023 30604 raft_consensus.cc:515] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
W20260709 12:22:52.924109 30339 leader_election.cc:343] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.924527 30339 leader_election.cc:304] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040; no voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:52.925590 30571 raft_consensus.cc:2749] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.926167 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151d51bac3f6483e8bf730de881fcf16" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:52.926779 30449 raft_consensus.cc:3060] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.926941 30565 tablet_bootstrap.cc:492] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.927428 30565 ts_tablet_manager.cc:1403] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 12:22:52.930027 30565 raft_consensus.cc:359] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.930616 30565 raft_consensus.cc:385] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.930889 30565 raft_consensus.cc:740] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.931452 30565 consensus_queue.cc:260] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.932014 30612 raft_consensus.cc:493] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.925617 30567 raft_consensus.cc:359] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.932533 30612 raft_consensus.cc:515] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.934100 30565 ts_tablet_manager.cc:1434] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:52.934931 30565 tablet_bootstrap.cc:492] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8: Bootstrap starting.
I20260709 12:22:52.934636 30274 catalog_manager.cc:5697] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.935524 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:52.937153 30567 raft_consensus.cc:385] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.936489 30274 catalog_manager.cc:5697] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.937462 30567 raft_consensus.cc:740] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.938032 30449 raft_consensus.cc:2468] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 1.
I20260709 12:22:52.938215 30567 consensus_queue.cc:260] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.939230 30341 leader_election.cc:304] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:52.940155 30571 raft_consensus.cc:2804] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.940479 30567 ts_tablet_manager.cc:1434] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:22:52.941376 30567 tablet_bootstrap.cc:492] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:52.951916 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e34823cd7341ceb7718ac70ef79508" is_pre_election: true
I20260709 12:22:52.952838 30449 raft_consensus.cc:2393] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 641f517d83c347a390a75c7744c293e8 in current term 1: Already voted for candidate 88e01eb7e17e478cb41a6b289f539040 in this term.
I20260709 12:22:52.945164 30612 leader_election.cc:290] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:52.955394 30490 leader_election.cc:304] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 641f517d83c347a390a75c7744c293e8; no voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:52.956786 30571 raft_consensus.cc:697] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:52.957698 30571 consensus_queue.cc:237] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.961272 30565 tablet_bootstrap.cc:654] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.959822 30612 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.969249 30274 catalog_manager.cc:5697] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.971194 30604 leader_election.cc:290] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:52.971062 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151d51bac3f6483e8bf730de881fcf16" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8"
W20260709 12:22:52.973392 30339 leader_election.cc:343] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.974157 30274 catalog_manager.cc:5697] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.975948 30565 tablet_bootstrap.cc:492] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8: No bootstrap required, opened a new log
I20260709 12:22:52.976367 30565 ts_tablet_manager.cc:1403] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.005s
I20260709 12:22:52.978459 30565 raft_consensus.cc:359] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.978614 30612 raft_consensus.cc:2749] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.978927 30565 raft_consensus.cc:385] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.979192 30565 raft_consensus.cc:740] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.979764 30565 consensus_queue.cc:260] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.981491 30565 ts_tablet_manager.cc:1434] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:52.983287 30567 tablet_bootstrap.cc:654] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.994005 30567 tablet_bootstrap.cc:492] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:52.994457 30567 ts_tablet_manager.cc:1403] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.002s
I20260709 12:22:52.994500 30274 catalog_manager.cc:5697] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.997076 30567 raft_consensus.cc:359] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:52.997068 30572 consensus_queue.cc:1048] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:52.997807 30567 raft_consensus.cc:385] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.998013 30567 raft_consensus.cc:740] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.998508 30567 consensus_queue.cc:260] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.000380 30567 ts_tablet_manager.cc:1434] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:53.001402 30567 tablet_bootstrap.cc:492] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508: Bootstrap starting.
I20260709 12:22:53.006428 30567 tablet_bootstrap.cc:654] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.010994 30567 tablet_bootstrap.cc:492] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508: No bootstrap required, opened a new log
I20260709 12:22:53.013005 30567 ts_tablet_manager.cc:1403] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:22:53.016551 30567 raft_consensus.cc:359] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.017215 30567 raft_consensus.cc:385] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.017472 30567 raft_consensus.cc:740] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.018563 30567 consensus_queue.cc:260] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.020037 30567 ts_tablet_manager.cc:1434] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:53.021529 30572 consensus_queue.cc:1048] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.204339 30612 consensus_queue.cc:1048] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.204731 30604 consensus_queue.cc:1048] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.217144 30571 consensus_queue.cc:1048] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.221915 30612 consensus_queue.cc:1048] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.257366 30572 raft_consensus.cc:493] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.257812 30572 raft_consensus.cc:515] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.259505 30572 leader_election.cc:290] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.260255 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:53.260450 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:53.261036 30524 raft_consensus.cc:2393] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d6e34823cd7341ceb7718ac70ef79508 in current term 1: Already voted for candidate 88e01eb7e17e478cb41a6b289f539040 in this term.
I20260709 12:22:53.261915 30414 leader_election.cc:304] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6e34823cd7341ceb7718ac70ef79508; no voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040
I20260709 12:22:53.262501 30572 raft_consensus.cc:3060] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.266842 30572 raft_consensus.cc:2749] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.286782 30572 raft_consensus.cc:493] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.287215 30572 raft_consensus.cc:515] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.288398 30575 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.289860 30449 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.290849 30572 leader_election.cc:290] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.289750 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040" is_pre_election: true
I20260709 12:22:53.292039 30373 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 0.
I20260709 12:22:53.291997 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8" is_pre_election: true
I20260709 12:22:53.292737 30524 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 0.
I20260709 12:22:53.293694 30612 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.294153 30414 leader_election.cc:304] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.294945 30572 raft_consensus.cc:2804] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.295301 30572 raft_consensus.cc:493] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.295635 30572 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.300730 30575 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.302222 30572 raft_consensus.cc:515] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.304888 30572 leader_election.cc:290] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.307580 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:53.307842 30524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.308214 30373 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.308395 30524 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.316301 30373 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 1.
I20260709 12:22:53.317866 30415 leader_election.cc:304] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.318682 30588 raft_consensus.cc:2804] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.319146 30588 raft_consensus.cc:697] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:53.320008 30588 consensus_queue.cc:237] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.321245 30575 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.324033 30524 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 1.
I20260709 12:22:53.326596 30616 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.333138 30274 catalog_manager.cc:5697] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.345857 30571 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.349413 30524 raft_consensus.cc:3060] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.349263 30616 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:22:53.355856 30625 consensus_queue.cc:1048] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.357564 30625 consensus_queue.cc:1048] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.372917 30625 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.378151 30604 consensus_queue.cc:1048] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.384291 30604 consensus_queue.cc:1048] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.553117 30451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:56104
I20260709 12:22:53.553668 30451 raft_consensus.cc:606] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:22:53.566224 30523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:47700
I20260709 12:22:53.566759 30523 raft_consensus.cc:606] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:22:53.572118 30523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:47700
I20260709 12:22:53.572635 30523 raft_consensus.cc:606] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:22:53.579949 30451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:56104
I20260709 12:22:53.580466 30451 raft_consensus.cc:606] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:22:53.593303 30373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:22:53.594085 30373 raft_consensus.cc:606] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Received request to transfer leadership to TS d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:53.599423 30373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:22:53.600054 30373 raft_consensus.cc:606] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Received request to transfer leadership to TS d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:53.604596 30523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
mode: GRACEFUL
new_leader_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:47700
I20260709 12:22:53.605033 30523 raft_consensus.cc:606] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Received request to transfer leadership to TS d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:53.609875 30373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:22:53.610328 30373 raft_consensus.cc:606] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Received request to transfer leadership to TS d6e34823cd7341ceb7718ac70ef79508
I20260709 12:22:53.629114 30604 raft_consensus.cc:993] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.629537 30614 raft_consensus.cc:1081] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Signalling peer d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.631119 30451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:56514
I20260709 12:22:53.631763 30451 raft_consensus.cc:493] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.632097 30451 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.636600 30451 raft_consensus.cc:515] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.638162 30451 leader_election.cc:290] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.639374 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:53.639374 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.640125 30523 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.640106 30373 raft_consensus.cc:3055] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.640589 30373 raft_consensus.cc:740] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:53.641345 30373 consensus_queue.cc:260] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.642565 30373 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.646693 30523 raft_consensus.cc:2468] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.648064 30414 leader_election.cc:304] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.648866 30588 raft_consensus.cc:2804] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.649164 30373 raft_consensus.cc:2468] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.649394 30588 raft_consensus.cc:697] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:53.650369 30588 consensus_queue.cc:237] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.656868 30271 catalog_manager.cc:5697] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 1 to 2, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.741747 30616 raft_consensus.cc:993] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8: : Instructing follower d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.742524 30606 raft_consensus.cc:1081] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Signalling peer d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.744227 30451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:56530
I20260709 12:22:53.744760 30451 raft_consensus.cc:493] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.745081 30451 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.749358 30451 raft_consensus.cc:515] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.751138 30451 leader_election.cc:290] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.751937 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:53.752493 30374 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.753026 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.753556 30523 raft_consensus.cc:3055] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.753862 30523 raft_consensus.cc:740] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:53.754611 30523 consensus_queue.cc:260] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.755795 30523 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.758769 30374 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.759982 30415 leader_election.cc:304] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.760607 30588 raft_consensus.cc:2804] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.761132 30588 raft_consensus.cc:697] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:53.761610 30523 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.761919 30588 consensus_queue.cc:237] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.767884 30271 catalog_manager.cc:5697] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 1 to 2, leader changed from 641f517d83c347a390a75c7744c293e8 (127.29.9.3) to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.775790 30604 raft_consensus.cc:993] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.776248 30614 raft_consensus.cc:1081] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Signalling peer d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.777581 30451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:56514
I20260709 12:22:53.778020 30451 raft_consensus.cc:493] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.778291 30451 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.782922 30616 raft_consensus.cc:993] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.783339 30606 raft_consensus.cc:1081] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.783339 30451 raft_consensus.cc:515] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.785025 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59452
I20260709 12:22:53.785368 30451 leader_election.cc:290] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.785665 30374 raft_consensus.cc:493] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.786038 30374 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.786070 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:53.786330 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.786657 30373 raft_consensus.cc:3055] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.786758 30523 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.787022 30373 raft_consensus.cc:740] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:53.788767 30373 consensus_queue.cc:260] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.790056 30373 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.792387 30523 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.792806 30374 raft_consensus.cc:515] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.793337 30414 leader_election.cc:304] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.794008 30588 raft_consensus.cc:2804] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.794397 30588 raft_consensus.cc:697] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:53.795270 30374 leader_election.cc:290] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.795559 30451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:53.796150 30451 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.795815 30588 consensus_queue.cc:237] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.797102 30373 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.797935 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.798442 30523 raft_consensus.cc:3055] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.798666 30523 raft_consensus.cc:740] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:53.799364 30523 consensus_queue.cc:260] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.800429 30523 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.802759 30451 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.803783 30341 leader_election.cc:304] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.803663 30271 catalog_manager.cc:5697] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 1 to 2, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.804499 30614 raft_consensus.cc:2804] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.805055 30614 raft_consensus.cc:697] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:53.805738 30614 consensus_queue.cc:237] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.807207 30523 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.813442 30273 catalog_manager.cc:5697] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 1 to 2, leader changed from 641f517d83c347a390a75c7744c293e8 (127.29.9.3) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.851323 30588 consensus_queue.cc:1048] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.852908 30588 consensus_queue.cc:1048] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.863134 30658 raft_consensus.cc:993] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.863605 30659 raft_consensus.cc:1081] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.868996 30373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59448
I20260709 12:22:53.869547 30373 raft_consensus.cc:493] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.869904 30373 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.875102 30575 raft_consensus.cc:993] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.875516 30606 raft_consensus.cc:1081] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.877120 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59452
I20260709 12:22:53.877658 30374 raft_consensus.cc:493] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.877615 30373 raft_consensus.cc:515] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.878109 30374 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.880496 30451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:53.881042 30451 raft_consensus.cc:3055] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.881181 30373 leader_election.cc:290] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.881402 30451 raft_consensus.cc:740] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:53.882115 30523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.882696 30523 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.882208 30451 consensus_queue.cc:260] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.883687 30451 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.884784 30374 raft_consensus.cc:515] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.886828 30374 leader_election.cc:290] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.887609 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:53.887912 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.888300 30449 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.888381 30525 raft_consensus.cc:3055] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.888785 30525 raft_consensus.cc:740] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:53.889601 30525 consensus_queue.cc:260] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.890653 30451 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.890766 30525 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.891426 30523 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.892493 30339 leader_election.cc:304] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:53.893318 30614 raft_consensus.cc:2804] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.893774 30614 raft_consensus.cc:697] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:53.894570 30449 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.894629 30614 consensus_queue.cc:237] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.896387 30341 leader_election.cc:304] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.897001 30525 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.897171 30604 raft_consensus.cc:2804] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.897650 30604 raft_consensus.cc:697] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:53.898339 30604 consensus_queue.cc:237] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.902462 30271 catalog_manager.cc:5697] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 1 to 2, leader changed from d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.913261 30271 catalog_manager.cc:5697] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 1 to 2, leader changed from 641f517d83c347a390a75c7744c293e8 (127.29.9.3) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.918171 30571 raft_consensus.cc:993] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.918589 30571 raft_consensus.cc:1081] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Signalling peer d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:22:53.920033 30449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:56514
I20260709 12:22:53.920482 30449 raft_consensus.cc:493] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.920820 30449 raft_consensus.cc:3060] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.925525 30449 raft_consensus.cc:515] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.927084 30449 leader_election.cc:290] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:22:53.927919 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:53.928166 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3ac604384f419eb15d2ee5058e4c3a" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.928435 30374 raft_consensus.cc:3055] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.928686 30525 raft_consensus.cc:3060] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.928720 30374 raft_consensus.cc:740] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:53.929486 30374 consensus_queue.cc:260] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.930346 30374 raft_consensus.cc:3060] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.933247 30525 raft_consensus.cc:2468] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.934201 30414 leader_election.cc:304] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:53.934831 30588 raft_consensus.cc:2804] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.934994 30374 raft_consensus.cc:2468] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 2.
I20260709 12:22:53.935187 30588 raft_consensus.cc:697] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:53.936058 30588 consensus_queue.cc:237] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:53.941593 30271 catalog_manager.cc:5697] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 1 to 2, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.947746 30588 raft_consensus.cc:993] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.948174 30659 raft_consensus.cc:1081] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:22:53.949611 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59448
I20260709 12:22:53.950047 30374 raft_consensus.cc:493] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.950312 30374 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.954749 30374 raft_consensus.cc:515] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:53.956414 30374 leader_election.cc:290] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Requested vote from peers 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:53.957110 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:22:53.957439 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:53.957741 30525 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.957983 30449 raft_consensus.cc:3055] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.958308 30449 raft_consensus.cc:740] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:22:53.959090 30449 consensus_queue.cc:260] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:53.960304 30449 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.964371 30525 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.965549 30339 leader_election.cc:304] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:22:53.966187 30571 raft_consensus.cc:2804] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.966673 30571 raft_consensus.cc:697] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:53.966625 30449 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 2.
I20260709 12:22:53.967540 30571 consensus_queue.cc:237] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:22:53.973234 30271 catalog_manager.cc:5697] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 1 to 2, leader changed from d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:54.210211 30374 raft_consensus.cc:1275] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.211584 30588 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.220279 30525 raft_consensus.cc:1275] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.221753 30591 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.224046 30525 raft_consensus.cc:1275] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.227160 30591 consensus_queue.cc:1048] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.238310 30523 raft_consensus.cc:1275] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.238438 30374 raft_consensus.cc:1275] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.239805 30658 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.240303 30659 consensus_queue.cc:1048] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.245973 30373 raft_consensus.cc:1275] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.247306 30658 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.321395 30523 raft_consensus.cc:1275] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.322621 30659 consensus_queue.cc:1048] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.329816 30374 raft_consensus.cc:1275] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.331274 30588 consensus_queue.cc:1048] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.341517 30523 raft_consensus.cc:1275] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.342722 30571 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.350891 30449 raft_consensus.cc:1275] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.352313 30614 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.385344 30449 raft_consensus.cc:1275] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.386515 30614 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.395408 30523 raft_consensus.cc:1275] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.396687 30604 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.399710 30525 raft_consensus.cc:1275] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.401031 30571 consensus_queue.cc:1048] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.406227 30451 raft_consensus.cc:1275] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.407704 30571 consensus_queue.cc:1048] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.420523 30525 raft_consensus.cc:1275] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.424546 30604 consensus_queue.cc:1048] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.432720 30449 raft_consensus.cc:1275] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.434115 30571 consensus_queue.cc:1048] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:56.647667 29732 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:22:56.648419 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:56.666884 30374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:60986
I20260709 12:22:56.667474 30374 raft_consensus.cc:606] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Received request to transfer leadership to TS 641f517d83c347a390a75c7744c293e8
I20260709 12:22:56.669762 30374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:60986
I20260709 12:22:56.670230 30374 raft_consensus.cc:606] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Received request to transfer leadership to TS 641f517d83c347a390a75c7744c293e8
I20260709 12:22:56.671250 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:56.671676 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:56.790422 30672 raft_consensus.cc:993] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:22:56.790889 30571 raft_consensus.cc:1081] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Signalling peer 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:22:56.792279 30523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:49674
I20260709 12:22:56.792836 30523 raft_consensus.cc:493] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:56.793092 30523 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.797973 30523 raft_consensus.cc:515] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:56.799554 30523 leader_election.cc:290] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 3 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:56.800482 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:56.800529 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:56.801177 30374 raft_consensus.cc:3055] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:56.801215 30449 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.801615 30374 raft_consensus.cc:740] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:56.802404 30374 consensus_queue.cc:260] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:56.803579 30374 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.808079 30449 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 3.
I20260709 12:22:56.809325 30490 leader_election.cc:304] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:56.809720 30374 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 3.
I20260709 12:22:56.809959 30606 raft_consensus.cc:2804] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:56.811129 30606 raft_consensus.cc:697] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:56.811918 30606 consensus_queue.cc:237] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:56.818481 30274 catalog_manager.cc:5697] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 2 to 3, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.004882 30672 raft_consensus.cc:993] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:22:57.005285 30571 raft_consensus.cc:1081] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Signalling peer 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:22:57.006726 30523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:49674
I20260709 12:22:57.007176 30523 raft_consensus.cc:493] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.007531 30523 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:57.012319 30523 raft_consensus.cc:515] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:57.013845 30523 leader_election.cc:290] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 3 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:22:57.014652 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:22:57.014881 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:22:57.015156 30374 raft_consensus.cc:3055] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:57.015364 30449 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:57.015503 30374 raft_consensus.cc:740] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:22:57.016240 30374 consensus_queue.cc:260] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:57.017357 30374 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:57.021365 30449 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 3.
I20260709 12:22:57.022249 30490 leader_election.cc:304] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:22:57.022637 30374 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 3.
I20260709 12:22:57.022895 30606 raft_consensus.cc:2804] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:57.023368 30606 raft_consensus.cc:697] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:22:57.024111 30606 consensus_queue.cc:237] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:22:57.030442 30274 catalog_manager.cc:5697] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 2 to 3, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.191572 30449 raft_consensus.cc:1275] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:57.192713 30606 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:57.203667 30374 raft_consensus.cc:1275] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:57.205209 30682 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:57.491938 30449 raft_consensus.cc:1275] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:57.493131 30682 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:57.501127 30374 raft_consensus.cc:1275] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:57.502642 30673 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:57.672593 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.678200 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:57.678578 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:58.679535 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:58.685634 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:58.685985 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:59.686844 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:59.692328 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:59.692680 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:00.693516 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:00.699126 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:00.699535 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:01.700651 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:01.707151 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:01.707547 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:02.708498 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.714744 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:02.715109 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.716022 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.721944 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:03.722460 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.723302 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.729344 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:04.729816 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.730652 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.735792 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.736127 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.767154 29732 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:23:06.773312 30525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:47700
I20260709 12:23:06.773897 30525 raft_consensus.cc:606] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:23:06.778604 30525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:47700
I20260709 12:23:06.779055 30525 raft_consensus.cc:606] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:23:06.788524 30449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:56104
I20260709 12:23:06.788975 30449 raft_consensus.cc:606] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:23:06.793172 30449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:56104
I20260709 12:23:06.793566 30449 raft_consensus.cc:606] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:23:06.798007 30449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
mode: GRACEFUL
new_leader_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:56104
I20260709 12:23:06.798442 30449 raft_consensus.cc:606] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Received request to transfer leadership to TS 88e01eb7e17e478cb41a6b289f539040
I20260709 12:23:06.842754 30698 raft_consensus.cc:993] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:06.843235 30702 raft_consensus.cc:1081] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:06.844919 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59448
I20260709 12:23:06.845400 30374 raft_consensus.cc:493] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.845691 30374 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.850637 30374 raft_consensus.cc:515] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.852195 30374 leader_election.cc:290] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 3 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:23:06.853088 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:23:06.853338 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:23:06.853681 30449 raft_consensus.cc:3055] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:06.853873 30525 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.853953 30449 raft_consensus.cc:740] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:23:06.854682 30449 consensus_queue.cc:260] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.855553 30449 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.858856 30525 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 3.
I20260709 12:23:06.860107 30449 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 3.
I20260709 12:23:06.860072 30339 leader_election.cc:304] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:23:06.861104 30672 raft_consensus.cc:2804] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:06.862345 30672 raft_consensus.cc:697] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:06.863231 30672 consensus_queue.cc:237] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.870445 30271 catalog_manager.cc:5697] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 2 to 3, leader changed from d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.923111 30698 raft_consensus.cc:993] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:06.923560 30702 raft_consensus.cc:1081] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:06.924949 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59448
I20260709 12:23:06.925390 30374 raft_consensus.cc:493] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.925619 30374 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.930058 30374 raft_consensus.cc:515] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.931402 30374 leader_election.cc:290] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 3 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:23:06.932221 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:23:06.932368 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c802fb55c484341b1a09ef24085d9e8" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:23:06.932674 30449 raft_consensus.cc:3055] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:06.932821 30525 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.932931 30449 raft_consensus.cc:740] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:23:06.933600 30449 consensus_queue.cc:260] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.934419 30449 raft_consensus.cc:3060] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.937400 30525 raft_consensus.cc:2468] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 3.
I20260709 12:23:06.938369 30449 raft_consensus.cc:2468] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 3.
I20260709 12:23:06.938335 30339 leader_election.cc:304] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:23:06.939174 30672 raft_consensus.cc:2804] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:06.939569 30672 raft_consensus.cc:697] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:06.940285 30672 consensus_queue.cc:237] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.946043 30271 catalog_manager.cc:5697] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 2 to 3, leader changed from d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.973042 30699 raft_consensus.cc:993] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:06.973583 30701 raft_consensus.cc:1081] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:06.974901 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59452
I20260709 12:23:06.975271 30374 raft_consensus.cc:493] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:06.975484 30374 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:06.979703 30374 raft_consensus.cc:515] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.981180 30374 leader_election.cc:290] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 4 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:23:06.981923 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:23:06.982185 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920bd8cab74646e79972859bb87ded4c" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:23:06.982383 30449 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:06.982654 30525 raft_consensus.cc:3055] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:06.982904 30525 raft_consensus.cc:740] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:23:06.983534 30525 consensus_queue.cc:260] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.984542 30525 raft_consensus.cc:3060] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:06.986660 30449 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 4.
I20260709 12:23:06.987637 30341 leader_election.cc:304] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:23:06.988252 30672 raft_consensus.cc:2804] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:06.988664 30672 raft_consensus.cc:697] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 4 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:06.989145 30525 raft_consensus.cc:2468] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 4.
I20260709 12:23:06.989444 30672 consensus_queue.cc:237] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:06.996171 30271 catalog_manager.cc:5697] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 3 to 4, leader changed from 641f517d83c347a390a75c7744c293e8 (127.29.9.3) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 4 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.109139 30698 raft_consensus.cc:993] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:07.109589 30702 raft_consensus.cc:1081] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:07.110783 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59448
I20260709 12:23:07.111217 30374 raft_consensus.cc:493] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.111481 30374 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.115393 30374 raft_consensus.cc:515] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:07.116668 30374 leader_election.cc:290] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 3 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:23:07.117306 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:23:07.117656 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:23:07.117769 30449 raft_consensus.cc:3055] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:07.118106 30525 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.118103 30449 raft_consensus.cc:740] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:23:07.118880 30449 consensus_queue.cc:260] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:07.119678 30449 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.122711 30525 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 3.
I20260709 12:23:07.123289 30449 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 3.
I20260709 12:23:07.123626 30339 leader_election.cc:304] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, 88e01eb7e17e478cb41a6b289f539040; no voters: 
I20260709 12:23:07.124387 30672 raft_consensus.cc:2804] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:07.124744 30672 raft_consensus.cc:697] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:07.125327 30672 consensus_queue.cc:237] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:07.131585 30271 catalog_manager.cc:5697] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 2 to 3, leader changed from d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.233726 30699 raft_consensus.cc:993] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: : Instructing follower 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:07.234124 30701 raft_consensus.cc:1081] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Signalling peer 88e01eb7e17e478cb41a6b289f539040 to start an election
I20260709 12:23:07.235385 30374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
 from {username='slave'} at 127.0.0.1:59452
I20260709 12:23:07.235778 30374 raft_consensus.cc:493] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:07.235991 30374 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:07.240069 30374 raft_consensus.cc:515] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:07.241403 30374 leader_election.cc:290] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 4 election: Requested vote from peers d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:23:07.242122 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:23:07.242367 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb56271011824a0e8ce6c6ab393ef6a0" candidate_uuid: "88e01eb7e17e478cb41a6b289f539040" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:23:07.242659 30449 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:07.242878 30525 raft_consensus.cc:3055] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:07.243180 30525 raft_consensus.cc:740] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:23:07.243974 30525 consensus_queue.cc:260] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:07.245134 30525 raft_consensus.cc:3060] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:07.248767 30449 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 4.
I20260709 12:23:07.249836 30341 leader_election.cc:304] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88e01eb7e17e478cb41a6b289f539040, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:23:07.250540 30672 raft_consensus.cc:2804] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:07.250957 30672 raft_consensus.cc:697] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 4 LEADER]: Becoming Leader. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:07.251250 30525 raft_consensus.cc:2468] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88e01eb7e17e478cb41a6b289f539040 in term 4.
I20260709 12:23:07.251669 30672 consensus_queue.cc:237] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:07.257833 30271 catalog_manager.cc:5697] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 reported cstate change: term changed from 3 to 4, leader changed from 641f517d83c347a390a75c7744c293e8 (127.29.9.3) to 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1). New cstate: current_term: 4 leader_uuid: "88e01eb7e17e478cb41a6b289f539040" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:07.322253 30525 raft_consensus.cc:1275] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.323385 30672 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.332495 30449 raft_consensus.cc:1275] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.334110 30672 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.460577 30525 raft_consensus.cc:1275] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.461695 30672 consensus_queue.cc:1048] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.464581 30449 raft_consensus.cc:1275] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:07.465767 30672 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.473688 30451 raft_consensus.cc:1275] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.476228 30703 consensus_queue.cc:1048] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.484481 30525 raft_consensus.cc:1275] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:07.486646 30703 consensus_queue.cc:1048] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.625278 30451 raft_consensus.cc:1275] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.626372 30703 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.635576 30525 raft_consensus.cc:1275] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:07.636864 30723 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.839645 30523 raft_consensus.cc:1275] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:07.840765 30723 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.849413 30451 raft_consensus.cc:1275] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Refusing update from remote peer 88e01eb7e17e478cb41a6b289f539040: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:07.851373 30703 consensus_queue.cc:1048] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:09.832507 29732 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:23:09.833135 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.839851 30374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:60986
I20260709 12:23:09.840281 30374 raft_consensus.cc:606] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Received request to transfer leadership to TS 641f517d83c347a390a75c7744c293e8
I20260709 12:23:09.842367 30374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:60986
I20260709 12:23:09.842764 30374 raft_consensus.cc:606] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Received request to transfer leadership to TS d6e34823cd7341ceb7718ac70ef79508
I20260709 12:23:09.844760 30374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:60986
I20260709 12:23:09.845163 30374 raft_consensus.cc:606] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Received request to transfer leadership to TS 641f517d83c347a390a75c7744c293e8
I20260709 12:23:09.847149 30374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813"
dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
mode: GRACEFUL
new_leader_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:60986
I20260709 12:23:09.847558 30374 raft_consensus.cc:606] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Received request to transfer leadership to TS d6e34823cd7341ceb7718ac70ef79508
I20260709 12:23:09.848426 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:09.848835 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:09.864238 30729 raft_consensus.cc:993] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:23:09.864725 30672 raft_consensus.cc:1081] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Signalling peer d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:23:09.866020 30449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:56514
I20260709 12:23:09.866469 30449 raft_consensus.cc:493] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:09.866783 30449 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:09.870851 30449 raft_consensus.cc:515] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:09.872691 30449 leader_election.cc:290] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 4 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:23:09.873252 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:23:09.873624 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24a727a611d4cf597902aa75f5f3813" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:23:09.873790 30374 raft_consensus.cc:3055] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:09.874156 30525 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:09.874161 30374 raft_consensus.cc:740] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:09.874979 30374 consensus_queue.cc:260] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:09.875932 30374 raft_consensus.cc:3060] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:09.878666 30525 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 4.
I20260709 12:23:09.879793 30414 leader_election.cc:304] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:23:09.880429 30374 raft_consensus.cc:2468] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 4.
I20260709 12:23:09.880570 30727 raft_consensus.cc:2804] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:09.881036 30727 raft_consensus.cc:697] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 4 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:23:09.881726 30727 consensus_queue.cc:237] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:09.887998 30273 catalog_manager.cc:5697] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 3 to 4, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 4 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.241839 30729 raft_consensus.cc:993] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:23:10.242233 30729 raft_consensus.cc:1081] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Signalling peer 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:23:10.243492 30525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:49674
I20260709 12:23:10.243920 30525 raft_consensus.cc:493] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:10.244184 30525 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:10.248349 30525 raft_consensus.cc:515] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:10.250422 30525 leader_election.cc:290] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 4 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:23:10.250882 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:23:10.250837 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14feb88ffafe4dbe94f6c8581945f738" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:23:10.251559 30449 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:10.251624 30374 raft_consensus.cc:3055] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:10.251971 30374 raft_consensus.cc:740] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:10.252626 30374 consensus_queue.cc:260] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:10.253662 30374 raft_consensus.cc:3060] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:10.257550 30449 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 4.
I20260709 12:23:10.258648 30490 leader_election.cc:304] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:23:10.259099 30374 raft_consensus.cc:2468] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 4.
I20260709 12:23:10.259223 30701 raft_consensus.cc:2804] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:10.260480 30701 raft_consensus.cc:697] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 4 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:23:10.261261 30701 consensus_queue.cc:237] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:10.267540 30273 catalog_manager.cc:5697] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 3 to 4, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 4 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.270503 30525 raft_consensus.cc:1275] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:10.271569 30727 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.280014 30374 raft_consensus.cc:1275] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:10.281368 30727 consensus_queue.cc:1048] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.351449 30672 raft_consensus.cc:993] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:23:10.351858 30729 raft_consensus.cc:1081] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Signalling peer d6e34823cd7341ceb7718ac70ef79508 to start an election
I20260709 12:23:10.353119 30449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e"
dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
 from {username='slave'} at 127.0.0.1:56514
I20260709 12:23:10.353487 30449 raft_consensus.cc:493] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:10.353716 30449 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.357702 30449 raft_consensus.cc:515] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:10.359002 30449 leader_election.cc:290] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 3 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), 641f517d83c347a390a75c7744c293e8 (127.29.9.3:44915)
I20260709 12:23:10.359946 30525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "641f517d83c347a390a75c7744c293e8"
I20260709 12:23:10.359743 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985e70a06dd436883ec1289807cfa8e" candidate_uuid: "d6e34823cd7341ceb7718ac70ef79508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:23:10.360659 30525 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.360787 30374 raft_consensus.cc:3055] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:10.361100 30374 raft_consensus.cc:740] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:10.361797 30374 consensus_queue.cc:260] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:10.362828 30374 raft_consensus.cc:3060] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.363049 30672 raft_consensus.cc:993] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040: : Instructing follower 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:23:10.363544 30729 raft_consensus.cc:1081] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Signalling peer 641f517d83c347a390a75c7744c293e8 to start an election
I20260709 12:23:10.365012 30523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e"
dest_uuid: "641f517d83c347a390a75c7744c293e8"
 from {username='slave'} at 127.0.0.1:49674
I20260709 12:23:10.365486 30523 raft_consensus.cc:493] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:10.365792 30523 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.365829 30525 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 3.
I20260709 12:23:10.366885 30414 leader_election.cc:304] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:23:10.367636 30727 raft_consensus.cc:2804] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:10.367748 30374 raft_consensus.cc:2468] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e34823cd7341ceb7718ac70ef79508 in term 3.
I20260709 12:23:10.368422 30727 raft_consensus.cc:697] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 3 LEADER]: Becoming Leader. State: Replica: d6e34823cd7341ceb7718ac70ef79508, State: Running, Role: LEADER
I20260709 12:23:10.369167 30727 consensus_queue.cc:237] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } }
I20260709 12:23:10.370922 30523 raft_consensus.cc:515] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:23:10.373168 30374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88e01eb7e17e478cb41a6b289f539040"
I20260709 12:23:10.373724 30374 raft_consensus.cc:3055] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:10.374111 30523 leader_election.cc:290] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 3 election: Requested vote from peers 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165), d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2:37729)
I20260709 12:23:10.374048 30374 raft_consensus.cc:740] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88e01eb7e17e478cb41a6b289f539040, State: Running, Role: LEADER
I20260709 12:23:10.375002 30449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b27da61aaf34884923faa7f2574251e" candidate_uuid: "641f517d83c347a390a75c7744c293e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e34823cd7341ceb7718ac70ef79508"
I20260709 12:23:10.375520 30449 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.375495 30374 consensus_queue.cc:260] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:23:10.376730 30374 raft_consensus.cc:3060] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:10.376878 30273 catalog_manager.cc:5697] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 reported cstate change: term changed from 2 to 3, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to d6e34823cd7341ceb7718ac70ef79508 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "d6e34823cd7341ceb7718ac70ef79508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.380059 30449 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 3.
I20260709 12:23:10.380973 30490 leader_election.cc:304] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641f517d83c347a390a75c7744c293e8, d6e34823cd7341ceb7718ac70ef79508; no voters: 
I20260709 12:23:10.381680 30374 raft_consensus.cc:2468] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 641f517d83c347a390a75c7744c293e8 in term 3.
I20260709 12:23:10.382740 30701 raft_consensus.cc:2804] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:10.383193 30701 raft_consensus.cc:697] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Becoming Leader. State: Replica: 641f517d83c347a390a75c7744c293e8, State: Running, Role: LEADER
I20260709 12:23:10.383913 30701 consensus_queue.cc:237] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } }
I20260709 12:23:10.390568 30273 catalog_manager.cc:5697] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 reported cstate change: term changed from 2 to 3, leader changed from 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1) to 641f517d83c347a390a75c7744c293e8 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "641f517d83c347a390a75c7744c293e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.755204 30449 raft_consensus.cc:1275] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:10.756290 30701 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.763899 30374 raft_consensus.cc:1275] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:10.765363 30735 consensus_queue.cc:1048] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.812196 30374 raft_consensus.cc:1275] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:10.813161 30735 consensus_queue.cc:1048] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.821405 30449 raft_consensus.cc:1275] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Refusing update from remote peer 641f517d83c347a390a75c7744c293e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:10.822727 30745 consensus_queue.cc:1048] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e34823cd7341ceb7718ac70ef79508" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 37729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.847500 30523 raft_consensus.cc:1275] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:10.848652 30728 consensus_queue.cc:1048] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "641f517d83c347a390a75c7744c293e8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.849812 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.857733 30374 raft_consensus.cc:1275] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Refusing update from remote peer d6e34823cd7341ceb7718ac70ef79508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:10.859861 30727 consensus_queue.cc:1048] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88e01eb7e17e478cb41a6b289f539040" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 38165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.860244 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:10.861526 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:12.396973 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:12.402626 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:12.403039 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:13.100458 30472 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd220 after lost signal to thread 29735
W20260709 12:23:13.101246 30472 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd900 after lost signal to thread 30308
W20260709 12:23:13.101999 30472 debug-util.cc:398] Leaking SignalData structure 0x7b0800164b60 after lost signal to thread 30400
W20260709 12:23:13.102699 30472 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd140 after lost signal to thread 30475
W20260709 12:23:13.103443 30472 debug-util.cc:398] Leaking SignalData structure 0x7b080008e860 after lost signal to thread 30549
I20260709 12:23:13.404053 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:13.409664 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:13.410036 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:14.410938 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.417387 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:14.418020 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:15.418963 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.425690 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:15.426071 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:16.426882 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.432053 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:16.432442 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.433308 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.438562 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:17.438947 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:18.439883 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.445407 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:18.445829 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.446715 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.452134 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:19.452651 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:20.481271 29732 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:23:20.481741 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
I20260709 12:23:20.504839 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:20.505481 29732 tablet_replica.cc:333] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.506107 29732 raft_consensus.cc:2243] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.506958 29732 raft_consensus.cc:2272] T fb56271011824a0e8ce6c6ab393ef6a0 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.508716 29732 tablet_replica.cc:333] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.509218 29732 raft_consensus.cc:2243] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.509914 29732 raft_consensus.cc:2272] T 920bd8cab74646e79972859bb87ded4c P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.511588 29732 tablet_replica.cc:333] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.512130 29732 raft_consensus.cc:2243] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.512514 29732 raft_consensus.cc:2272] T 9e3ac604384f419eb15d2ee5058e4c3a P 88e01eb7e17e478cb41a6b289f539040 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.514196 29732 tablet_replica.cc:333] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.514653 29732 raft_consensus.cc:2243] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.515053 29732 raft_consensus.cc:2272] T 9b27da61aaf34884923faa7f2574251e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.516762 29732 tablet_replica.cc:333] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.517228 29732 raft_consensus.cc:2243] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.517932 29732 raft_consensus.cc:2272] T 3c802fb55c484341b1a09ef24085d9e8 P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.519503 29732 tablet_replica.cc:333] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.519997 29732 raft_consensus.cc:2243] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.520432 29732 raft_consensus.cc:2272] T 7985e70a06dd436883ec1289807cfa8e P 88e01eb7e17e478cb41a6b289f539040 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.521999 29732 tablet_replica.cc:333] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.522481 29732 raft_consensus.cc:2243] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.522853 29732 raft_consensus.cc:2272] T c24a727a611d4cf597902aa75f5f3813 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.524410 29732 tablet_replica.cc:333] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.524823 29732 raft_consensus.cc:2243] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.525745 29732 raft_consensus.cc:2272] T 151d51bac3f6483e8bf730de881fcf16 P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.527941 29732 tablet_replica.cc:333] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.528470 29732 raft_consensus.cc:2243] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.528824 29732 raft_consensus.cc:2272] T 14feb88ffafe4dbe94f6c8581945f738 P 88e01eb7e17e478cb41a6b289f539040 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.530256 29732 tablet_replica.cc:333] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040: stopping tablet replica
I20260709 12:23:20.530630 29732 raft_consensus.cc:2243] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.530957 29732 raft_consensus.cc:2272] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 88e01eb7e17e478cb41a6b289f539040 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.557971 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
I20260709 12:23:20.577385 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
I20260709 12:23:20.601961 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:20.602577 29732 tablet_replica.cc:333] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.603397 29732 raft_consensus.cc:2243] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.604514 29732 raft_consensus.cc:2272] T 9e3ac604384f419eb15d2ee5058e4c3a P d6e34823cd7341ceb7718ac70ef79508 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:20.605288 30489 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.9.1:38165: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260709 12:23:20.607014 29732 tablet_replica.cc:333] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.607785 29732 raft_consensus.cc:2243] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.608279 29732 raft_consensus.cc:2272] T 920bd8cab74646e79972859bb87ded4c P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:20.608498 30489 consensus_peers.cc:597] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 -> Peer 88e01eb7e17e478cb41a6b289f539040 (127.29.9.1:38165): Couldn't send request to peer 88e01eb7e17e478cb41a6b289f539040. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:38165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:20.610090 29732 tablet_replica.cc:333] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.610554 29732 raft_consensus.cc:2243] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.610985 29732 raft_consensus.cc:2272] T fb56271011824a0e8ce6c6ab393ef6a0 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.612771 29732 tablet_replica.cc:333] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.613204 29732 raft_consensus.cc:2243] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.613842 29732 raft_consensus.cc:2272] T 7985e70a06dd436883ec1289807cfa8e P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.615424 29732 tablet_replica.cc:333] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.615906 29732 raft_consensus.cc:2243] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.616545 29732 raft_consensus.cc:2272] T c24a727a611d4cf597902aa75f5f3813 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.618064 29732 tablet_replica.cc:333] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.618484 29732 raft_consensus.cc:2243] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.618871 29732 raft_consensus.cc:2272] T 14feb88ffafe4dbe94f6c8581945f738 P d6e34823cd7341ceb7718ac70ef79508 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.620395 29732 tablet_replica.cc:333] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.620812 29732 raft_consensus.cc:2243] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.621150 29732 raft_consensus.cc:2272] T 151d51bac3f6483e8bf730de881fcf16 P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.622606 29732 tablet_replica.cc:333] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.623013 29732 raft_consensus.cc:2243] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.623351 29732 raft_consensus.cc:2272] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P d6e34823cd7341ceb7718ac70ef79508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.624790 29732 tablet_replica.cc:333] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.625182 29732 raft_consensus.cc:2243] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.625509 29732 raft_consensus.cc:2272] T 3c802fb55c484341b1a09ef24085d9e8 P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.626922 29732 tablet_replica.cc:333] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508: stopping tablet replica
I20260709 12:23:20.627298 29732 raft_consensus.cc:2243] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.627657 29732 raft_consensus.cc:2272] T 9b27da61aaf34884923faa7f2574251e P d6e34823cd7341ceb7718ac70ef79508 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.671823 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
I20260709 12:23:20.689841 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
I20260709 12:23:20.712726 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:20.713337 29732 tablet_replica.cc:333] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.713907 29732 raft_consensus.cc:2243] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.714340 29732 raft_consensus.cc:2272] T 9e3ac604384f419eb15d2ee5058e4c3a P 641f517d83c347a390a75c7744c293e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.716094 29732 tablet_replica.cc:333] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.716557 29732 raft_consensus.cc:2243] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.716945 29732 raft_consensus.cc:2272] T 7985e70a06dd436883ec1289807cfa8e P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.718446 29732 tablet_replica.cc:333] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.718890 29732 raft_consensus.cc:2243] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.719285 29732 raft_consensus.cc:2272] T c24a727a611d4cf597902aa75f5f3813 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.720944 29732 tablet_replica.cc:333] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.721403 29732 raft_consensus.cc:2243] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.721772 29732 raft_consensus.cc:2272] T 151d51bac3f6483e8bf730de881fcf16 P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.723290 29732 tablet_replica.cc:333] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.723775 29732 raft_consensus.cc:2243] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.724483 29732 raft_consensus.cc:2272] T 14feb88ffafe4dbe94f6c8581945f738 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.725907 29732 tablet_replica.cc:333] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.726351 29732 raft_consensus.cc:2243] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.727056 29732 raft_consensus.cc:2272] T d9fcbf8d97ca4c9c98be4ddbcd5cc95f P 641f517d83c347a390a75c7744c293e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.728646 29732 tablet_replica.cc:333] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.729074 29732 raft_consensus.cc:2243] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.729442 29732 raft_consensus.cc:2272] T 3c802fb55c484341b1a09ef24085d9e8 P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.730926 29732 tablet_replica.cc:333] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.731400 29732 raft_consensus.cc:2243] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.732075 29732 raft_consensus.cc:2272] T 9b27da61aaf34884923faa7f2574251e P 641f517d83c347a390a75c7744c293e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.733659 29732 tablet_replica.cc:333] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.734295 29732 raft_consensus.cc:2243] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.734676 29732 raft_consensus.cc:2272] T 920bd8cab74646e79972859bb87ded4c P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.736316 29732 tablet_replica.cc:333] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8: stopping tablet replica
I20260709 12:23:20.736768 29732 raft_consensus.cc:2243] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.737144 29732 raft_consensus.cc:2272] T fb56271011824a0e8ce6c6ab393ef6a0 P 641f517d83c347a390a75c7744c293e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.764724 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
I20260709 12:23:20.782351 29732 master.cc:562] Master@127.29.9.62:32829 shutting down...
I20260709 12:23:20.884292 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:20.884879 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.885262 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9794bbfe7a8240118743f17a687e321e: stopping tablet replica
I20260709 12:23:20.903951 29732 master.cc:584] Master@127.29.9.62:32829 shutdown complete.
641f517d83c347a390a75c7744c293e8  1
88e01eb7e17e478cb41a6b289f539040  5
d6e34823cd7341ceb7718ac70ef79508  4
641f517d83c347a390a75c7744c293e8  3
88e01eb7e17e478cb41a6b289f539040  3
d6e34823cd7341ceb7718ac70ef79508  4
641f517d83c347a390a75c7744c293e8  1
88e01eb7e17e478cb41a6b289f539040  8
d6e34823cd7341ceb7718ac70ef79508  1
641f517d83c347a390a75c7744c293e8  3
88e01eb7e17e478cb41a6b289f539040  4
d6e34823cd7341ceb7718ac70ef79508  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29365 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:23:20.943850 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:46357
I20260709 12:23:20.944932 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:20.950006 30774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:20.950999 30775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:20.951444 30777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:20.951704 29732 server_base.cc:1061] running on GCE node
I20260709 12:23:20.952643 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:20.952819 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:20.952929 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599800952919 us; error 0 us; skew 500 ppm
I20260709 12:23:20.953390 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:20.955754 29732 webserver.cc:533] Webserver started at http://127.29.9.62:33981/ using document root <none> and password file <none>
I20260709 12:23:20.956197 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:20.956360 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:20.956578 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:20.957631 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4"
format_stamp: "Formatted at 2026-07-09 12:23:20 on dist-test-slave-ftzc"
I20260709 12:23:20.961755 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:20.964887 30782 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:20.965528 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:23:20.965760 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4"
format_stamp: "Formatted at 2026-07-09 12:23:20 on dist-test-slave-ftzc"
I20260709 12:23:20.965977 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:20.990437 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:20.991582 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:21.028057 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:46357
I20260709 12:23:21.028172 30833 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:46357 every 8 connection(s)
I20260709 12:23:21.032519 30834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.043879 30834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Bootstrap starting.
I20260709 12:23:21.048458 30834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.052554 30834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: No bootstrap required, opened a new log
I20260709 12:23:21.054585 30834 raft_consensus.cc:359] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" member_type: VOTER }
I20260709 12:23:21.055030 30834 raft_consensus.cc:385] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.055240 30834 raft_consensus.cc:740] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e5ef8bf7224b3eb4f5bc33c89543d4, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.055749 30834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" member_type: VOTER }
I20260709 12:23:21.056192 30834 raft_consensus.cc:399] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:21.056406 30834 raft_consensus.cc:493] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:21.056649 30834 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:21.060575 30834 raft_consensus.cc:515] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" member_type: VOTER }
I20260709 12:23:21.061038 30834 leader_election.cc:304] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68e5ef8bf7224b3eb4f5bc33c89543d4; no voters: 
I20260709 12:23:21.062073 30834 leader_election.cc:290] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:21.062453 30837 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:21.063659 30837 raft_consensus.cc:697] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 1 LEADER]: Becoming Leader. State: Replica: 68e5ef8bf7224b3eb4f5bc33c89543d4, State: Running, Role: LEADER
I20260709 12:23:21.064270 30837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" member_type: VOTER }
I20260709 12:23:21.064869 30834 sys_catalog.cc:565] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:21.069088 30838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" member_type: VOTER } }
I20260709 12:23:21.069316 30839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68e5ef8bf7224b3eb4f5bc33c89543d4. Latest consensus state: current_term: 1 leader_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e5ef8bf7224b3eb4f5bc33c89543d4" member_type: VOTER } }
I20260709 12:23:21.069748 30838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:21.069849 30839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:21.071619 30844 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:21.076344 30844 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:21.079149 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:21.084851 30844 catalog_manager.cc:1383] Generated new cluster ID: 519d1d9a3b3343db8755311d83fd7e71
I20260709 12:23:21.085157 30844 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:21.100256 30844 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:21.101497 30844 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:21.115686 30844 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Generated new TSK 0
I20260709 12:23:21.116251 30844 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:21.145932 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:21.151837 30855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:21.152529 30856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:21.155230 30858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:21.155365 29732 server_base.cc:1061] running on GCE node
I20260709 12:23:21.156312 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:21.156490 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:21.156612 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599801156601 us; error 0 us; skew 500 ppm
I20260709 12:23:21.157066 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:21.159157 29732 webserver.cc:533] Webserver started at http://127.29.9.1:40325/ using document root <none> and password file <none>
I20260709 12:23:21.159585 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:21.159788 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:21.160034 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:21.161024 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "5e9d2b069edc4166802ee0456ebcb706"
format_stamp: "Formatted at 2026-07-09 12:23:21 on dist-test-slave-ftzc"
I20260709 12:23:21.165091 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 12:23:21.168179 30863 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.168843 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:23:21.169086 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "5e9d2b069edc4166802ee0456ebcb706"
format_stamp: "Formatted at 2026-07-09 12:23:21 on dist-test-slave-ftzc"
I20260709 12:23:21.169307 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:21.198778 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:21.200062 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:21.201457 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:21.203770 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:21.203939 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.204186 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:21.204335 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.242991 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:39249
I20260709 12:23:21.243083 30925 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:39249 every 8 connection(s)
I20260709 12:23:21.247931 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:21.254400 30930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:21.255832 30931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:21.258162 29732 server_base.cc:1061] running on GCE node
W20260709 12:23:21.258617 30933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:21.259760 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:21.259789 30926 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46357
W20260709 12:23:21.260123 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:21.260301 30926 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:21.260340 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599801260321 us; error 0 us; skew 500 ppm
I20260709 12:23:21.261137 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:21.261236 30926 heartbeater.cc:507] Master 127.29.9.62:46357 requested a full tablet report, sending...
I20260709 12:23:21.263674 29732 webserver.cc:533] Webserver started at http://127.29.9.2:32787/ using document root <none> and password file <none>
I20260709 12:23:21.263616 30799 ts_manager.cc:194] Registered new tserver with Master: 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:21.264274 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:21.264478 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:21.264714 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:21.265537 30799 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53550
I20260709 12:23:21.265793 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "f868402d5ae640e7b362b9fddacbaf44"
format_stamp: "Formatted at 2026-07-09 12:23:21 on dist-test-slave-ftzc"
I20260709 12:23:21.270505 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:21.273597 30938 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.274349 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:21.274595 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "f868402d5ae640e7b362b9fddacbaf44"
format_stamp: "Formatted at 2026-07-09 12:23:21 on dist-test-slave-ftzc"
I20260709 12:23:21.274847 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:21.284614 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:21.285750 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:21.287123 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:21.289280 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:21.289464 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.289676 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:21.289825 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.326885 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:39975
I20260709 12:23:21.326977 31000 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:39975 every 8 connection(s)
I20260709 12:23:21.331286 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:21.337900 31004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:21.338413 31005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:21.340832 31007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:21.341771 29732 server_base.cc:1061] running on GCE node
I20260709 12:23:21.342576 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:21.342798 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:21.342996 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599801342979 us; error 0 us; skew 500 ppm
I20260709 12:23:21.343371 31001 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46357
I20260709 12:23:21.343631 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:21.343699 31001 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:21.344492 31001 heartbeater.cc:507] Master 127.29.9.62:46357 requested a full tablet report, sending...
I20260709 12:23:21.346310 29732 webserver.cc:533] Webserver started at http://127.29.9.3:46671/ using document root <none> and password file <none>
I20260709 12:23:21.346644 30799 ts_manager.cc:194] Registered new tserver with Master: f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:21.346932 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:21.347182 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:21.347488 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:21.348387 30799 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53558
I20260709 12:23:21.349002 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "1a7b44e2d0ed440985e5f643a5a54587"
format_stamp: "Formatted at 2026-07-09 12:23:21 on dist-test-slave-ftzc"
I20260709 12:23:21.353488 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:21.356622 31012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.357337 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:21.357622 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "1a7b44e2d0ed440985e5f643a5a54587"
format_stamp: "Formatted at 2026-07-09 12:23:21 on dist-test-slave-ftzc"
I20260709 12:23:21.357888 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:21.384738 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:21.385895 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:21.387274 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:21.389322 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:21.389511 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.389730 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:21.389878 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:21.448957 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:38505
I20260709 12:23:21.449067 31075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:38505 every 8 connection(s)
I20260709 12:23:21.464813 31076 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46357
I20260709 12:23:21.465189 31076 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:21.466053 31076 heartbeater.cc:507] Master 127.29.9.62:46357 requested a full tablet report, sending...
I20260709 12:23:21.468214 30799 ts_manager.cc:194] Registered new tserver with Master: 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:21.468698 29732 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015949024s
I20260709 12:23:21.470330 30799 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53570
I20260709 12:23:21.495177 30799 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53584:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:21.502539 30799 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:21.690178 30966 tablet_service.cc:1511] Processing CreateTablet for tablet c42f8452db3546feaba1bef22141480f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:21.690625 30965 tablet_service.cc:1511] Processing CreateTablet for tablet 73ffaf8ce697442c8bbb38cea5ba4136 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:21.691579 31041 tablet_service.cc:1511] Processing CreateTablet for tablet c42f8452db3546feaba1bef22141480f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:21.692075 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f8452db3546feaba1bef22141480f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.693002 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f8452db3546feaba1bef22141480f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.693612 30965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ffaf8ce697442c8bbb38cea5ba4136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.693090 30964 tablet_service.cc:1511] Processing CreateTablet for tablet 367bf3d3c48d46dc88329ac7bc92fceb (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:21.695668 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367bf3d3c48d46dc88329ac7bc92fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.705276 31040 tablet_service.cc:1511] Processing CreateTablet for tablet 73ffaf8ce697442c8bbb38cea5ba4136 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:21.706604 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ffaf8ce697442c8bbb38cea5ba4136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.712641 31091 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:21.713332 31039 tablet_service.cc:1511] Processing CreateTablet for tablet 367bf3d3c48d46dc88329ac7bc92fceb (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:21.714712 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367bf3d3c48d46dc88329ac7bc92fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.715413 30889 tablet_service.cc:1511] Processing CreateTablet for tablet 367bf3d3c48d46dc88329ac7bc92fceb (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:21.716807 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367bf3d3c48d46dc88329ac7bc92fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.720124 30890 tablet_service.cc:1511] Processing CreateTablet for tablet 73ffaf8ce697442c8bbb38cea5ba4136 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:21.721349 30890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ffaf8ce697442c8bbb38cea5ba4136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.723637 30966 tablet_service.cc:1511] Processing CreateTablet for tablet 2426f61afbf24698969bfa651d747ae9 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:21.724891 30891 tablet_service.cc:1511] Processing CreateTablet for tablet c42f8452db3546feaba1bef22141480f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:21.726128 30891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f8452db3546feaba1bef22141480f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.730378 30964 tablet_service.cc:1511] Processing CreateTablet for tablet c773fc74822844b7aec9509683eb266e (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:21.734771 30888 tablet_service.cc:1511] Processing CreateTablet for tablet 2426f61afbf24698969bfa651d747ae9 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:21.736884 30887 tablet_service.cc:1511] Processing CreateTablet for tablet c773fc74822844b7aec9509683eb266e (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:21.737679 31091 tablet_bootstrap.cc:654] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.738131 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c773fc74822844b7aec9509683eb266e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.745668 31038 tablet_service.cc:1511] Processing CreateTablet for tablet c773fc74822844b7aec9509683eb266e (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:21.747067 31038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c773fc74822844b7aec9509683eb266e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.749006 30886 tablet_service.cc:1511] Processing CreateTablet for tablet f8311babaa554788b3a614d3f27a53f4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:21.724916 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2426f61afbf24698969bfa651d747ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.751080 30888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2426f61afbf24698969bfa651d747ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.751425 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c773fc74822844b7aec9509683eb266e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.753888 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8311babaa554788b3a614d3f27a53f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.760911 31093 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:21.765311 30965 tablet_service.cc:1511] Processing CreateTablet for tablet f8311babaa554788b3a614d3f27a53f4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:21.774372 30965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8311babaa554788b3a614d3f27a53f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.774643 31039 tablet_service.cc:1511] Processing CreateTablet for tablet 2426f61afbf24698969bfa651d747ae9 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:21.780532 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2426f61afbf24698969bfa651d747ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.789913 31037 tablet_service.cc:1511] Processing CreateTablet for tablet f8311babaa554788b3a614d3f27a53f4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:21.791347 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8311babaa554788b3a614d3f27a53f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.791785 30891 tablet_service.cc:1511] Processing CreateTablet for tablet d6c2e2c3cd614b10b823dd15a66b564a (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:21.792999 30891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c2e2c3cd614b10b823dd15a66b564a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.793732 30964 tablet_service.cc:1511] Processing CreateTablet for tablet d6c2e2c3cd614b10b823dd15a66b564a (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:21.794916 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c2e2c3cd614b10b823dd15a66b564a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.791814 31092 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:21.810084 31093 tablet_bootstrap.cc:654] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.811510 31091 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:21.812038 31091 ts_tablet_manager.cc:1403] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.003s
I20260709 12:23:21.813131 31092 tablet_bootstrap.cc:654] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.818732 31037 tablet_service.cc:1511] Processing CreateTablet for tablet d6c2e2c3cd614b10b823dd15a66b564a (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:21.820031 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c2e2c3cd614b10b823dd15a66b564a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.815058 31091 raft_consensus.cc:359] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:21.821378 31091 raft_consensus.cc:385] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.821743 31091 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.822763 31091 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:21.829712 30965 tablet_service.cc:1511] Processing CreateTablet for tablet d2b6f99bf7a54d65868d8e55cbb466b0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:21.830562 31093 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:21.831049 31093 ts_tablet_manager.cc:1403] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.012s
I20260709 12:23:21.832677 30886 tablet_service.cc:1511] Processing CreateTablet for tablet d2b6f99bf7a54d65868d8e55cbb466b0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:21.833875 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b6f99bf7a54d65868d8e55cbb466b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.834149 31093 raft_consensus.cc:359] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:21.834903 31093 raft_consensus.cc:385] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.835036 30965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b6f99bf7a54d65868d8e55cbb466b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.835322 31093 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.835696 30890 tablet_service.cc:1511] Processing CreateTablet for tablet c41891dd6716497eaa34a9558f696ee1 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:21.836159 31093 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:21.841230 31001 heartbeater.cc:499] Master 127.29.9.62:46357 was elected leader, sending a full tablet report...
I20260709 12:23:21.841466 31091 ts_tablet_manager.cc:1434] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:23:21.842542 31091 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:21.839763 30890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41891dd6716497eaa34a9558f696ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.854040 30966 tablet_service.cc:1511] Processing CreateTablet for tablet c41891dd6716497eaa34a9558f696ee1 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:21.855953 30963 tablet_service.cc:1511] Processing CreateTablet for tablet bb928f25f0c549d8a16221f877f4e73c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:21.858143 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41891dd6716497eaa34a9558f696ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.858737 30887 tablet_service.cc:1511] Processing CreateTablet for tablet bb928f25f0c549d8a16221f877f4e73c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:21.859922 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb928f25f0c549d8a16221f877f4e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.863404 30963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb928f25f0c549d8a16221f877f4e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.864609 31041 tablet_service.cc:1511] Processing CreateTablet for tablet bb928f25f0c549d8a16221f877f4e73c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:21.864889 30962 tablet_service.cc:1511] Processing CreateTablet for tablet 16482c443f7041fa88ccf619697bd7b6 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:21.865805 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb928f25f0c549d8a16221f877f4e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.866170 30962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16482c443f7041fa88ccf619697bd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.868580 31093 ts_tablet_manager.cc:1434] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.037s	user 0.017s	sys 0.011s
I20260709 12:23:21.846868 31038 tablet_service.cc:1511] Processing CreateTablet for tablet c41891dd6716497eaa34a9558f696ee1 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:21.871564 31038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41891dd6716497eaa34a9558f696ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.872740 30889 tablet_service.cc:1511] Processing CreateTablet for tablet ea71eb6769834992980701da50fb499d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:21.869828 30888 tablet_service.cc:1511] Processing CreateTablet for tablet 16482c443f7041fa88ccf619697bd7b6 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:21.873929 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea71eb6769834992980701da50fb499d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.869766 30961 tablet_service.cc:1511] Processing CreateTablet for tablet ea71eb6769834992980701da50fb499d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:21.875005 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea71eb6769834992980701da50fb499d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.876477 30888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16482c443f7041fa88ccf619697bd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.877920 31036 tablet_service.cc:1511] Processing CreateTablet for tablet ea71eb6769834992980701da50fb499d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:21.879187 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea71eb6769834992980701da50fb499d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.889211 30926 heartbeater.cc:499] Master 127.29.9.62:46357 was elected leader, sending a full tablet report...
I20260709 12:23:21.892815 31093 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:21.893631 31091 tablet_bootstrap.cc:654] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.896679 31037 tablet_service.cc:1511] Processing CreateTablet for tablet 16482c443f7041fa88ccf619697bd7b6 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:21.897887 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16482c443f7041fa88ccf619697bd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.904711 30891 tablet_service.cc:1511] Processing CreateTablet for tablet a99465fc591541cf808078e4fb820f06 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:21.905941 30891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a99465fc591541cf808078e4fb820f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.903455 31093 tablet_bootstrap.cc:654] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.926069 31038 tablet_service.cc:1511] Processing CreateTablet for tablet a99465fc591541cf808078e4fb820f06 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:21.927807 31091 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:21.928310 31091 ts_tablet_manager.cc:1403] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.000s
I20260709 12:23:21.928833 30886 tablet_service.cc:1511] Processing CreateTablet for tablet df33f71fccef4bc399b382d9c520fc89 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:21.930011 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df33f71fccef4bc399b382d9c520fc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.926069 30964 tablet_service.cc:1511] Processing CreateTablet for tablet a99465fc591541cf808078e4fb820f06 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:21.931109 31091 raft_consensus.cc:359] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:21.931843 31091 raft_consensus.cc:385] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.932132 31091 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.932390 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a99465fc591541cf808078e4fb820f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.927408 31038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a99465fc591541cf808078e4fb820f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.933005 31091 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:21.935755 31091 ts_tablet_manager.cc:1434] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:23:21.936622 31091 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:21.937172 31092 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:21.937606 31092 ts_tablet_manager.cc:1403] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.146s	user 0.002s	sys 0.011s
I20260709 12:23:21.943889 31036 tablet_service.cc:1511] Processing CreateTablet for tablet df33f71fccef4bc399b382d9c520fc89 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:21.944921 31091 tablet_bootstrap.cc:654] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:21.944768 30961 tablet_service.cc:1511] Processing CreateTablet for tablet df33f71fccef4bc399b382d9c520fc89 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:21.945998 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df33f71fccef4bc399b382d9c520fc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.947227 31097 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.947764 31097 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:21.950443 31097 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:21.945150 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df33f71fccef4bc399b382d9c520fc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.953521 31092 raft_consensus.cc:359] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:21.954257 31092 raft_consensus.cc:385] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:21.954545 31092 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:21.954422 30891 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7ff3f21bc8406f850dc7aa742d339b (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:21.955894 30891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7ff3f21bc8406f850dc7aa742d339b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.974575 31040 tablet_service.cc:1511] Processing CreateTablet for tablet d2b6f99bf7a54d65868d8e55cbb466b0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:21.975875 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b6f99bf7a54d65868d8e55cbb466b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.976369 30965 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7ff3f21bc8406f850dc7aa742d339b (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:21.983361 30965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7ff3f21bc8406f850dc7aa742d339b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.993072 31098 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.993306 30886 tablet_service.cc:1511] Processing CreateTablet for tablet 8f02e5ab61a44506bdae958f8a275d96 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:21.993549 31098 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:21.993937 31041 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7ff3f21bc8406f850dc7aa742d339b (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:21.994614 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f02e5ab61a44506bdae958f8a275d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:21.971521 31092 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:21.995152 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7ff3f21bc8406f850dc7aa742d339b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:22.007835 30927 tablet.cc:2406] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:22.008514 31092 ts_tablet_manager.cc:1434] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.010s
I20260709 12:23:22.009193 31076 heartbeater.cc:499] Master 127.29.9.62:46357 was elected leader, sending a full tablet report...
I20260709 12:23:22.001508 31098 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:22.028538 31093 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:22.030120 31092 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:22.031807 31093 ts_tablet_manager.cc:1403] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.011s
I20260709 12:23:22.034624 31093 raft_consensus.cc:359] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.035329 31093 raft_consensus.cc:385] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.037034 30966 tablet_service.cc:1511] Processing CreateTablet for tablet 8f02e5ab61a44506bdae958f8a275d96 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:22.038367 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f02e5ab61a44506bdae958f8a275d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.041584 31092 tablet_bootstrap.cc:654] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.045588 31091 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:22.045327 30962 tablet_service.cc:1511] Processing CreateTablet for tablet 412c07102f934870a9035bbc8463f79a (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:22.046062 31091 ts_tablet_manager.cc:1403] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.110s	user 0.004s	sys 0.011s
I20260709 12:23:22.046599 30962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412c07102f934870a9035bbc8463f79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.035604 31093 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.048853 31093 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.048985 31091 raft_consensus.cc:359] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.049675 31091 raft_consensus.cc:385] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.050226 31091 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.051054 31091 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.052471 30961 tablet_service.cc:1511] Processing CreateTablet for tablet 01464274c44b4333a93e3d0f02ab076c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:22.053151 31091 ts_tablet_manager.cc:1434] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:22.053665 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01464274c44b4333a93e3d0f02ab076c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.055127 30888 tablet_service.cc:1511] Processing CreateTablet for tablet 412c07102f934870a9035bbc8463f79a (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:22.057050 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 01464274c44b4333a93e3d0f02ab076c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:22.058213 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01464274c44b4333a93e3d0f02ab076c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.050253 31098 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.059940 31098 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.067065 31037 tablet_service.cc:1511] Processing CreateTablet for tablet 412c07102f934870a9035bbc8463f79a (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:22.067574 31093 ts_tablet_manager.cc:1434] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.003s
I20260709 12:23:22.067940 30888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412c07102f934870a9035bbc8463f79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.068435 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412c07102f934870a9035bbc8463f79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.068742 31093 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:22.060237 31040 tablet_service.cc:1511] Processing CreateTablet for tablet 8f02e5ab61a44506bdae958f8a275d96 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:22.071153 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f02e5ab61a44506bdae958f8a275d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.075966 31093 tablet_bootstrap.cc:654] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.084918 31098 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.080555 31091 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:22.094035 31038 tablet_service.cc:1511] Processing CreateTablet for tablet 01464274c44b4333a93e3d0f02ab076c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:22.094400 31039 tablet_service.cc:1511] Processing CreateTablet for tablet 46a1f37dacb24754935cf60327f898a9 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:22.095358 31038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01464274c44b4333a93e3d0f02ab076c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.097563 30885 tablet_service.cc:1511] Processing CreateTablet for tablet d2cc749e9de5450fa2de1c458a9deba7 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:22.098829 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cc749e9de5450fa2de1c458a9deba7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:22.100704 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:22.102871 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a1f37dacb24754935cf60327f898a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.103229 31035 tablet_service.cc:1511] Processing CreateTablet for tablet d2cc749e9de5450fa2de1c458a9deba7 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:22.104573 31035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cc749e9de5450fa2de1c458a9deba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.106384 30889 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8a0dad5f8a44e9b54943368c8d3758 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:22.107558 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8a0dad5f8a44e9b54943368c8d3758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.110754 30963 tablet_service.cc:1511] Processing CreateTablet for tablet d2cc749e9de5450fa2de1c458a9deba7 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:22.110754 30964 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8a0dad5f8a44e9b54943368c8d3758 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:22.112224 30963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cc749e9de5450fa2de1c458a9deba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.113808 30961 tablet_service.cc:1511] Processing CreateTablet for tablet 46a1f37dacb24754935cf60327f898a9 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:22.115025 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a1f37dacb24754935cf60327f898a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.116175 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8a0dad5f8a44e9b54943368c8d3758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.126139 31091 tablet_bootstrap.cc:654] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.127321 31097 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.127862 31097 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:22.129877 31097 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:22.131366 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:22.132158 30976 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:22.133430 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:22.134052 30975 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:22.135385 30865 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.136286 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.137143 31098 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.137470 31098 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.137802 31098 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.141086 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:22.142577 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:23:22.144102 30939 leader_election.cc:343] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:22.149092 30783 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 46865us
I20260709 12:23:22.149643 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:22.150283 31050 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:22.150210 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:22.152412 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.153196 31097 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.153522 31097 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.153842 31097 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:22.155915 30939 leader_election.cc:343] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:22.156352 30939 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:22.174099 31041 tablet_service.cc:1511] Processing CreateTablet for tablet d26d779b278e4014b0368920ddf7529f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:22.175488 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26d779b278e4014b0368920ddf7529f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.131330 30890 tablet_service.cc:1511] Processing CreateTablet for tablet 46a1f37dacb24754935cf60327f898a9 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:22.180604 30890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a1f37dacb24754935cf60327f898a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.176268 30966 tablet_service.cc:1511] Processing CreateTablet for tablet d26d779b278e4014b0368920ddf7529f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:22.194767 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26d779b278e4014b0368920ddf7529f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.198097 31108 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.199304 31108 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.199646 31108 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.202016 31093 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:22.202541 31093 ts_tablet_manager.cc:1403] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.020s
I20260709 12:23:22.204591 31036 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8a0dad5f8a44e9b54943368c8d3758 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:22.205837 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8a0dad5f8a44e9b54943368c8d3758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.206264 31108 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.208398 31097 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:22.209103 31093 raft_consensus.cc:359] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.209832 31093 raft_consensus.cc:385] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.210155 31093 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.210348 31097 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:22.212121 31092 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:22.212024 30965 tablet_service.cc:1511] Processing CreateTablet for tablet 7101e773e94f44688e2e79f4540cad7e (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:22.212613 31092 ts_tablet_manager.cc:1403] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.192s	user 0.013s	sys 0.000s
I20260709 12:23:22.212508 31097 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:22.213307 30965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7101e773e94f44688e2e79f4540cad7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.213583 31093 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.216825 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 7101e773e94f44688e2e79f4540cad7e (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:22.217993 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7101e773e94f44688e2e79f4540cad7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.220659 30886 tablet_service.cc:1511] Processing CreateTablet for tablet d26d779b278e4014b0368920ddf7529f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:22.221827 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26d779b278e4014b0368920ddf7529f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.223042 31041 tablet_service.cc:1511] Processing CreateTablet for tablet 7101e773e94f44688e2e79f4540cad7e (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:22.223403 30888 tablet_service.cc:1511] Processing CreateTablet for tablet c16ae54ff14e49b6877d162ad00f3ac4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:22.224220 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7101e773e94f44688e2e79f4540cad7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.224555 30888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c16ae54ff14e49b6877d162ad00f3ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.226090 31098 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:22.226599 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:22.227281 30900 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:23:22.228031 30864 leader_election.cc:343] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:22.228480 31092 raft_consensus.cc:359] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.226146 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:22.229218 31092 raft_consensus.cc:385] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.229408 31051 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:22.231783 31037 tablet_service.cc:1511] Processing CreateTablet for tablet c16ae54ff14e49b6877d162ad00f3ac4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:22.232914 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c16ae54ff14e49b6877d162ad00f3ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.233938 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:22.234259 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:22.234542 31092 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.234490 31051 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.235167 30900 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:22.234750 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:22.237021 30975 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.239782 31098 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:22.235368 31092 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.240778 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:22.240798 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:22.242489 31092 ts_tablet_manager.cc:1434] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 12:23:22.243388 31092 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:22.248906 30889 tablet_service.cc:1511] Processing CreateTablet for tablet a623118fdd9441959cededdcb6981b04 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:22.250229 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a623118fdd9441959cededdcb6981b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.251134 30964 tablet_service.cc:1511] Processing CreateTablet for tablet a623118fdd9441959cededdcb6981b04 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:22.251814 30976 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:22.252331 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a623118fdd9441959cededdcb6981b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.254845 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:22.255475 31050 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.265376 31108 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.269608 30864 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:22.277172 31091 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:22.277721 31091 ts_tablet_manager.cc:1403] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.199s	user 0.009s	sys 0.004s
I20260709 12:23:22.278381 31050 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:22.279434 31108 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:22.279872 30864 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:22.280581 31108 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:22.281044 31108 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:22.280686 31091 raft_consensus.cc:359] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.281572 31091 raft_consensus.cc:385] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.281908 31091 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.281884 31108 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.282737 31091 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.284898 31091 ts_tablet_manager.cc:1434] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:22.287439 31091 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:22.295053 30963 tablet_service.cc:1511] Processing CreateTablet for tablet c16ae54ff14e49b6877d162ad00f3ac4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:22.295851 31041 tablet_service.cc:1511] Processing CreateTablet for tablet a623118fdd9441959cededdcb6981b04 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:22.296348 30963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c16ae54ff14e49b6877d162ad00f3ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.296581 30975 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:22.297043 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a623118fdd9441959cededdcb6981b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.307116 31091 tablet_bootstrap.cc:654] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.343825 31051 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:22.345350 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:22.345563 30889 tablet_service.cc:1511] Processing CreateTablet for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:22.346598 31111 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:22.346901 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.347064 31111 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:22.347911 31111 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } }
I20260709 12:23:22.360073 30890 tablet_service.cc:1511] Processing CreateTablet for tablet e0f1d02ed7d148238e18e004aa55b7d4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:22.367363 30890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f1d02ed7d148238e18e004aa55b7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.369764 30797 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.380792 31041 tablet_service.cc:1511] Processing CreateTablet for tablet e0f1d02ed7d148238e18e004aa55b7d4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:22.382581 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f1d02ed7d148238e18e004aa55b7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.400812 31093 ts_tablet_manager.cc:1434] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.198s	user 0.009s	sys 0.009s
I20260709 12:23:22.402055 31093 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:22.404019 30966 tablet_service.cc:1511] Processing CreateTablet for tablet e0f1d02ed7d148238e18e004aa55b7d4 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:22.405289 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f1d02ed7d148238e18e004aa55b7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.407379 31092 tablet_bootstrap.cc:654] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.418838 31093 tablet_bootstrap.cc:654] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.432762 30964 tablet_service.cc:1511] Processing CreateTablet for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:22.432981 30965 tablet_service.cc:1511] Processing CreateTablet for tablet 16bdfcb6fd114ab2865524877be18bd1 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:22.424045 30890 tablet_service.cc:1511] Processing CreateTablet for tablet 16bdfcb6fd114ab2865524877be18bd1 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:22.434468 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.434751 30890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bdfcb6fd114ab2865524877be18bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.436288 30965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bdfcb6fd114ab2865524877be18bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.439172 30962 tablet_service.cc:1511] Processing CreateTablet for tablet 3e64945a8b39400e851326d79a2f4d8d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:22.440543 30962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e64945a8b39400e851326d79a2f4d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.443362 31035 tablet_service.cc:1511] Processing CreateTablet for tablet 3e64945a8b39400e851326d79a2f4d8d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:22.443554 30798 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.444653 31035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e64945a8b39400e851326d79a2f4d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.447388 31040 tablet_service.cc:1511] Processing CreateTablet for tablet 16bdfcb6fd114ab2865524877be18bd1 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:22.453743 31091 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:22.453469 30961 tablet_service.cc:1511] Processing CreateTablet for tablet 94b5c1c64c494cb59ba74a90317df87d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:22.455106 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bdfcb6fd114ab2865524877be18bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.455148 31091 ts_tablet_manager.cc:1403] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.168s	user 0.026s	sys 0.012s
I20260709 12:23:22.455592 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b5c1c64c494cb59ba74a90317df87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.458336 31037 tablet_service.cc:1511] Processing CreateTablet for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:22.459533 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.458469 31091 raft_consensus.cc:359] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.461222 30960 tablet_service.cc:1511] Processing CreateTablet for tablet 90927dbf8a094626a555e5e7b3d0f803 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:22.461380 30886 tablet_service.cc:1511] Processing CreateTablet for tablet 90927dbf8a094626a555e5e7b3d0f803 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:22.461869 31091 raft_consensus.cc:385] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.462308 31091 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.462525 30960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90927dbf8a094626a555e5e7b3d0f803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.462951 31039 tablet_service.cc:1511] Processing CreateTablet for tablet 90927dbf8a094626a555e5e7b3d0f803 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:22.465864 31036 tablet_service.cc:1511] Processing CreateTablet for tablet 94b5c1c64c494cb59ba74a90317df87d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:22.441692 30889 tablet_service.cc:1511] Processing CreateTablet for tablet 3e64945a8b39400e851326d79a2f4d8d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:22.467245 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e64945a8b39400e851326d79a2f4d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.470206 30885 tablet_service.cc:1511] Processing CreateTablet for tablet f7010d5d8a0647a9ab67a7f9250845ea (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:22.471462 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7010d5d8a0647a9ab67a7f9250845ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.472397 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90927dbf8a094626a555e5e7b3d0f803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.463232 31091 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.479446 30959 tablet_service.cc:1511] Processing CreateTablet for tablet f7010d5d8a0647a9ab67a7f9250845ea (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:22.479954 31092 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:22.480417 31092 ts_tablet_manager.cc:1403] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.237s	user 0.010s	sys 0.005s
I20260709 12:23:22.480839 30959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7010d5d8a0647a9ab67a7f9250845ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.484026 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90927dbf8a094626a555e5e7b3d0f803. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.483352 31092 raft_consensus.cc:359] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.488210 31092 raft_consensus.cc:385] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.488555 31092 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.489428 31092 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.491582 31092 ts_tablet_manager.cc:1434] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:23:22.492579 31092 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:22.495886 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b5c1c64c494cb59ba74a90317df87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.461395 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 94b5c1c64c494cb59ba74a90317df87d (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:22.496935 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b5c1c64c494cb59ba74a90317df87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.502768 31092 tablet_bootstrap.cc:654] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.514853 31091 ts_tablet_manager.cc:1434] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 12:23:22.516526 31091 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:22.533778 31036 tablet_service.cc:1511] Processing CreateTablet for tablet f7010d5d8a0647a9ab67a7f9250845ea (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:22.535066 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7010d5d8a0647a9ab67a7f9250845ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.535740 30889 tablet_service.cc:1511] Processing CreateTablet for tablet e9e2b6ed092748a1a4b34148ab6d2923 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:22.536926 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e2b6ed092748a1a4b34148ab6d2923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.536917 31039 tablet_service.cc:1511] Processing CreateTablet for tablet e9e2b6ed092748a1a4b34148ab6d2923 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:22.538204 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e2b6ed092748a1a4b34148ab6d2923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.538456 30959 tablet_service.cc:1511] Processing CreateTablet for tablet e9e2b6ed092748a1a4b34148ab6d2923 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:22.539597 30959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e2b6ed092748a1a4b34148ab6d2923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.554991 31093 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:22.555557 31093 ts_tablet_manager.cc:1403] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.154s	user 0.007s	sys 0.006s
I20260709 12:23:22.558512 30886 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:22.561545 31093 raft_consensus.cc:359] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.562338 31093 raft_consensus.cc:385] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.562635 31093 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.563462 30886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.572846 31091 tablet_bootstrap.cc:654] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.596215 31093 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.598932 31093 ts_tablet_manager.cc:1434] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.043s	user 0.001s	sys 0.004s
I20260709 12:23:22.600391 31093 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:22.609257 31092 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:22.609781 31092 ts_tablet_manager.cc:1403] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.026s
I20260709 12:23:22.612571 31092 raft_consensus.cc:359] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.613315 31092 raft_consensus.cc:385] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.613622 31092 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.614394 31092 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.616825 31092 ts_tablet_manager.cc:1434] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:23:22.617923 31092 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:22.623257 31111 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.623799 31111 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.624589 31092 tablet_bootstrap.cc:654] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.624788 31108 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.625383 31108 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.626031 31111 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.627418 31108 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.627930 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:22.629832 31051 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:22.633299 31093 tablet_bootstrap.cc:654] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.636113 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:22.638458 31091 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:22.638944 31091 ts_tablet_manager.cc:1403] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.018s
I20260709 12:23:22.641592 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.643169 31111 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.643000 31091 raft_consensus.cc:359] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.643000 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:22.643898 31091 raft_consensus.cc:385] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.644296 31091 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.644356 30975 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:22.645330 31091 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.645725 30865 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.643548 31111 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:22.646292 30864 leader_election.cc:343] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:22.646600 31111 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.648170 31091 ts_tablet_manager.cc:1434] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:22.649246 31091 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:22.653067 31108 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.653498 31108 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.653844 31108 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.655488 31091 tablet_bootstrap.cc:654] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.660820 31108 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.653836 31111 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.663913 31111 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.665127 31092 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:22.665462 31108 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.665601 31092 ts_tablet_manager.cc:1403] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.024s
I20260709 12:23:22.668671 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:22.670143 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:22.670446 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:22.670774 31050 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.671056 30975 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.678321 30975 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:22.679236 31050 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:22.668501 31092 raft_consensus.cc:359] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.679587 30865 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.679877 31092 raft_consensus.cc:385] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.680253 31092 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.680567 31108 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:22.680821 31113 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.681079 31108 raft_consensus.cc:697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:22.681275 31113 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.681183 31092 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.682296 31051 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.682092 31108 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.683434 31113 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.685647 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:22.696862 30976 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:22.690078 31051 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:22.691179 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.692317 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:22.693122 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:22.697937 31111 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:22.698426 31111 raft_consensus.cc:697] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:22.698956 30865 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:22.699651 31111 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.701578 31113 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:22.697106 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:22.703740 31113 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.704187 31050 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
W20260709 12:23:22.710294 30939 leader_election.cc:343] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:22.715862 31108 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:22.717690 30939 leader_election.cc:343] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:22.704206 31113 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:22.744577 31093 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:22.745201 31093 ts_tablet_manager.cc:1403] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.000s
I20260709 12:23:22.748332 31093 raft_consensus.cc:359] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.749106 31093 raft_consensus.cc:385] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:22.749428 31093 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:22.750195 31093 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.754036 31093 ts_tablet_manager.cc:1434] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:22.755196 31093 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:22.759958 30887 tablet_service.cc:1511] Processing CreateTablet for tablet cce46c39c1e64c35bd5af558239d31e0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:22.761504 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce46c39c1e64c35bd5af558239d31e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.763082 30889 tablet_service.cc:1511] Processing CreateTablet for tablet 251fc9e7cd1b4a0a83ccb0059840fc8b (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:22.764324 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251fc9e7cd1b4a0a83ccb0059840fc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.775595 31093 tablet_bootstrap.cc:654] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.886907 31108 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.887454 31108 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.890503 31108 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.911223 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 07b3f75bb9e3426a95aa33d2f0472a36 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:22.912606 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b3f75bb9e3426a95aa33d2f0472a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.920980 31092 ts_tablet_manager.cc:1434] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.255s	user 0.010s	sys 0.002s
I20260709 12:23:22.921963 31092 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:22.922820 30885 tablet_service.cc:1511] Processing CreateTablet for tablet 9b078c36427749489d90f67c6504ea82 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:22.924118 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b078c36427749489d90f67c6504ea82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.928288 30890 tablet_service.cc:1511] Processing CreateTablet for tablet bb8d20fced0547649402e6668241468c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:22.929563 30890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8d20fced0547649402e6668241468c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.937793 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbd739a4ac24132b2b04caeed573906 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:22.940217 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbd739a4ac24132b2b04caeed573906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.942282 30889 tablet_service.cc:1511] Processing CreateTablet for tablet 174b12b6011c47a2baad4ae805c60e15 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:22.943392 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174b12b6011c47a2baad4ae805c60e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.944826 30885 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf1075e43344e4c85d09b6aeac40c55 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:22.946076 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf1075e43344e4c85d09b6aeac40c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.946462 30891 tablet_service.cc:1511] Processing CreateTablet for tablet 42ef8a4823164a83ae72778108c8d593 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:22.947651 30891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ef8a4823164a83ae72778108c8d593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.950726 30888 tablet_service.cc:1511] Processing CreateTablet for tablet 4045483bdd0047e8a04aade3faadf9d6 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:22.952744 30884 tablet_service.cc:1511] Processing CreateTablet for tablet f278da50d600410dbed3af60b0147046 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:22.953402 31097 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.953958 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f278da50d600410dbed3af60b0147046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.953855 31097 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:22.954488 30888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4045483bdd0047e8a04aade3faadf9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.958351 31108 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.968371 31092 tablet_bootstrap.cc:654] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:22.970943 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:22.978432 31038 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbd739a4ac24132b2b04caeed573906 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:22.973965 31111 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:22.984858 31038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbd739a4ac24132b2b04caeed573906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.974669 31097 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:22.976783 31039 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:22.986349 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.978431 31041 tablet_service.cc:1511] Processing CreateTablet for tablet bb8d20fced0547649402e6668241468c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:22.988428 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8d20fced0547649402e6668241468c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.988837 30960 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:22.990038 30960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.979985 31036 tablet_service.cc:1511] Processing CreateTablet for tablet cce46c39c1e64c35bd5af558239d31e0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:22.989974 31034 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf1075e43344e4c85d09b6aeac40c55 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:22.992413 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce46c39c1e64c35bd5af558239d31e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.991567 31093 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:22.993026 31034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf1075e43344e4c85d09b6aeac40c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.994148 30959 tablet_service.cc:1511] Processing CreateTablet for tablet 251fc9e7cd1b4a0a83ccb0059840fc8b (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:22.995385 30959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251fc9e7cd1b4a0a83ccb0059840fc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.981550 31037 tablet_service.cc:1511] Processing CreateTablet for tablet 07b3f75bb9e3426a95aa33d2f0472a36 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:22.996464 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b3f75bb9e3426a95aa33d2f0472a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.996776 30963 tablet_service.cc:1511] Processing CreateTablet for tablet bb8d20fced0547649402e6668241468c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:22.998838 30966 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbd739a4ac24132b2b04caeed573906 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:22.983064 31035 tablet_service.cc:1511] Processing CreateTablet for tablet 251fc9e7cd1b4a0a83ccb0059840fc8b (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:23.000481 31035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251fc9e7cd1b4a0a83ccb0059840fc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.000873 30962 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf1075e43344e4c85d09b6aeac40c55 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 12:23:23.002918 30939 leader_election.cc:343] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:22.992686 30961 tablet_service.cc:1511] Processing CreateTablet for tablet cce46c39c1e64c35bd5af558239d31e0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:23.012964 30964 tablet_service.cc:1511] Processing CreateTablet for tablet 07b3f75bb9e3426a95aa33d2f0472a36 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:22.980520 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:23.014671 31050 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:22.728456 31113 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.020093 31093 ts_tablet_manager.cc:1403] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.265s	user 0.071s	sys 0.064s
I20260709 12:23:23.024003 31093 raft_consensus.cc:359] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.025197 31093 raft_consensus.cc:385] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.025696 31093 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.008350 31033 tablet_service.cc:1511] Processing CreateTablet for tablet 174b12b6011c47a2baad4ae805c60e15 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:23.033113 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:23.033728 30974 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.034766 31040 tablet_service.cc:1511] Processing CreateTablet for tablet 9b078c36427749489d90f67c6504ea82 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:23.037905 30965 tablet_service.cc:1511] Processing CreateTablet for tablet 9b078c36427749489d90f67c6504ea82 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:23.035281 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce46c39c1e64c35bd5af558239d31e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.033205 31033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174b12b6011c47a2baad4ae805c60e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.040453 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:23.042238 30958 tablet_service.cc:1511] Processing CreateTablet for tablet 174b12b6011c47a2baad4ae805c60e15 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:23.043273 30962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf1075e43344e4c85d09b6aeac40c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.044525 31032 tablet_service.cc:1511] Processing CreateTablet for tablet 42ef8a4823164a83ae72778108c8d593 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:23.044957 30887 tablet_service.cc:1511] Processing CreateTablet for tablet b9ebc983d26c40eda93f030abf94ac78 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:23.046095 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebc983d26c40eda93f030abf94ac78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.046641 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbd739a4ac24132b2b04caeed573906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.049226 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b078c36427749489d90f67c6504ea82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.050645 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:23.052866 31032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ef8a4823164a83ae72778108c8d593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.052033 30963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8d20fced0547649402e6668241468c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.054044 30957 tablet_service.cc:1511] Processing CreateTablet for tablet 42ef8a4823164a83ae72778108c8d593 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:23.055258 30957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ef8a4823164a83ae72778108c8d593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.056110 30958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174b12b6011c47a2baad4ae805c60e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.026764 31093 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.059763 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b3f75bb9e3426a95aa33d2f0472a36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:23.060295 30939 leader_election.cc:343] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.060734 30939 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:23.060962 31093 ts_tablet_manager.cc:1434] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:23:23.049187 31091 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:23.061717 31091 ts_tablet_manager.cc:1403] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.413s	user 0.028s	sys 0.043s
I20260709 12:23:23.062162 30865 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:23.066161 31097 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:23.068143 31091 raft_consensus.cc:359] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.068804 31091 raft_consensus.cc:385] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.069119 31091 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.069814 30965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b078c36427749489d90f67c6504ea82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.069981 31091 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.071954 31091 ts_tablet_manager.cc:1434] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:23:23.072844 31091 tablet_bootstrap.cc:492] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:23.040443 30974 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:23.075685 31097 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:23.076015 30799 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.072002 31098 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.084054 30865 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:23:23.104184 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:23.120340 31108 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:23.134447 31041 tablet_service.cc:1511] Processing CreateTablet for tablet 4045483bdd0047e8a04aade3faadf9d6 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:23.135831 31041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4045483bdd0047e8a04aade3faadf9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.130999 31093 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.126171 31113 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:23:23.141276 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 57308.2us
I20260709 12:23:23.165623 31098 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:23.170374 31038 tablet_service.cc:1511] Processing CreateTablet for tablet f278da50d600410dbed3af60b0147046 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:23.171900 31038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f278da50d600410dbed3af60b0147046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.154659 31108 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:23.194496 31142 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:23.198421 31108 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.221376 30961 tablet_service.cc:1511] Processing CreateTablet for tablet f278da50d600410dbed3af60b0147046 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:23.222903 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f278da50d600410dbed3af60b0147046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.227262 31091 tablet_bootstrap.cc:654] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.221376 30963 tablet_service.cc:1511] Processing CreateTablet for tablet 4045483bdd0047e8a04aade3faadf9d6 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:23.244953 31037 tablet_service.cc:1511] Processing CreateTablet for tablet b9ebc983d26c40eda93f030abf94ac78 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:23.189601 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:23.245041 30961 tablet_service.cc:1511] Processing CreateTablet for tablet b9ebc983d26c40eda93f030abf94ac78 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:23.256652 31097 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:23.256561 31039 tablet_service.cc:1511] Processing CreateTablet for tablet acdd02ca27e84adea69d06954f5fe368 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:23.260658 31092 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:23.265046 31140 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:23.277493 30963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4045483bdd0047e8a04aade3faadf9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.278565 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebc983d26c40eda93f030abf94ac78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.280511 31049 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.289597 31093 tablet_bootstrap.cc:654] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.290395 31092 ts_tablet_manager.cc:1403] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.369s	user 0.046s	sys 0.031s
I20260709 12:23:23.306324 30964 tablet_service.cc:1511] Processing CreateTablet for tablet 4e16650c05cc4ef7a21196d5cc0ca3de (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:23.312315 31040 tablet_service.cc:1511] Processing CreateTablet for tablet db4086d50310462885b584b6297df730 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:23.318554 31039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acdd02ca27e84adea69d06954f5fe368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.318264 31032 tablet_service.cc:1511] Processing CreateTablet for tablet 4e16650c05cc4ef7a21196d5cc0ca3de (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:23.318885 30959 tablet_service.cc:1511] Processing CreateTablet for tablet acdd02ca27e84adea69d06954f5fe368 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:23.319566 31032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e16650c05cc4ef7a21196d5cc0ca3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.319643 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebc983d26c40eda93f030abf94ac78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:23.334087 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 55578.4us
I20260709 12:23:23.335882 30885 tablet_service.cc:1511] Processing CreateTablet for tablet db4086d50310462885b584b6297df730 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:23.332158 30959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acdd02ca27e84adea69d06954f5fe368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.332535 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4086d50310462885b584b6297df730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.341538 31092 raft_consensus.cc:359] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.343149 31092 raft_consensus.cc:385] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.344681 30889 tablet_service.cc:1511] Processing CreateTablet for tablet acdd02ca27e84adea69d06954f5fe368 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:23.344928 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 4e16650c05cc4ef7a21196d5cc0ca3de (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:23.345912 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acdd02ca27e84adea69d06954f5fe368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.346446 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e16650c05cc4ef7a21196d5cc0ca3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.347819 30884 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3512a5343c47d9aec2fa9ca2e680d8 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:23.349099 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3512a5343c47d9aec2fa9ca2e680d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.350888 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4086d50310462885b584b6297df730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.343465 31092 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.352458 31092 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.358311 30964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e16650c05cc4ef7a21196d5cc0ca3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.365216 31049 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:23.390159 31091 tablet_bootstrap.cc:492] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:23.390584 31091 ts_tablet_manager.cc:1403] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.318s	user 0.014s	sys 0.014s
I20260709 12:23:23.387310 31140 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.405833 30966 tablet_service.cc:1511] Processing CreateTablet for tablet db4086d50310462885b584b6297df730 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:23.407140 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4086d50310462885b584b6297df730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.407968 31091 raft_consensus.cc:359] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.408639 31091 raft_consensus.cc:385] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.408891 31091 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.410704 30960 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3512a5343c47d9aec2fa9ca2e680d8 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:23.411669 30960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3512a5343c47d9aec2fa9ca2e680d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.411957 31111 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:23.423849 31144 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.424448 31092 ts_tablet_manager.cc:1434] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.001s
I20260709 12:23:23.424362 31144 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.425478 31092 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:23.425717 31038 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3512a5343c47d9aec2fa9ca2e680d8 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:23.426414 31144 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:23.426936 31038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3512a5343c47d9aec2fa9ca2e680d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.400116 31140 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.428328 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:23.430788 31140 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:23:23.430891 30939 leader_election.cc:343] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.432111 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:23.432745 30974 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:23.433815 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:23.435055 30889 tablet_service.cc:1511] Processing CreateTablet for tablet af9423709bcf457ab89f49d71d157085 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:23.436192 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9423709bcf457ab89f49d71d157085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.441781 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:23.442409 31050 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:23.432900 31093 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:23.443925 31093 ts_tablet_manager.cc:1403] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.322s	user 0.037s	sys 0.027s
W20260709 12:23:23.446426 30864 leader_election.cc:343] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.446697 31093 raft_consensus.cc:359] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.447439 31093 raft_consensus.cc:385] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.448632 30939 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:23.448870 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:23.449932 31140 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:23.450274 31140 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.450721 30798 catalog_manager.cc:5697] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.452526 31153 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:23.452907 31153 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.453212 31153 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.430030 31091 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.453568 31140 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.470106 31091 ts_tablet_manager.cc:1434] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 12:23:23.454138 31093 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.479045 30961 tablet_service.cc:1511] Processing CreateTablet for tablet bbcdd6eee3294377852452b4989be45f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:23.480067 31033 tablet_service.cc:1511] Processing CreateTablet for tablet bbcdd6eee3294377852452b4989be45f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:23.484815 30959 tablet_service.cc:1511] Processing CreateTablet for tablet af9423709bcf457ab89f49d71d157085 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:23.482256 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 217b561ab05e4c71be81abf723e3c499 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:23.486008 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b561ab05e4c71be81abf723e3c499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.490263 30799 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.492108 30961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbcdd6eee3294377852452b4989be45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.485212 31033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbcdd6eee3294377852452b4989be45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.480192 30889 tablet_service.cc:1511] Processing CreateTablet for tablet bbcdd6eee3294377852452b4989be45f (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:23.504562 30889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbcdd6eee3294377852452b4989be45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.505379 31092 tablet_bootstrap.cc:654] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.481318 31093 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.510136 31091 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:23.518265 30958 tablet_service.cc:1511] Processing CreateTablet for tablet 217b561ab05e4c71be81abf723e3c499 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:23.519603 30958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b561ab05e4c71be81abf723e3c499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.520884 31091 tablet_bootstrap.cc:654] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.519027 31153 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.526196 31037 tablet_service.cc:1511] Processing CreateTablet for tablet af9423709bcf457ab89f49d71d157085 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:23.527319 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9423709bcf457ab89f49d71d157085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.529534 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:23.530148 30900 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.539680 30963 tablet_service.cc:1511] Processing CreateTablet for tablet f09ba14cb7054588ae9fdcdedf04b081 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:23.543871 31153 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:23.544875 30959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9423709bcf457ab89f49d71d157085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.544992 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:23.545648 31051 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.546854 30963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ba14cb7054588ae9fdcdedf04b081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.549243 31040 tablet_service.cc:1511] Processing CreateTablet for tablet 217b561ab05e4c71be81abf723e3c499 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:23.534636 31140 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.550630 30884 tablet_service.cc:1511] Processing CreateTablet for tablet f09ba14cb7054588ae9fdcdedf04b081 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:23.551352 30900 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:23.553128 30939 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:23.555052 31111 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:23.555478 31111 raft_consensus.cc:697] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:23.556139 30887 tablet_service.cc:1511] Processing CreateTablet for tablet f62100297c3841e0914543cebffb2ce0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:23.556257 31111 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.557318 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62100297c3841e0914543cebffb2ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.558393 30962 tablet_service.cc:1511] Processing CreateTablet for tablet f62100297c3841e0914543cebffb2ce0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:23.564426 30962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62100297c3841e0914543cebffb2ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.560796 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ba14cb7054588ae9fdcdedf04b081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.560887 31036 tablet_service.cc:1511] Processing CreateTablet for tablet f62100297c3841e0914543cebffb2ce0 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:23.565035 31093 ts_tablet_manager.cc:1434] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.000s
I20260709 12:23:23.566036 31093 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.576750 30885 tablet_service.cc:1511] Processing CreateTablet for tablet 404ba35beca1446e838b7d720c8a6281 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:23.578014 30885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404ba35beca1446e838b7d720c8a6281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.578362 31092 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:23.578837 31092 ts_tablet_manager.cc:1403] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.004s
I20260709 12:23:23.551282 31032 tablet_service.cc:1511] Processing CreateTablet for tablet f09ba14cb7054588ae9fdcdedf04b081 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:23.581676 31051 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:23.583695 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62100297c3841e0914543cebffb2ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.589339 31032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ba14cb7054588ae9fdcdedf04b081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.590648 31040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b561ab05e4c71be81abf723e3c499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.591360 30960 tablet_service.cc:1511] Processing CreateTablet for tablet 404ba35beca1446e838b7d720c8a6281 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:23.592738 30960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404ba35beca1446e838b7d720c8a6281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.598321 31091 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:23.598860 31091 ts_tablet_manager.cc:1403] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.010s
I20260709 12:23:23.601467 31091 raft_consensus.cc:359] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.603621 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:23.611357 30976 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.619153 31093 tablet_bootstrap.cc:654] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.626304 30976 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:23.627642 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:23.628629 31146 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:23.629092 31146 raft_consensus.cc:697] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:23.629010 31092 raft_consensus.cc:359] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.629926 31092 raft_consensus.cc:385] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.630394 31092 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.605695 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:23.610678 31091 raft_consensus.cc:385] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.629966 31146 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.604612 31140 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:23.631023 31091 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.634428 31037 tablet_service.cc:1511] Processing CreateTablet for tablet 404ba35beca1446e838b7d720c8a6281 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:23.636018 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404ba35beca1446e838b7d720c8a6281. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:23.640496 30864 leader_election.cc:343] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.641973 31091 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.644244 31092 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.646634 31092 ts_tablet_manager.cc:1434] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 12:23:23.651119 30887 tablet_service.cc:1511] Processing CreateTablet for tablet e9e712edd3ac45e9b088a4dbd226c616 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:23.652420 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e712edd3ac45e9b088a4dbd226c616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.652590 31091 ts_tablet_manager.cc:1434] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 12:23:23.641956 30884 tablet_service.cc:1511] Processing CreateTablet for tablet b1166342933745c5b82da4ee4032736c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:23.653465 31091 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:23.669569 31140 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:23.676409 30799 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.678668 31091 tablet_bootstrap.cc:654] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.679891 30958 tablet_service.cc:1511] Processing CreateTablet for tablet e9e712edd3ac45e9b088a4dbd226c616 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:23.681757 30958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e712edd3ac45e9b088a4dbd226c616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.682915 30884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1166342933745c5b82da4ee4032736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.686573 31092 tablet_bootstrap.cc:492] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:23.686450 30962 tablet_service.cc:1511] Processing CreateTablet for tablet b1166342933745c5b82da4ee4032736c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:23.687695 30962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1166342933745c5b82da4ee4032736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.688170 31037 tablet_service.cc:1511] Processing CreateTablet for tablet e9e712edd3ac45e9b088a4dbd226c616 (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:23.689214 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e712edd3ac45e9b088a4dbd226c616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.688975 31036 tablet_service.cc:1511] Processing CreateTablet for tablet b1166342933745c5b82da4ee4032736c (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:23.690166 31036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1166342933745c5b82da4ee4032736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.700131 30799 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.723446 31092 tablet_bootstrap.cc:654] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.729504 30887 tablet_service.cc:1511] Processing CreateTablet for tablet 6741df8b39c94364bb06b6b75ab50bac (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:23.730731 30887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6741df8b39c94364bb06b6b75ab50bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.736891 31093 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:23.740025 31093 ts_tablet_manager.cc:1403] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.174s	user 0.017s	sys 0.022s
I20260709 12:23:23.742578 31093 raft_consensus.cc:359] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.743876 31148 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:23.752852 31093 raft_consensus.cc:385] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.753777 31093 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.754067 30958 tablet_service.cc:1511] Processing CreateTablet for tablet 6741df8b39c94364bb06b6b75ab50bac (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:23.754608 31093 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.755326 30958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6741df8b39c94364bb06b6b75ab50bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.759621 31093 ts_tablet_manager.cc:1434] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 12:23:23.760699 31093 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.766469 31093 tablet_bootstrap.cc:654] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.772989 31091 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:23.773442 31091 ts_tablet_manager.cc:1403] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.120s	user 0.004s	sys 0.004s
I20260709 12:23:23.774453 31037 tablet_service.cc:1511] Processing CreateTablet for tablet 6741df8b39c94364bb06b6b75ab50bac (DEFAULT_TABLE table=test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:23.775616 31037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6741df8b39c94364bb06b6b75ab50bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.785552 31091 raft_consensus.cc:359] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.786305 31091 raft_consensus.cc:385] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.786571 31091 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.787424 31091 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.792755 31092 tablet_bootstrap.cc:492] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:23.793217 31092 ts_tablet_manager.cc:1403] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 12:23:23.793569 31091 ts_tablet_manager.cc:1434] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:23:23.794565 31091 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:23.795584 31092 raft_consensus.cc:359] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.796512 31092 raft_consensus.cc:385] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.796761 31092 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.797489 31092 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.800233 31092 ts_tablet_manager.cc:1434] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:23.800791 31091 tablet_bootstrap.cc:654] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.802977 31093 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:23.803400 31093 ts_tablet_manager.cc:1403] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.020s
I20260709 12:23:23.804032 31092 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:23.805809 31093 raft_consensus.cc:359] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.806437 31093 raft_consensus.cc:385] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.806689 31093 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.807300 31093 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.809157 31093 ts_tablet_manager.cc:1434] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:23:23.810267 31093 tablet_bootstrap.cc:492] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.812665 31092 tablet_bootstrap.cc:654] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.815501 31093 tablet_bootstrap.cc:654] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.821849 31093 tablet_bootstrap.cc:492] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:23.821906 31091 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:23.822372 31093 ts_tablet_manager.cc:1403] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.002s
I20260709 12:23:23.822446 31091 ts_tablet_manager.cc:1403] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 12:23:23.824321 31092 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:23.824796 31092 ts_tablet_manager.cc:1403] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:23:23.824931 31093 raft_consensus.cc:359] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.825618 31093 raft_consensus.cc:385] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.825878 31093 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.826490 31093 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.827556 31092 raft_consensus.cc:359] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.828233 31092 raft_consensus.cc:385] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.828358 31093 ts_tablet_manager.cc:1434] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:23.828545 31092 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.829231 31093 tablet_bootstrap.cc:492] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.829279 31092 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.831384 31092 ts_tablet_manager.cc:1434] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:23.834872 31093 tablet_bootstrap.cc:654] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.835786 31092 tablet_bootstrap.cc:492] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:23.837853 31091 raft_consensus.cc:359] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.838510 31091 raft_consensus.cc:385] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.838771 31091 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.839521 31091 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.841931 31092 tablet_bootstrap.cc:654] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.852936 31091 ts_tablet_manager.cc:1434] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:23:23.863214 31091 tablet_bootstrap.cc:492] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:23.864341 31093 tablet_bootstrap.cc:492] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:23.864739 31093 ts_tablet_manager.cc:1403] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.015s
I20260709 12:23:23.866740 31093 raft_consensus.cc:359] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.867214 31093 raft_consensus.cc:385] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.867413 31093 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.868148 31093 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.868929 31091 tablet_bootstrap.cc:654] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.870225 31092 tablet_bootstrap.cc:492] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:23.870517 31093 ts_tablet_manager.cc:1434] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:23.870695 31092 ts_tablet_manager.cc:1403] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.035s	user 0.027s	sys 0.005s
I20260709 12:23:23.872920 31093 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.873242 31092 raft_consensus.cc:359] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.873883 31092 raft_consensus.cc:385] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.874040 31091 tablet_bootstrap.cc:492] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:23.874240 31092 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.874451 31091 ts_tablet_manager.cc:1403] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:23:23.875006 31092 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.877242 31092 ts_tablet_manager.cc:1434] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:23.877074 31091 raft_consensus.cc:359] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.877751 31091 raft_consensus.cc:385] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.878364 31091 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.878865 31093 tablet_bootstrap.cc:654] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.879550 31091 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.881139 31092 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:23.887122 31092 tablet_bootstrap.cc:654] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.889922 31093 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:23.890367 31093 ts_tablet_manager.cc:1403] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 12:23:23.892251 31111 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.892762 31111 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.892943 31093 raft_consensus.cc:359] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.893554 31093 raft_consensus.cc:385] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.893779 31093 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.894289 31093 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.894977 31111 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:23.896261 31093 ts_tablet_manager.cc:1434] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:23:23.896099 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:23.896766 31049 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:23.897161 31093 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.897977 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:23.898118 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:23.898729 31092 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:23.898942 31111 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:23.899348 31092 ts_tablet_manager.cc:1403] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:23:23.899314 31111 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.899926 31111 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.902161 31092 raft_consensus.cc:359] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.902829 31092 raft_consensus.cc:385] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.903124 31092 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.903477 31093 tablet_bootstrap.cc:654] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.903891 31092 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:23.903796 30939 leader_election.cc:343] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.908031 31148 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.908279 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb8c0 after lost signal to thread 29735
W20260709 12:23:23.909435 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08000bbfa0 after lost signal to thread 30833
W20260709 12:23:23.910619 30922 debug-util.cc:398] Leaking SignalData structure 0x7b080016b920 after lost signal to thread 30925
I20260709 12:23:23.904347 31091 ts_tablet_manager.cc:1434] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
W20260709 12:23:23.911665 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8a20 after lost signal to thread 31000
I20260709 12:23:23.908480 31148 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.912688 31092 ts_tablet_manager.cc:1434] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
W20260709 12:23:23.912799 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7e00 after lost signal to thread 31075
I20260709 12:23:23.913705 31092 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:23.913913 31148 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:23.914950 31153 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.915117 31091 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:23.915402 31153 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.918743 31111 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.920800 31111 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:23.922684 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:23.917371 31153 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:23.923326 31049 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:23.924047 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:23.924634 30976 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:23.926435 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:23.927250 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:23.927834 31050 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.928659 31093 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:23.929162 31093 ts_tablet_manager.cc:1403] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.003s
I20260709 12:23:23.929028 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:23.928596 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:23.931212 31091 tablet_bootstrap.cc:654] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.932747 31150 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.930536 30939 leader_election.cc:343] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:23.932323 31051 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:23.933506 31150 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.936074 31093 raft_consensus.cc:359] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.936785 31093 raft_consensus.cc:385] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.937091 31093 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.937770 31093 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.938341 31092 tablet_bootstrap.cc:654] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.932099 30865 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:23.941176 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:23.942027 31153 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:23.942390 31153 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.942710 31153 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.943747 31093 ts_tablet_manager.cc:1434] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:23:23.944769 31093 tablet_bootstrap.cc:492] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:23.952600 31150 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:23.953516 31111 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:23.960438 31093 tablet_bootstrap.cc:654] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:23.930517 30900 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:23.961509 31145 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:23.969036 31145 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.969475 31145 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:23.974668 31050 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:23.975565 31092 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:23.976130 31092 ts_tablet_manager.cc:1403] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.007s
I20260709 12:23:23.976054 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:23.977002 31111 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:23.978281 31111 raft_consensus.cc:697] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:23.979238 31111 consensus_queue.cc:237] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.979192 31092 raft_consensus.cc:359] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:23.984678 31092 raft_consensus.cc:385] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:23.985059 31092 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:23.988451 31092 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.000897 31153 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.001412 31092 ts_tablet_manager.cc:1434] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:23:24.002468 31092 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.003755 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:24.006886 31153 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.014515 30796 catalog_manager.cc:5697] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.016440 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.017078 31050 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.035311 31111 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.035838 31111 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.039306 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.039989 31111 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.040628 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:24.041980 30939 leader_election.cc:343] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.040057 30901 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.044066 30939 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:24.045284 31111 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.045663 31111 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.045766 31145 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.046232 31111 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.047086 30900 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:24.051283 31145 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.053140 31092 tablet_bootstrap.cc:654] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.053047 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.063369 31051 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.065208 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:24.066009 30976 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:24.067348 31050 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:24.070997 30865 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.072117 31093 tablet_bootstrap.cc:492] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:24.072551 31093 ts_tablet_manager.cc:1403] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.128s	user 0.037s	sys 0.042s
I20260709 12:23:24.072059 31145 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.075915 31092 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:24.076331 31092 ts_tablet_manager.cc:1403] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.013s
I20260709 12:23:24.076495 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:24.077540 31153 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:24.077979 31153 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:24.080447 31153 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.077023 31111 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.085320 31111 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.088392 31097 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.088842 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:24.086762 31092 raft_consensus.cc:359] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.090042 31092 raft_consensus.cc:385] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.090237 31150 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.090314 31092 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.090749 31150 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.089411 30900 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.091070 31092 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.091265 31145 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:24.092720 31150 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:24.095749 31091 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:24.096179 31091 ts_tablet_manager.cc:1403] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.181s	user 0.026s	sys 0.030s
I20260709 12:23:24.103137 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.103804 31050 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.101786 31150 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.105597 31150 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.107544 31150 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:23:24.113456 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:24.114387 30900 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:24.115628 30939 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:24.120414 31050 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:24.121336 31153 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:24.122822 31153 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:24.124742 31153 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.127218 31091 raft_consensus.cc:359] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.128316 31091 raft_consensus.cc:385] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.128908 31091 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.128711 30799 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.129621 31091 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.134466 31093 raft_consensus.cc:359] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.135120 31093 raft_consensus.cc:385] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.135380 31093 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.139281 31111 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.139747 31093 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.139753 31111 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.143023 31091 ts_tablet_manager.cc:1434] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:23:24.143711 31091 tablet_bootstrap.cc:492] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:24.144091 31093 ts_tablet_manager.cc:1434] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:23:24.144722 31092 ts_tablet_manager.cc:1434] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.068s	user 0.015s	sys 0.020s
I20260709 12:23:24.145277 31093 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:24.145658 31092 tablet_bootstrap.cc:492] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.145732 31111 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.147158 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.148541 30901 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.149135 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.149758 31050 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.150962 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:24.151800 31111 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.152184 31111 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.152515 31111 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.156301 31145 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.156771 31145 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.157996 31097 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.158432 31097 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.158776 31145 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.160234 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.160449 31097 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.161100 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.161479 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.161006 31050 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:24.162045 31048 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.162523 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.161720 30901 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.163398 31148 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.168646 30865 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.168759 31148 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.169785 31140 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.172145 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:24.164619 31145 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.167068 31097 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.179818 31145 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.182653 31145 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.182916 31140 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.183781 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.184401 31048 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:24.184605 31148 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.179404 31097 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.185948 30864 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:24.186780 31148 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.187124 31148 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.186976 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.187616 31048 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:24.187881 31111 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.188393 31097 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.189045 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:24.189554 31097 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.189967 31097 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.189878 31148 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.190557 31097 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.192457 31093 tablet_bootstrap.cc:654] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.190152 31140 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.192842 31140 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.190162 31092 tablet_bootstrap.cc:654] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.189916 31111 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.193729 31140 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.198329 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.200440 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.201122 31048 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.204416 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:24.204931 30900 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.208346 31091 tablet_bootstrap.cc:654] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.210700 30796 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.211503 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.209271 31148 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.213523 30901 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:24.226524 31148 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.226424 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.225926 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.228087 31051 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.232842 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.233251 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.228540 31140 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.230211 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.234159 31048 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.234513 30901 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:24.235342 31093 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:24.233870 30974 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:24.236397 31093 ts_tablet_manager.cc:1403] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.009s
I20260709 12:23:24.238194 31140 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.238824 31093 raft_consensus.cc:359] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.239457 31093 raft_consensus.cc:385] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.239701 31093 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.240348 31093 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.241770 31093 ts_tablet_manager.cc:1434] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:23:24.242125 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.242671 31050 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.243995 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:24.244532 30974 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.247269 31093 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:24.247943 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.248667 30899 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:24.249766 31097 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.250918 30976 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:24.251089 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.251044 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.257361 30975 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:24.255592 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.259248 30973 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:24.261107 31014 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.261273 30974 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:24.262465 31014 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.263495 31050 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:24.263691 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.266237 31189 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.264566 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:24.267324 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:24.267504 31189 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.268107 30974 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:24.268937 31048 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:24.269042 31148 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:24.269470 31150 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.269583 31148 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:24.270429 31148 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.270712 30864 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:24.272933 31146 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:24.273351 31146 raft_consensus.cc:697] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:24.274108 31146 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.274724 31092 tablet_bootstrap.cc:492] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:24.275167 31092 ts_tablet_manager.cc:1403] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.012s
I20260709 12:23:24.282980 30900 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:24.287472 31091 tablet_bootstrap.cc:492] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:24.288126 31091 ts_tablet_manager.cc:1403] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.010s
I20260709 12:23:24.289811 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:24.291831 31193 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:24.292405 31193 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:24.293213 31193 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.299214 31146 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:24.305383 31148 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.308629 31148 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.307871 31092 raft_consensus.cc:359] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.311318 31092 raft_consensus.cc:385] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.311625 31092 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.302610 31097 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.307525 31093 tablet_bootstrap.cc:654] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.311861 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.309798 30797 catalog_manager.cc:5697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.313467 31092 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:24.314196 30864 leader_election.cc:343] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.316922 31051 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:24.318629 31092 ts_tablet_manager.cc:1434] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:23:24.310765 31148 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.325073 31091 raft_consensus.cc:359] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.326810 31092 tablet_bootstrap.cc:492] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.327098 31091 raft_consensus.cc:385] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.327381 31091 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.328764 31091 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.326416 30939 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:24.332769 31097 raft_consensus.cc:2764] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:24.335008 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:24.339519 31091 ts_tablet_manager.cc:1434] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.003s
I20260709 12:23:24.340545 31091 tablet_bootstrap.cc:492] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:24.341406 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.342059 30974 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:24.348531 30865 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:24.348171 30797 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.349612 30799 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.351640 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.351898 31146 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.352298 31146 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.353197 31146 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.352722 31051 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:24.355682 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:24.356477 31111 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.364367 31146 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.372462 31093 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:24.375993 31148 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.376554 31148 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.383560 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:24.385365 30864 leader_election.cc:343] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.386778 31148 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.387742 31093 ts_tablet_manager.cc:1403] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.023s
I20260709 12:23:24.388900 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:24.389001 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.389626 30974 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.390089 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:24.390563 31092 tablet_bootstrap.cc:654] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:24.391820 30864 leader_election.cc:343] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.391979 31091 tablet_bootstrap.cc:654] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:24.391966 30865 leader_election.cc:343] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.392761 30865 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.393949 31148 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.391558 31146 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.398073 31093 raft_consensus.cc:359] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.398713 31093 raft_consensus.cc:385] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.398978 31093 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.399669 31093 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.401289 31092 tablet_bootstrap.cc:492] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:24.401738 31092 ts_tablet_manager.cc:1403] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.000s
I20260709 12:23:24.402872 31148 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.403095 30974 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:24.403338 31148 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.404219 30865 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:24.405463 31148 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.406032 31148 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:24.406616 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.408164 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.410851 31148 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:24.410449 31093 ts_tablet_manager.cc:1434] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
W20260709 12:23:24.410377 30864 leader_election.cc:343] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:24.412469 30865 leader_election.cc:343] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.411711 31148 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.413005 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.414141 31092 raft_consensus.cc:359] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.414794 31092 raft_consensus.cc:385] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.415040 31092 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.415144 31140 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.412314 31093 tablet_bootstrap.cc:492] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:24.415812 31092 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.417908 31092 ts_tablet_manager.cc:1434] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:24.418730 31193 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.419056 31092 tablet_bootstrap.cc:492] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.422472 31093 tablet_bootstrap.cc:654] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.428596 31091 tablet_bootstrap.cc:492] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:24.430825 31091 ts_tablet_manager.cc:1403] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.000s
I20260709 12:23:24.434360 31091 raft_consensus.cc:359] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.437310 31091 raft_consensus.cc:385] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.437644 31091 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.438323 31091 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.440615 31091 ts_tablet_manager.cc:1434] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:24.442154 31091 tablet_bootstrap.cc:492] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:24.430866 31092 tablet_bootstrap.cc:654] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.448510 31093 tablet_bootstrap.cc:492] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:24.448953 31093 ts_tablet_manager.cc:1403] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.010s
I20260709 12:23:24.449342 30799 catalog_manager.cc:5697] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.453707 31097 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.457474 31091 tablet_bootstrap.cc:654] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.451395 31093 raft_consensus.cc:359] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.472824 31093 raft_consensus.cc:385] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.473132 31093 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.475790 31093 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.482160 31092 tablet_bootstrap.cc:492] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:24.482640 31092 ts_tablet_manager.cc:1403] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.015s
I20260709 12:23:24.485235 31092 raft_consensus.cc:359] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.485860 31092 raft_consensus.cc:385] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.486112 31092 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.486819 31092 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.496202 31092 ts_tablet_manager.cc:1434] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:23:24.479388 31093 ts_tablet_manager.cc:1434] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:23:24.500561 31093 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:24.509307 31092 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.515522 31092 tablet_bootstrap.cc:654] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.518174 31093 tablet_bootstrap.cc:654] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.521807 31091 tablet_bootstrap.cc:492] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:24.522213 31091 ts_tablet_manager.cc:1403] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.080s	user 0.032s	sys 0.033s
I20260709 12:23:24.526755 31091 raft_consensus.cc:359] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.527428 31091 raft_consensus.cc:385] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.527683 31091 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.528316 31091 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.529956 31091 ts_tablet_manager.cc:1434] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:24.530627 31091 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:24.539233 31092 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:24.539710 31092 ts_tablet_manager.cc:1403] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.000s
I20260709 12:23:24.540647 31097 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.542404 31091 tablet_bootstrap.cc:654] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.542671 31092 raft_consensus.cc:359] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.543299 31092 raft_consensus.cc:385] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.543532 31092 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.544312 31092 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.546219 31092 ts_tablet_manager.cc:1434] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:24.547116 31092 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.551163 31091 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:24.551779 31091 ts_tablet_manager.cc:1403] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:23:24.552758 31092 tablet_bootstrap.cc:654] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.554548 31091 raft_consensus.cc:359] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.555271 31091 raft_consensus.cc:385] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.555557 31091 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.561653 31091 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.566876 31091 ts_tablet_manager.cc:1434] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:24.567874 31091 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:24.574865 31193 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.586498 31092 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:24.586997 31092 ts_tablet_manager.cc:1403] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.014s
I20260709 12:23:24.588945 31193 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.589583 31092 raft_consensus.cc:359] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.590108 31093 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:24.590233 31092 raft_consensus.cc:385] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.603157 31093 ts_tablet_manager.cc:1403] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.010s
I20260709 12:23:24.603166 31092 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.610787 31197 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.611374 31197 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.612896 31091 tablet_bootstrap.cc:654] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.612730 31092 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.613564 31197 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:24.615624 31093 raft_consensus.cc:359] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.616292 31093 raft_consensus.cc:385] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.616559 31093 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.617221 31093 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.619133 31093 ts_tablet_manager.cc:1434] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 12:23:24.620012 31093 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:24.621125 31092 ts_tablet_manager.cc:1434] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:23:24.620990 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.621980 31092 tablet_bootstrap.cc:492] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.622313 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:23:24.623775 31014 leader_election.cc:343] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:24.625044 31013 leader_election.cc:343] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.625523 31013 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.642123 31197 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:24.648159 31092 tablet_bootstrap.cc:654] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.649226 31197 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.650502 31091 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:24.650650 31093 tablet_bootstrap.cc:654] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.651135 31091 ts_tablet_manager.cc:1403] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.083s	user 0.005s	sys 0.009s
I20260709 12:23:24.652159 31197 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.654803 31197 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:24.657155 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.657793 30901 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:24.658696 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:24.660266 31014 leader_election.cc:343] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.661427 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.662525 31197 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.662891 31197 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.663226 31197 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.654551 31091 raft_consensus.cc:359] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.665618 31091 raft_consensus.cc:385] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.665935 31091 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.666643 31091 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.680644 31193 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.681154 31148 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.684943 31091 ts_tablet_manager.cc:1434] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:23:24.687299 31091 tablet_bootstrap.cc:492] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:24.695775 31197 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.705318 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:24.706017 30901 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.712455 31197 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:24.714246 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:23:24.715795 31014 leader_election.cc:343] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.716949 31091 tablet_bootstrap.cc:654] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:24.717195 31148 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:24.727353 30901 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:24.729902 31093 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:24.730306 31093 ts_tablet_manager.cc:1403] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.018s
I20260709 12:23:24.730319 31092 tablet_bootstrap.cc:492] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:24.730973 31092 ts_tablet_manager.cc:1403] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.109s	user 0.040s	sys 0.027s
I20260709 12:23:24.732560 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:24.735692 31092 raft_consensus.cc:359] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.736613 31092 raft_consensus.cc:385] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.736922 31092 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.737709 31092 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.734107 31197 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:24.744696 31092 ts_tablet_manager.cc:1434] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:24.744343 31093 raft_consensus.cc:359] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.746209 31092 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:24.746537 31093 raft_consensus.cc:385] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.751006 31150 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.752092 31091 tablet_bootstrap.cc:492] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:24.752501 31091 ts_tablet_manager.cc:1403] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.002s
I20260709 12:23:24.751492 31150 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.745235 31197 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:24.755815 31197 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.756237 31091 raft_consensus.cc:359] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.756892 31091 raft_consensus.cc:385] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:24.756932 31097 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.757210 31091 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.757511 31097 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.757889 31091 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.760159 31153 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.760640 31153 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.760419 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:24.762826 30974 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:24.764101 31014 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:24.764498 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.749289 31093 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:24.764027 31111 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.848908 31111 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.849586 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.765667 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.850332 30899 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
W20260709 12:23:24.851177 30939 leader_election.cc:343] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.851418 31111 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.762575 31153 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.764938 31150 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:24.853183 31150 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.853938 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:24.853971 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.855540 31093 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.859480 31048 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.859892 31153 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.860327 31153 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.860663 31153 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.860867 31140 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.768306 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.824106 31148 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.845384 31097 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.824148 31146 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:23:24.764894 31189 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.891508 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.880183 31111 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.856838 31150 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.872784 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:24.887030 31189 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.866683 31140 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.883196 31148 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.894234 31193 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.905309 31091 ts_tablet_manager.cc:1434] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.151s	user 0.025s	sys 0.009s
I20260709 12:23:24.906065 31091 tablet_bootstrap.cc:492] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:24.908682 31093 ts_tablet_manager.cc:1434] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.178s	user 0.026s	sys 0.005s
I20260709 12:23:24.899765 31189 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.909109 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:24.909960 31140 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.910637 31093 tablet_bootstrap.cc:492] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:24.899020 31111 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.910545 31153 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:24.922785 30939 leader_election.cc:343] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:24.904644 31193 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.925010 31193 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.925520 31193 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:24.925869 31193 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:24.926189 31193 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:24.939277 30899 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:24.940130 31148 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:24.967517 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:24.971913 31225 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.972407 31225 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.970924 31189 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:24.975106 31051 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:23:25.005268 31189 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:25.025168 30797 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.020503 31111 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.027192 31150 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:25.035564 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.036269 31050 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:25.037608 31050 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.037979 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.038579 30899 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
W20260709 12:23:25.044463 31013 leader_election.cc:343] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.049103 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.040445 31225 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:25.053501 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:25.054119 30973 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.057538 31226 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:25.057968 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.059212 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.059417 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:25.059489 31014 leader_election.cc:343] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.060192 30974 raft_consensus.cc:2393] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:25.060010 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.061713 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.061786 31225 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.062352 31111 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:25.063478 31111 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.065557 31233 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:25.053546 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.069538 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.071216 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.071784 30900 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.072005 31091 tablet_bootstrap.cc:654] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.072463 30973 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:25.063843 31111 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.074095 31014 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.074967 31225 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:25.077729 31225 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:25.077903 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.078668 31225 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.078668 30973 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:23:25.080003 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.080605 30976 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:25.082582 30900 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.075181 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:25.084235 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.084925 31097 raft_consensus.cc:2764] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:25.086779 31233 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:25.092041 30864 leader_election.cc:343] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.096213 31233 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.096184 31229 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:23:25.088390 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:25.101014 30939 leader_election.cc:343] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.105922 30865 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:25.106973 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.107479 31146 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:25.108026 31146 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.108337 31146 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.107590 30901 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.096885 31233 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.115165 30864 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.125975 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:25.127571 31226 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:25.128315 31013 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.111666 31153 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.139453 31093 tablet_bootstrap.cc:654] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.139703 31092 tablet_bootstrap.cc:654] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.153599 31091 tablet_bootstrap.cc:492] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.154086 31091 ts_tablet_manager.cc:1403] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.248s	user 0.015s	sys 0.010s
I20260709 12:23:25.161298 31193 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.171950 31193 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.173740 31225 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:25.151189 30939 leader_election.cc:343] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.176365 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.182749 31153 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:25.184041 31153 raft_consensus.cc:697] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:25.184834 31153 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:25.185700 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:25.187316 31150 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.187824 31146 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.192898 31227 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:25.195324 31111 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.207165 31111 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.216538 31093 tablet_bootstrap.cc:492] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.217080 31093 ts_tablet_manager.cc:1403] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.307s	user 0.020s	sys 0.023s
I20260709 12:23:25.212330 30901 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:25.221349 31230 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.223922 31091 raft_consensus.cc:359] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.224591 31091 raft_consensus.cc:385] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.224856 31091 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.225489 31091 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.249224 31091 ts_tablet_manager.cc:1434] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 12:23:25.250218 31091 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.254117 30799 catalog_manager.cc:5697] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.273355 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:25.280984 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.209844 31233 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.290184 31092 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.290767 31092 ts_tablet_manager.cc:1403] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.545s	user 0.031s	sys 0.062s
I20260709 12:23:25.292335 31091 tablet_bootstrap.cc:654] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.293352 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:25.295620 31092 raft_consensus.cc:359] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.297067 31092 raft_consensus.cc:385] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.297358 31092 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.289798 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:25.298720 31050 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.299194 31146 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.295481 30976 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:25.302353 30798 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.305106 31233 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:23:25.305785 30864 leader_election.cc:343] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.305984 31146 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:25.306562 30939 leader_election.cc:343] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.306455 31146 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.308430 31146 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.324579 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.324903 31092 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.327070 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:25.327839 31047 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.327888 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.333619 31092 ts_tablet_manager.cc:1434] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:23:25.336140 31093 raft_consensus.cc:359] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.333525 31050 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.336826 31093 raft_consensus.cc:385] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.337136 31093 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.337809 31093 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.339421 31093 ts_tablet_manager.cc:1434] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.122s	user 0.005s	sys 0.000s
I20260709 12:23:25.342314 31047 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.344090 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:23:25.344254 30939 leader_election.cc:343] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:25.345422 30939 leader_election.cc:343] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.346993 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:25.347699 31233 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:25.348749 30865 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.349182 31233 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:25.349526 31230 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.351061 31092 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:25.351933 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.352165 31093 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.352700 30901 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:25.350422 31233 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:25.334884 30864 leader_election.cc:343] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:25.360162 31244 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:23:25.368721 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:25.369835 31153 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:25.371371 31153 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:25.375747 31153 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:25.378329 31014 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.382745 31093 tablet_bootstrap.cc:654] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:25.369891 30939 leader_election.cc:343] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.393496 31091 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.393954 31091 ts_tablet_manager.cc:1403] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.003s
I20260709 12:23:25.397423 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.420318 31146 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:25.409258 30865 leader_election.cc:343] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.427680 31233 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.428007 30865 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.428162 31233 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.428748 31227 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.430044 31233 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.427045 31146 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.430866 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:25.431656 31233 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.433787 31091 raft_consensus.cc:359] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.434808 31091 raft_consensus.cc:385] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.435074 31091 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.435305 31146 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.435918 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.409194 30797 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.435833 31091 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.436682 31047 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:25.438198 31091 ts_tablet_manager.cc:1434] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:23:25.438449 31092 tablet_bootstrap.cc:654] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.439412 31091 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.441207 31093 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.441629 31093 ts_tablet_manager.cc:1403] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.090s	user 0.024s	sys 0.018s
I20260709 12:23:25.442485 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.444017 31093 raft_consensus.cc:359] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.444394 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.445595 31093 raft_consensus.cc:385] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.445889 31093 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.445966 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.446537 31093 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.448204 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:23:25.448879 30939 leader_election.cc:343] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.449399 31146 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:25.449791 30939 leader_election.cc:343] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.450220 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:25.453539 31093 ts_tablet_manager.cc:1434] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:23:25.455704 31093 tablet_bootstrap.cc:492] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.453863 31153 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.461133 30797 catalog_manager.cc:5697] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.465636 31146 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.474001 31091 tablet_bootstrap.cc:654] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.478433 31093 tablet_bootstrap.cc:654] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.475232 31092 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.480472 31092 ts_tablet_manager.cc:1403] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.015s
I20260709 12:23:25.483170 31092 raft_consensus.cc:359] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.483919 31092 raft_consensus.cc:385] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.484186 31092 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.486804 31092 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.493197 31225 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:25.497341 31092 ts_tablet_manager.cc:1434] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:23:25.497805 31093 tablet_bootstrap.cc:492] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.498260 31093 ts_tablet_manager.cc:1403] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.015s
I20260709 12:23:25.502912 31091 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.503361 31091 ts_tablet_manager.cc:1403] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.004s
I20260709 12:23:25.500929 31093 raft_consensus.cc:359] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.505386 31093 raft_consensus.cc:385] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.505671 31093 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.506394 31093 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.506842 31091 raft_consensus.cc:359] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.507463 31091 raft_consensus.cc:385] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.507750 31091 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.508369 31091 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.509675 31092 tablet_bootstrap.cc:492] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:25.511277 31093 ts_tablet_manager.cc:1434] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:23:25.512207 31093 tablet_bootstrap.cc:492] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.512760 31091 ts_tablet_manager.cc:1434] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:25.513723 31091 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.534053 31091 tablet_bootstrap.cc:654] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.517872 31093 tablet_bootstrap.cc:654] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.521191 31225 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:25.525899 31092 tablet_bootstrap.cc:654] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.572309 31091 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.572800 31091 ts_tablet_manager.cc:1403] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.008s
I20260709 12:23:25.576893 31093 tablet_bootstrap.cc:492] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.577355 31093 ts_tablet_manager.cc:1403] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.006s
I20260709 12:23:25.578585 31091 raft_consensus.cc:359] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.579417 31093 raft_consensus.cc:359] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.579811 31091 raft_consensus.cc:385] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.579975 31093 raft_consensus.cc:385] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.580116 31091 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.580278 31093 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.581218 31093 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.581248 31091 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.583097 31093 ts_tablet_manager.cc:1434] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:23:25.584015 31093 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.588135 31091 ts_tablet_manager.cc:1434] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:25.589074 31091 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.593662 31093 tablet_bootstrap.cc:654] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.594303 31091 tablet_bootstrap.cc:654] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.584053 31092 tablet_bootstrap.cc:492] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.596148 31092 ts_tablet_manager.cc:1403] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.012s
I20260709 12:23:25.598578 31092 raft_consensus.cc:359] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.599215 31092 raft_consensus.cc:385] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.599445 31092 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.600036 31092 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.601958 31092 ts_tablet_manager.cc:1434] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:25.602921 31092 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:25.608369 31092 tablet_bootstrap.cc:654] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.612061 31093 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.612495 31093 ts_tablet_manager.cc:1403] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 12:23:25.615803 31093 raft_consensus.cc:359] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.618254 31093 raft_consensus.cc:385] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.618510 31093 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.619097 31093 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.620798 31093 ts_tablet_manager.cc:1434] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:25.621634 31093 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.629323 31093 tablet_bootstrap.cc:654] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.633213 31091 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.633683 31091 ts_tablet_manager.cc:1403] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.006s
I20260709 12:23:25.636245 31091 raft_consensus.cc:359] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.636880 31091 raft_consensus.cc:385] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.637130 31091 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.638190 31091 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.640817 31092 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.641274 31092 ts_tablet_manager.cc:1403] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:23:25.641837 31093 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.642203 31093 ts_tablet_manager.cc:1403] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:23:25.643781 31092 raft_consensus.cc:359] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.644052 31093 raft_consensus.cc:359] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.644737 31091 ts_tablet_manager.cc:1434] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:23:25.647631 31092 raft_consensus.cc:385] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.648046 31092 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.649024 31091 tablet_bootstrap.cc:492] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.648756 31092 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.651010 31092 ts_tablet_manager.cc:1434] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:25.651634 31093 raft_consensus.cc:385] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.652005 31093 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.652793 31093 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.660135 31092 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:25.658800 31091 tablet_bootstrap.cc:654] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.666921 31093 ts_tablet_manager.cc:1434] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:23:25.667845 31093 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.673149 31093 tablet_bootstrap.cc:654] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.674789 31092 tablet_bootstrap.cc:654] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.679687 31091 tablet_bootstrap.cc:492] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.680137 31091 ts_tablet_manager.cc:1403] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.006s
I20260709 12:23:25.680796 31092 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.681238 31092 ts_tablet_manager.cc:1403] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 12:23:25.682186 31091 raft_consensus.cc:359] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.682677 31091 raft_consensus.cc:385] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.682884 31091 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.683466 31091 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.683795 31092 raft_consensus.cc:359] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.684454 31092 raft_consensus.cc:385] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.684698 31092 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.685334 31091 ts_tablet_manager.cc:1434] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:23:25.685467 31092 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.687328 31093 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.687764 31093 ts_tablet_manager.cc:1403] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:23:25.690122 31093 raft_consensus.cc:359] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.690742 31093 raft_consensus.cc:385] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.690999 31093 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.691341 31092 ts_tablet_manager.cc:1434] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:25.691608 31093 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.692384 31092 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:25.693564 31093 ts_tablet_manager.cc:1434] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:25.694428 31093 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.696492 31091 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.704932 31093 tablet_bootstrap.cc:654] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.709076 31091 tablet_bootstrap.cc:654] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.711006 31153 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.711329 31092 tablet_bootstrap.cc:654] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.711480 31153 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.713557 31153 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.715497 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.716192 31047 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:25.717650 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.718449 31233 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.718912 31233 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.720963 31233 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.721441 31233 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:25.721747 31233 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.722038 31233 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.722397 31092 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.722826 31092 ts_tablet_manager.cc:1403] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.004s
I20260709 12:23:25.724632 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.725289 31092 raft_consensus.cc:359] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.725920 31092 raft_consensus.cc:385] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.726171 31092 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
W20260709 12:23:25.726894 30939 leader_election.cc:343] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.726971 31092 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.728583 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.729200 31047 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:25.730906 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.731491 30900 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:25.740872 30939 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.742084 31193 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:25.742453 31193 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.742761 31193 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.744144 31092 ts_tablet_manager.cc:1434] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:23:25.753906 31092 tablet_bootstrap.cc:492] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:25.759577 31092 tablet_bootstrap.cc:654] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.765522 31097 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:25.761330 31193 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.772182 31092 tablet_bootstrap.cc:492] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.774121 31092 ts_tablet_manager.cc:1403] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 12:23:25.766666 31233 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.777097 31092 raft_consensus.cc:359] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.802994 31092 raft_consensus.cc:385] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.803309 31092 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.803998 31092 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.806756 31233 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.780573 31097 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.819615 31097 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.821609 31097 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.784343 31227 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.822266 31227 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.824370 31227 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.782822 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.790206 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:25.825160 31047 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.790874 31111 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.795217 31050 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.827988 31111 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.829972 31111 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.809056 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.809502 31189 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.831385 31189 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.833963 31189 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:25.834825 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.834957 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.835754 30974 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:25.837319 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.838086 30899 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:25.839246 31013 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.839911 30900 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:25.840842 30864 leader_election.cc:343] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.842588 31150 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.846925 30900 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.852018 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:25.852224 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.852648 31051 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:25.778612 31193 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.816039 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:25.853516 31049 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.853787 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:25.855376 30939 leader_election.cc:343] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.857197 30939 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.813020 31092 ts_tablet_manager.cc:1434] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.002s
I20260709 12:23:25.859179 31092 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:25.817107 31153 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:25.860122 31093 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.849223 30974 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.860553 31093 ts_tablet_manager.cc:1403] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.166s	user 0.041s	sys 0.037s
I20260709 12:23:25.850080 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.858127 31091 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.848455 31047 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.864118 31091 ts_tablet_manager.cc:1403] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.168s	user 0.025s	sys 0.054s
I20260709 12:23:25.864034 30899 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:25.866370 31092 tablet_bootstrap.cc:654] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.866744 31153 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:25.866600 31091 raft_consensus.cc:359] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.867249 31091 raft_consensus.cc:385] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.867637 31091 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.867257 31153 raft_consensus.cc:697] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:25.867961 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.868417 31091 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.868630 31153 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.869246 30976 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:25.863307 31093 raft_consensus.cc:359] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.869952 31093 raft_consensus.cc:385] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.870210 31093 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.871384 31091 ts_tablet_manager.cc:1434] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:25.872277 31091 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.872128 30939 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.873911 31193 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:25.873751 31093 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.874308 31193 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.874724 31189 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.875191 31189 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.876156 31093 ts_tablet_manager.cc:1434] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:25.876804 30939 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:25.892278 31225 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.892796 31225 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.894794 31225 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:25.895658 30865 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:25.896790 31227 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:25.897148 31227 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.897467 31227 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.898187 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.877112 31093 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.898818 30973 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:25.879313 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.901006 31014 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.903059 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.903687 30899 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:25.904374 31093 tablet_bootstrap.cc:654] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.904704 31227 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.905530 31225 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:25.905898 31225 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:25.906217 31225 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.908553 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:23:25.909979 30864 leader_election.cc:343] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.910153 31227 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.909979 31091 tablet_bootstrap.cc:654] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.915678 31093 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:25.916872 31093 ts_tablet_manager.cc:1403] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:23:25.922905 31091 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:25.923398 31091 ts_tablet_manager.cc:1403] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.002s
I20260709 12:23:25.874755 31193 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.925032 31150 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.879796 31189 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:25.884459 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:25.928610 31013 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.929860 31189 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:25.930902 31193 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.932161 31049 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.933694 31227 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.934337 31193 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.934186 31227 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.935408 30900 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.935951 31091 raft_consensus.cc:359] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.936594 31091 raft_consensus.cc:385] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.936873 31091 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.937574 31227 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:25.937485 31091 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.937692 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:25.939306 30864 leader_election.cc:343] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.939522 31091 ts_tablet_manager.cc:1434] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:23:25.940524 31091 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:25.919368 31093 raft_consensus.cc:359] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.942858 31093 raft_consensus.cc:385] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.943222 31093 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:25.944525 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:25.945155 30976 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.945081 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:25.946115 31091 tablet_bootstrap.cc:654] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:25.947247 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:25.947824 30899 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.950348 31225 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.956387 30899 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.958817 31111 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.960650 31093 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.962946 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:23:25.963305 30865 leader_election.cc:343] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:25.963595 31050 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:25.963771 30865 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:25.964951 31146 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:25.967880 31092 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:25.968886 31092 ts_tablet_manager.cc:1403] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.006s
I20260709 12:23:25.973246 31233 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:25.975835 31093 ts_tablet_manager.cc:1434] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.002s
I20260709 12:23:25.962998 30976 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:25.976481 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:25.976734 31227 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.972231 31092 raft_consensus.cc:359] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.984891 31227 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.977977 31050 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:25.984879 31093 tablet_bootstrap.cc:492] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:25.989786 31274 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:25.990393 31274 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:25.990443 31092 raft_consensus.cc:385] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:25.992372 31153 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:25.991624 31274 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:25.991626 31092 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.005059 31093 tablet_bootstrap.cc:654] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.007450 31153 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.008003 31153 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.010133 31153 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.017925 30865 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:26.018844 31230 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.019284 31230 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:26.020107 31230 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.022032 31093 tablet_bootstrap.cc:492] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:26.023947 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.025424 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.026409 31093 ts_tablet_manager.cc:1403] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.002s
I20260709 12:23:26.027458 30939 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:25.998257 31092 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.029934 31092 ts_tablet_manager.cc:1434] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 12:23:26.030872 31092 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:26.033433 31193 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.033944 31193 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:26.035060 31093 raft_consensus.cc:359] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.041824 31093 raft_consensus.cc:385] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.042462 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:26.042641 31093 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.041109 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:26.043408 31225 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:26.043741 30900 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:26.038681 31280 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:23:26.043092 30976 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.050808 30900 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:26.052075 31013 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:26.035017 31193 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.053834 31189 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.054298 31189 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:26.055091 31189 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.056272 31093 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.059489 31153 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:26.061528 31093 ts_tablet_manager.cc:1434] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:23:26.058813 31097 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:26.058176 30976 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:26.070385 31093 tablet_bootstrap.cc:492] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
W20260709 12:23:26.082142 31283 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:23:26.085124 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:26.085512 30939 leader_election.cc:343] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:26.086539 30939 leader_election.cc:343] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.086900 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:26.087340 31227 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.089855 31092 tablet_bootstrap.cc:654] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.089504 30799 catalog_manager.cc:5697] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.092358 31093 tablet_bootstrap.cc:654] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.088153 31111 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.099946 31227 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.107051 31091 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:26.107591 31091 ts_tablet_manager.cc:1403] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.167s	user 0.058s	sys 0.051s
I20260709 12:23:26.103142 31227 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.125887 31189 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.144243 31230 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.148241 31230 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.150425 31230 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.153092 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:26.154479 30865 leader_election.cc:343] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.164783 31091 raft_consensus.cc:359] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.165534 31091 raft_consensus.cc:385] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.165791 31091 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.172312 31225 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.172783 31225 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.173408 31092 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:26.173866 31092 ts_tablet_manager.cc:1403] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.015s
I20260709 12:23:26.134552 31189 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.167374 31091 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.173763 31227 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.180186 31225 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:26.181854 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.181866 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.253892 30976 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:26.255059 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.258610 31092 raft_consensus.cc:359] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.259387 31092 raft_consensus.cc:385] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.261593 31189 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:26.263944 31093 tablet_bootstrap.cc:492] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:26.264393 31093 ts_tablet_manager.cc:1403] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.194s	user 0.022s	sys 0.006s
I20260709 12:23:26.266271 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.266580 31146 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.267012 30897 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:26.267007 31146 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.269587 31146 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.259654 31092 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.271955 31092 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:26.272344 31014 leader_election.cc:343] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.273861 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.274036 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.274587 31048 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:26.276659 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.277107 31092 ts_tablet_manager.cc:1434] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.006s
W20260709 12:23:26.277540 31014 leader_election.cc:343] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.278012 31092 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:26.280751 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.281615 31050 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:26.282841 30864 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.283746 31093 raft_consensus.cc:359] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.284287 31146 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:26.284396 31093 raft_consensus.cc:385] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.266355 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.284969 31093 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.285825 31093 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.286495 31092 tablet_bootstrap.cc:654] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.284931 31146 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.287348 31146 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.287600 31093 ts_tablet_manager.cc:1434] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:23:26.289086 31093 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:26.295691 31093 tablet_bootstrap.cc:654] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.296298 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.297827 31189 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:26.298341 31189 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.270694 30795 catalog_manager.cc:5697] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.298723 31189 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:26.300590 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 45700.9us
I20260709 12:23:26.301450 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.302644 30865 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:26.302799 31097 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.304759 31092 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:26.305279 31092 ts_tablet_manager.cc:1403] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 12:23:26.303247 31097 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.310513 31091 ts_tablet_manager.cc:1434] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.203s	user 0.009s	sys 0.013s
I20260709 12:23:26.311275 31091 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:26.315011 31097 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.319820 31146 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:26.313918 30864 leader_election.cc:343] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.323520 30900 raft_consensus.cc:2393] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:26.324446 31297 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:26.328055 31297 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.328342 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.329411 31091 tablet_bootstrap.cc:654] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.329769 31150 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.328428 31297 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.339346 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.331890 31146 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.352210 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:26.348670 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:26.353554 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.359195 31093 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:26.359581 31093 ts_tablet_manager.cc:1403] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.014s
I20260709 12:23:26.350529 31295 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:26.364820 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.362382 31227 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:26.369607 30939 leader_election.cc:343] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.372991 31233 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:26.380543 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.383636 31092 raft_consensus.cc:359] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.384194 31092 raft_consensus.cc:385] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.384400 31092 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.387188 30796 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.358239 31189 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.385239 31092 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.400296 31093 raft_consensus.cc:359] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.401010 31093 raft_consensus.cc:385] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.401257 31093 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.401867 31093 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:26.384811 30865 leader_election.cc:343] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.405853 31092 ts_tablet_manager.cc:1434] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.001s
I20260709 12:23:26.406328 31093 ts_tablet_manager.cc:1434] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:23:26.407039 31093 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:26.414481 31092 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:26.397588 31302 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:23:26.417344 31297 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.419440 30899 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:26.422809 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:26.423413 31051 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.428088 30939 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:26.426548 31297 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.430373 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:26.432725 30974 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.433176 31189 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:26.439359 31091 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:26.439827 31091 ts_tablet_manager.cc:1403] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.007s
I20260709 12:23:26.444569 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:26.450137 31227 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.450882 31051 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:26.447397 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:26.451478 31093 tablet_bootstrap.cc:654] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.451839 30898 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.452292 30864 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:26.454525 31297 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.455406 31193 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:26.458137 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:26.459538 31297 raft_consensus.cc:697] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:26.460410 31297 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.464522 31150 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.458971 30898 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:26.468680 31092 tablet_bootstrap.cc:654] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.469868 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:26.470620 31150 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.471055 31150 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:26.472970 31150 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.473577 31091 raft_consensus.cc:359] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:26.474211 31014 leader_election.cc:343] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.474514 31091 raft_consensus.cc:385] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.474903 31091 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.475248 31189 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.475669 31189 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.475601 31091 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.474519 30974 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:26.477788 31189 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:26.478410 31111 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.479171 31046 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:26.480057 31227 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.480516 31227 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.482535 31227 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.483187 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.483523 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.480765 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.483839 30976 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
W20260709 12:23:26.484759 31013 leader_election.cc:343] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.484783 30864 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.487432 31091 ts_tablet_manager.cc:1434] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:23:26.489976 31091 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:26.483753 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.500912 30865 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:23:26.502367 30864 leader_election.cc:343] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.502242 31233 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:26.503475 31227 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:26.503877 31227 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.504211 31227 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.506250 31295 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:26.506418 31014 leader_election.cc:343] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.506778 31295 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:26.507613 31295 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.507552 31014 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.510474 31189 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.522486 30796 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:23:26.523952 30796 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.531122 31150 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:26.536127 31091 tablet_bootstrap.cc:654] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.538430 31093 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:26.539031 31093 ts_tablet_manager.cc:1403] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.008s
I20260709 12:23:26.552017 31093 raft_consensus.cc:359] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.552397 31297 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:26.552774 31093 raft_consensus.cc:385] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.554442 31093 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.555246 31093 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.557664 31093 ts_tablet_manager.cc:1434] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:23:26.558548 31093 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:26.561534 31150 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:23:26.579137 31150 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.579627 31150 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.583561 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.585019 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.587491 31014 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.572904 31227 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.590134 31092 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:26.593554 31092 ts_tablet_manager.cc:1403] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.007s
I20260709 12:23:26.587706 30795 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.596077 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:26.596387 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:26.596814 30976 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:26.598032 30864 leader_election.cc:343] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.599256 31227 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.596312 31092 raft_consensus.cc:359] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.602403 31092 raft_consensus.cc:385] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.602703 31092 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.588491 31189 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.608349 31233 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:26.588111 31150 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:26.619180 31092 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.655431 31093 tablet_bootstrap.cc:654] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.661103 31091 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:26.661594 31091 ts_tablet_manager.cc:1403] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.010s
I20260709 12:23:26.672621 31111 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:26.673961 31051 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.670673 30799 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.677310 31092 ts_tablet_manager.cc:1434] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.006s
I20260709 12:23:26.677794 31227 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.678231 31227 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.679335 30976 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:26.681855 31227 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.682157 30865 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:26.681207 31091 raft_consensus.cc:359] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.683110 31091 raft_consensus.cc:385] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.683346 31091 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.683562 31297 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.684317 31297 raft_consensus.cc:697] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:26.684020 31091 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.685696 31092 tablet_bootstrap.cc:492] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:26.685487 31297 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.693881 31091 ts_tablet_manager.cc:1434] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:23:26.703377 31091 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:26.702546 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:26.712415 30976 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:26.712057 31230 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:26.711313 31233 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.713176 31233 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.714807 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.715070 31233 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.716157 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.725507 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:26.716248 30864 leader_election.cc:343] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.716958 30900 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:23:26.734233 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:26.735643 31230 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:26.735898 31093 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:26.736029 31230 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.736338 31093 ts_tablet_manager.cc:1403] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.178s	user 0.019s	sys 0.003s
I20260709 12:23:26.736471 31230 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.741302 30939 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:26.747026 31111 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.750802 31092 tablet_bootstrap.cc:654] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.754901 31111 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.758599 31093 raft_consensus.cc:359] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.759348 31093 raft_consensus.cc:385] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.759662 31093 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.760985 31093 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.766392 31093 ts_tablet_manager.cc:1434] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:23:26.767369 31093 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:26.768738 31230 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.770856 31091 tablet_bootstrap.cc:654] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.771555 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:26.772239 30976 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.775880 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:23:26.777237 30864 leader_election.cc:343] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.777575 31230 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.781723 30796 catalog_manager.cc:5697] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.784755 30796 catalog_manager.cc:5697] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.787768 31092 tablet_bootstrap.cc:492] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:26.788317 31092 ts_tablet_manager.cc:1403] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.103s	user 0.005s	sys 0.007s
I20260709 12:23:26.792474 31111 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.793015 31111 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.791389 31092 raft_consensus.cc:359] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.794709 31092 raft_consensus.cc:385] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.795008 31092 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.795704 31092 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.798338 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.798996 30898 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:26.799038 31111 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.799796 30976 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:26.801033 30939 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:26.802228 31092 ts_tablet_manager.cc:1434] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:26.802304 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.803570 31092 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:26.802928 31050 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:26.802863 31111 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:26.804128 31111 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.804442 31111 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.811120 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:26.812908 31297 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.813398 31297 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:26.814177 31297 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.814875 31295 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.815311 31295 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.818413 31295 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.819923 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:26.821239 30864 leader_election.cc:343] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.823029 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:26.824406 30865 leader_election.cc:343] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:26.824838 30865 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:26.827278 31295 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:26.827814 31111 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.830329 31093 tablet_bootstrap.cc:654] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.833956 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:26.834635 30898 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.836246 31091 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:26.836699 31091 ts_tablet_manager.cc:1403] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.134s	user 0.024s	sys 0.000s
I20260709 12:23:26.837296 31111 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.838790 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:26.839383 31048 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.839766 31092 tablet_bootstrap.cc:654] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.846556 30898 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:26.850400 31048 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:26.855115 30939 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:26.855841 31111 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.856271 31111 raft_consensus.cc:697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:26.856971 31111 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.858309 31091 raft_consensus.cc:359] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.858960 31091 raft_consensus.cc:385] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.859259 31091 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.859968 31091 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.860713 31189 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:26.861913 31091 ts_tablet_manager.cc:1434] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:23:26.856971 30796 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.862852 31091 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:26.868777 31091 tablet_bootstrap.cc:654] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.882989 31092 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:26.883599 31092 ts_tablet_manager.cc:1403] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.000s
I20260709 12:23:26.883489 30799 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.895972 31092 raft_consensus.cc:359] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.896678 31092 raft_consensus.cc:385] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.896935 31092 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.897396 31091 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:26.897853 31091 ts_tablet_manager.cc:1403] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.012s
I20260709 12:23:26.897567 31092 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.899636 31092 ts_tablet_manager.cc:1434] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 12:23:26.900347 31091 raft_consensus.cc:359] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.900996 31091 raft_consensus.cc:385] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.901268 31091 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.901916 31091 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.902267 31225 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:26.904163 31091 ts_tablet_manager.cc:1434] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:23:26.905031 31091 tablet_bootstrap.cc:492] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:26.910562 31091 tablet_bootstrap.cc:654] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.918798 31092 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:26.927917 31093 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:26.928396 31093 ts_tablet_manager.cc:1403] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.161s	user 0.018s	sys 0.010s
I20260709 12:23:26.930040 31092 tablet_bootstrap.cc:654] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.935107 31093 raft_consensus.cc:359] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.936574 31093 raft_consensus.cc:385] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.936906 31093 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.937646 31093 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.939188 31093 ts_tablet_manager.cc:1434] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 12:23:26.939944 31093 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:26.945158 31297 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:26.952880 31097 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.953362 31097 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:26.955238 31097 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:26.956261 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:26.958940 31048 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:26.960124 30939 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:26.961344 31302 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:26.957170 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:26.962198 30898 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:26.961740 31302 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.963056 31302 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.999490 31093 tablet_bootstrap.cc:654] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.002380 31091 tablet_bootstrap.cc:492] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:27.003754 31091 ts_tablet_manager.cc:1403] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.041s
I20260709 12:23:27.004585 31092 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.005039 31092 ts_tablet_manager.cc:1403] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 12:23:27.002744 31302 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.006313 31091 raft_consensus.cc:359] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.006974 31091 raft_consensus.cc:385] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.007254 31091 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.007414 31092 raft_consensus.cc:359] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.008121 31092 raft_consensus.cc:385] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.007896 31091 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.008388 31092 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.009897 31091 ts_tablet_manager.cc:1434] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:27.006680 31302 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.011665 31092 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.012013 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:27.012502 31091 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:27.012576 30900 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.018975 30900 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:27.021377 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:27.021973 31048 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.022063 31092 ts_tablet_manager.cc:1434] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:23:27.028759 31048 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:27.031181 31091 tablet_bootstrap.cc:654] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.035523 31092 tablet_bootstrap.cc:492] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.041880 31225 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.042358 31225 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.044348 31225 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:27.045830 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.046607 30976 raft_consensus.cc:2393] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:27.041643 31146 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.052778 31302 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.053380 31302 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.055467 31302 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.057356 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.057981 30897 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:27.058660 30939 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:27.059365 31302 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:27.059844 31302 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:27.059933 30973 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.060683 31302 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.063318 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.063977 31046 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:27.066509 31093 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.067023 31093 ts_tablet_manager.cc:1403] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.018s
I20260709 12:23:27.072954 31092 tablet_bootstrap.cc:654] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.067189 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:27.069156 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.078874 31092 tablet_bootstrap.cc:492] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.080744 31092 ts_tablet_manager.cc:1403] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.001s
I20260709 12:23:27.082553 31013 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.083353 31092 raft_consensus.cc:359] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.084045 31092 raft_consensus.cc:385] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.084306 31092 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.084926 31092 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.085899 31304 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.086810 31092 ts_tablet_manager.cc:1434] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:27.072597 31093 raft_consensus.cc:359] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.078876 31091 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:27.087690 31092 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.098938 31146 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.094954 31304 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.095288 31091 ts_tablet_manager.cc:1403] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.083s	user 0.032s	sys 0.003s
I20260709 12:23:27.103749 31091 raft_consensus.cc:359] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.104403 31091 raft_consensus.cc:385] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.104656 31091 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.087881 31093 raft_consensus.cc:385] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.096093 31153 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:27.105671 31093 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.105739 31153 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.106135 31153 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.106370 31093 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.108397 31093 ts_tablet_manager.cc:1434] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:23:27.109678 31093 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.110080 30799 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.112740 31091 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.114117 31297 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.114812 31091 ts_tablet_manager.cc:1434] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:23:27.115679 31091 tablet_bootstrap.cc:492] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:27.116782 31297 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.117219 31297 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.117800 31153 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.119668 31153 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.120786 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:27.121380 31048 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.125243 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:27.125876 30900 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.128407 31092 tablet_bootstrap.cc:654] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.129141 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:27.134374 30865 leader_election.cc:343] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.138712 31091 tablet_bootstrap.cc:654] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.139043 31297 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.141587 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:27.143018 30864 leader_election.cc:343] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.143447 30864 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.145567 31297 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.146275 30900 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:23:27.148030 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:27.148746 31153 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:27.149191 31153 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:27.149993 31304 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.149947 31153 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.150522 31304 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.152994 31093 tablet_bootstrap.cc:654] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.154790 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.154889 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.155705 30976 raft_consensus.cc:2393] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:27.153941 31304 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:27.156847 31014 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.149981 31048 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:23:27.159749 31297 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.160236 31297 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.160588 31304 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.166592 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.167331 30976 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:27.167651 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.166240 31297 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.168644 30865 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:23:27.170030 30864 leader_election.cc:343] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.170171 31092 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.170769 31092 ts_tablet_manager.cc:1403] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.083s	user 0.004s	sys 0.012s
I20260709 12:23:27.179808 31297 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.180290 31297 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.180629 31297 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.187351 31302 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.187917 31302 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.190248 31302 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.190694 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.191610 30900 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:27.191761 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.192364 31050 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:27.193471 30939 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:27.196399 31146 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.197429 31092 raft_consensus.cc:359] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.198216 31092 raft_consensus.cc:385] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.198515 31092 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.199112 31302 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.200752 31092 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.202234 31302 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.209570 30799 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 2, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.208741 31304 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.216094 31092 ts_tablet_manager.cc:1434] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 12:23:27.212139 31302 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.218019 31092 tablet_bootstrap.cc:492] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.223552 31091 tablet_bootstrap.cc:492] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:27.224169 31091 ts_tablet_manager.cc:1403] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.007s
I20260709 12:23:27.220455 31297 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.231205 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:27.231819 30973 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.233217 31091 raft_consensus.cc:359] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.233883 31091 raft_consensus.cc:385] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.234156 31091 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.233992 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:27.235759 31091 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:27.236243 30864 leader_election.cc:343] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.237709 31091 ts_tablet_manager.cc:1434] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:27.238512 31091 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:27.242228 30973 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:27.245232 30865 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:27.246481 31230 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:27.246940 31230 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:27.247756 31230 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.251353 31093 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.251912 31093 ts_tablet_manager.cc:1403] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.142s	user 0.009s	sys 0.009s
I20260709 12:23:27.231241 31297 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.254431 31093 raft_consensus.cc:359] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.255414 31093 raft_consensus.cc:385] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.255694 31093 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.256927 31093 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.260797 31093 ts_tablet_manager.cc:1434] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 12:23:27.261933 31093 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.270530 31302 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.273224 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:27.273873 30900 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.271148 31091 tablet_bootstrap.cc:654] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.274051 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:27.275069 31048 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.276222 31093 tablet_bootstrap.cc:654] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.273957 31092 tablet_bootstrap.cc:654] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.284286 31295 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.290709 31295 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.287890 31048 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:27.291215 31295 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.293311 31295 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.296026 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.302434 30900 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:27.297852 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.293854 31302 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.298681 30939 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:27.308166 31304 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.308728 31304 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:27.310257 30865 leader_election.cc:343] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.310724 31304 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:27.310778 31302 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:27.312542 31302 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:27.312814 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.313469 31302 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:27.314015 31013 leader_election.cc:343] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.313869 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.315744 30973 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:27.315701 30795 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.319260 31014 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:27.319927 31304 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.320281 31304 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.317548 31048 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:27.320673 31304 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.321467 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.322525 31297 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.322860 31297 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.323158 31297 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.327216 31304 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.330710 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:23:27.331959 31013 leader_election.cc:343] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.334105 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:27.334654 30973 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.337546 31297 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.340236 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:27.339799 30797 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:27.341624 30865 leader_election.cc:343] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.342151 31304 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:27.344707 31297 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.345698 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:27.346303 31050 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.352155 31050 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:27.353313 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.343616 30973 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:27.356787 31014 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:27.356959 31230 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:27.357496 31230 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:27.358304 31230 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.364183 31304 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:27.365356 31304 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:27.366273 31304 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.368584 31092 tablet_bootstrap.cc:492] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.372053 31092 ts_tablet_manager.cc:1403] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.154s	user 0.009s	sys 0.006s
I20260709 12:23:27.369905 31091 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:27.374060 31091 ts_tablet_manager.cc:1403] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.136s	user 0.009s	sys 0.005s
I20260709 12:23:27.376291 31093 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.376837 31093 ts_tablet_manager.cc:1403] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.000s
I20260709 12:23:27.377866 31092 raft_consensus.cc:359] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.378527 31092 raft_consensus.cc:385] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.377722 30795 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.378791 31092 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.379236 31093 raft_consensus.cc:359] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.379446 31092 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.379974 31093 raft_consensus.cc:385] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.380270 31093 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.376758 31091 raft_consensus.cc:359] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.380887 31093 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.382665 31092 ts_tablet_manager.cc:1434] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:23:27.383054 31093 ts_tablet_manager.cc:1434] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:27.381428 31091 raft_consensus.cc:385] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.383965 31093 tablet_bootstrap.cc:492] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.383934 31091 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.384682 31091 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.385406 31297 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.387324 31091 ts_tablet_manager.cc:1434] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:23:27.388253 31091 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:27.383667 31092 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.390261 30796 catalog_manager.cc:5697] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.399093 31091 tablet_bootstrap.cc:654] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.402091 31097 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.402529 31093 tablet_bootstrap.cc:654] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.403775 31092 tablet_bootstrap.cc:654] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.416798 31150 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.429445 31150 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.433746 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.434751 31302 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:27.435105 31013 leader_election.cc:343] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.435218 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:27.436717 31014 leader_election.cc:343] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.437144 31014 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.440204 31225 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.439338 31150 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:27.464979 31091 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:27.465579 31091 ts_tablet_manager.cc:1403] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.008s
I20260709 12:23:27.478015 31091 raft_consensus.cc:359] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.479367 31091 raft_consensus.cc:385] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.479749 31091 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.480440 31091 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.452067 31297 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:23:27.490075 31092 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.490958 31092 ts_tablet_manager.cc:1403] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.009s
I20260709 12:23:27.491827 31091 ts_tablet_manager.cc:1434] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 12:23:27.492753 31091 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:27.492915 31093 tablet_bootstrap.cc:492] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.493366 31093 ts_tablet_manager.cc:1403] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.007s
I20260709 12:23:27.494319 31092 raft_consensus.cc:359] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.495765 31092 raft_consensus.cc:385] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.496214 31092 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.496904 31092 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.499238 31092 ts_tablet_manager.cc:1434] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:27.500180 31092 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.500782 31091 tablet_bootstrap.cc:654] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.518112 31093 raft_consensus.cc:359] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.519098 31093 raft_consensus.cc:385] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.519554 31093 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.520282 31093 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.523895 31093 ts_tablet_manager.cc:1434] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 12:23:27.526250 31230 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.526757 31230 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.529806 31230 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.530092 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.530591 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:27.538813 30864 leader_election.cc:343] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:27.539714 30865 leader_election.cc:343] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.546540 31093 tablet_bootstrap.cc:492] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.556875 30865 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.557411 31091 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:27.557874 31091 ts_tablet_manager.cc:1403] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.010s
I20260709 12:23:27.559120 31146 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.561020 31091 raft_consensus.cc:359] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.561725 31091 raft_consensus.cc:385] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.561978 31091 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.562867 31091 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.569977 31093 tablet_bootstrap.cc:654] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.571395 31092 tablet_bootstrap.cc:654] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.586619 31093 tablet_bootstrap.cc:492] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.587813 31093 ts_tablet_manager.cc:1403] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.007s
I20260709 12:23:27.589633 31091 ts_tablet_manager.cc:1434] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:23:27.590611 31091 tablet_bootstrap.cc:492] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:27.591876 31092 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.592401 31092 ts_tablet_manager.cc:1403] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.000s
I20260709 12:23:27.595012 31093 raft_consensus.cc:359] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.600466 31093 raft_consensus.cc:385] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.600874 31093 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.596630 31092 raft_consensus.cc:359] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.602366 31092 raft_consensus.cc:385] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.603829 31092 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.604779 31050 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:27.603042 31093 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.607391 31302 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.604631 31092 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.612576 31093 ts_tablet_manager.cc:1434] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:23:27.614568 31093 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.613467 31092 ts_tablet_manager.cc:1434] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:23:27.616725 31092 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.617493 31091 tablet_bootstrap.cc:654] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.622445 31093 tablet_bootstrap.cc:654] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.636571 31092 tablet_bootstrap.cc:654] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.638784 31302 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.639267 31302 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.641237 31302 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:23:27.642608 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:27.643414 30900 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:27.643810 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.644842 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.645939 31302 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.648891 31093 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.649333 31093 ts_tablet_manager.cc:1403] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.007s
W20260709 12:23:27.651526 30939 leader_election.cc:343] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:27.652180 30939 leader_election.cc:343] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.652529 30939 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:27.652851 31093 raft_consensus.cc:359] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.653484 31093 raft_consensus.cc:385] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.653733 31093 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.653820 31097 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.654340 31093 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.656637 31093 ts_tablet_manager.cc:1434] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:23:27.657590 31093 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.663383 31093 tablet_bootstrap.cc:654] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.671090 31093 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.671505 31093 ts_tablet_manager.cc:1403] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:23:27.673784 31093 raft_consensus.cc:359] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.678730 31093 raft_consensus.cc:385] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.679016 31093 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.679638 31093 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.682199 31093 ts_tablet_manager.cc:1434] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:27.683022 31093 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.688544 31093 tablet_bootstrap.cc:654] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.699805 31302 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.700099 31097 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:27.700363 31302 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.703469 31302 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.708451 31111 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:27.715585 31091 tablet_bootstrap.cc:492] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:27.716132 31091 ts_tablet_manager.cc:1403] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.007s
I20260709 12:23:27.720153 31093 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.720626 31093 ts_tablet_manager.cc:1403] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 12:23:27.723032 31093 raft_consensus.cc:359] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.723697 31093 raft_consensus.cc:385] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.723979 31093 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.724550 31093 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.726619 31093 ts_tablet_manager.cc:1434] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:23:27.729480 31093 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.731546 31146 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.731820 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.732089 31146 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.734087 31146 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.735177 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.735894 31050 raft_consensus.cc:2393] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:27.740295 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.750664 30939 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:27.751400 31097 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.753845 31093 tablet_bootstrap.cc:654] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.758435 31097 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.760761 31091 raft_consensus.cc:359] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.761428 31091 raft_consensus.cc:385] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.761708 31091 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.762291 31091 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.768822 31092 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.769289 31092 ts_tablet_manager.cc:1403] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.153s	user 0.037s	sys 0.062s
I20260709 12:23:27.772193 31092 raft_consensus.cc:359] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.772836 31092 raft_consensus.cc:385] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.773084 31092 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.774075 31092 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.776145 31092 ts_tablet_manager.cc:1434] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:27.777359 31092 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.783113 31092 tablet_bootstrap.cc:654] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.785220 31093 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.785650 31093 ts_tablet_manager.cc:1403] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.004s
I20260709 12:23:27.788098 31093 raft_consensus.cc:359] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.788714 31093 raft_consensus.cc:385] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.788954 31093 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.789528 31093 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.791253 31093 ts_tablet_manager.cc:1434] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:23:27.793713 31093 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.798168 31092 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.798687 31092 ts_tablet_manager.cc:1403] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.005s
I20260709 12:23:27.799202 31093 tablet_bootstrap.cc:654] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.801273 31092 raft_consensus.cc:359] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.801950 31092 raft_consensus.cc:385] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.802213 31092 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.803007 31092 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.803308 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.804199 30976 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:23:27.805127 31092 ts_tablet_manager.cc:1434] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:27.805986 31092 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.809845 31146 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.810362 31146 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.812376 31146 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.815266 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:27.816668 30864 leader_election.cc:343] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.818634 31146 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.819216 31146 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.821435 31091 ts_tablet_manager.cc:1434] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.000s
I20260709 12:23:27.821930 31146 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.822464 31091 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:27.823041 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.823678 31048 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:27.824868 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:27.825702 31146 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.826058 31146 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.826370 31146 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.826673 31111 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.827111 31111 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.828805 31111 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.826473 31092 tablet_bootstrap.cc:654] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.833110 31146 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.835512 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.836175 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:27.836745 31048 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.837705 31297 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.840317 31230 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.841410 31092 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.841853 31092 ts_tablet_manager.cc:1403] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.007s
I20260709 12:23:27.843272 31048 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:27.844419 31092 raft_consensus.cc:359] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.844732 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:27.845098 31092 raft_consensus.cc:385] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.845423 31092 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.846091 31092 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.846450 31295 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:27.846980 31295 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:27.847258 31297 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.848161 31092 ts_tablet_manager.cc:1434] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:27.848100 31295 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.848677 31150 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.849191 31092 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.849109 31150 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.851118 31150 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:23:27.852267 30864 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:27.852356 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.852566 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:23:27.853710 31014 leader_election.cc:343] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:27.854216 31013 leader_election.cc:343] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.854619 31013 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.855638 31150 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:27.848068 31146 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.861304 31092 tablet_bootstrap.cc:654] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.871351 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.872087 30900 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:27.872464 31092 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:27.872920 31092 ts_tablet_manager.cc:1403] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 12:23:27.874253 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.874890 31050 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:27.875751 31092 raft_consensus.cc:359] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.876428 31092 raft_consensus.cc:385] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.878026 31092 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.879211 31302 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.879680 31302 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.881569 31302 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.878806 31092 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.883967 31092 ts_tablet_manager.cc:1434] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:27.884148 31150 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.884625 31150 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.886591 31150 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:27.887676 31295 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.888078 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:27.889405 31014 leader_election.cc:343] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.890203 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.890822 30900 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:27.892031 31013 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:27.893491 31225 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.893893 31225 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.894223 31225 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.901633 31304 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.920529 31382 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.920943 31150 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.921094 31382 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.921145 31225 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.923166 31382 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:27.931317 31092 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:27.927740 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.937862 31225 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:27.957083 31091 tablet_bootstrap.cc:654] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.957522 31093 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:27.958037 31093 ts_tablet_manager.cc:1403] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.165s	user 0.024s	sys 0.059s
I20260709 12:23:27.940915 31048 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:27.942394 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.963280 30973 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:27.962100 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:27.964061 30900 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.964159 30864 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:27.967123 31382 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.973145 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:27.968979 31382 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.974992 30900 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:27.979633 31013 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:27.980592 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:27.981220 30969 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:27.982179 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:27.981225 31387 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:27.984452 31387 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:27.984817 31230 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:27.980863 31093 raft_consensus.cc:359] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.986567 31093 raft_consensus.cc:385] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.986814 31093 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.986640 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:27.987293 31050 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:27.988637 31093 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.978184 31153 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:27.978644 31382 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:27.985904 31387 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:27.999647 31093 ts_tablet_manager.cc:1434] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.004s
I20260709 12:23:28.000639 31093 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:27.991328 31153 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.985281 30865 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:28.003893 31097 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:28.006579 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:28.003983 31153 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.013588 31092 tablet_bootstrap.cc:654] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.002569 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:28.018622 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:28.027977 31382 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.019414 31230 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:28.033957 31014 leader_election.cc:343] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.035089 31153 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.037442 30901 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:28.038224 31230 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.038394 31382 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.041983 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:28.042562 31050 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.045382 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:28.045950 31111 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.046301 31111 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.046588 31111 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.040597 31230 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.050809 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:28.055270 31091 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:28.055708 31091 ts_tablet_manager.cc:1403] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.233s	user 0.014s	sys 0.004s
I20260709 12:23:28.053196 31302 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:28.059373 31153 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.067327 31295 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.067852 31295 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:28.054083 30865 leader_election.cc:343] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.133347 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:28.134119 30901 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.137949 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:28.138660 31051 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.141451 31150 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.142028 31150 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:28.161047 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 107689us
W20260709 12:23:28.162945 30865 leader_election.cc:343] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.064560 30795 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.168349 31111 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.169636 30970 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:28.170349 31295 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.172113 31111 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.177675 31050 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:28.206303 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:28.206979 30898 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:28.216647 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:28.217314 30864 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:28.217582 31225 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.218317 31225 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.218639 31225 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.219102 31146 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.219622 31146 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:28.220340 31146 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:28.223871 31393 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:23:28.236232 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:28.237825 31092 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:28.238289 31092 ts_tablet_manager.cc:1403] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.307s	user 0.014s	sys 0.015s
I20260709 12:23:28.232044 31150 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:28.252390 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:28.252169 31230 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:28.254307 31014 leader_election.cc:343] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.248452 31387 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.297073 31093 tablet_bootstrap.cc:654] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.308560 31091 raft_consensus.cc:359] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.309243 31091 raft_consensus.cc:385] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.309441 31091 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.311170 31091 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.296793 31230 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.307886 31387 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.322613 31051 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:28.324717 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:28.327963 31091 ts_tablet_manager.cc:1434] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.272s	user 0.030s	sys 0.051s
I20260709 12:23:28.312561 31225 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.330940 31225 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:28.331231 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:28.333233 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:28.333786 30897 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.337584 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:28.323623 31387 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:23:28.339794 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 262833us
I20260709 12:23:28.340794 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:28.341367 30970 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.343384 31092 raft_consensus.cc:359] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.343932 31092 raft_consensus.cc:385] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.344442 31092 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.344393 31091 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
W20260709 12:23:28.327222 30864 leader_election.cc:343] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.352691 31092 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.358194 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:28.333850 30901 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:28.361703 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:28.365442 31146 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.365862 31146 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.367493 31146 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.370431 31092 ts_tablet_manager.cc:1434] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.132s	user 0.007s	sys 0.002s
I20260709 12:23:28.371426 31092 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:28.363574 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:28.374730 31111 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.375162 31111 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:28.375712 31111 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.361332 31014 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:28.374293 31045 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:28.392161 31150 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.394809 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:28.395413 30971 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:28.377269 30864 leader_election.cc:343] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.407895 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:28.422801 31093 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:28.423357 31093 ts_tablet_manager.cc:1403] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.423s	user 0.022s	sys 0.031s
W20260709 12:23:28.424990 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44912.1us
I20260709 12:23:28.426050 31093 raft_consensus.cc:359] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:28.426043 30865 leader_election.cc:343] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.426815 31093 raft_consensus.cc:385] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.427106 30865 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:28.427124 31093 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.428444 31093 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.415432 30897 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:28.438978 31404 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.439929 31093 ts_tablet_manager.cc:1434] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:23:28.448123 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:28.456910 31092 tablet_bootstrap.cc:654] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:28.447069 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 47388.5us
I20260709 12:23:28.471977 30971 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:28.472198 31304 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.499266 31304 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:23:28.476358 30865 leader_election.cc:343] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.476835 31225 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.481014 31091 tablet_bootstrap.cc:654] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.485731 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:28.486836 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:28.487488 31093 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:28.490108 31048 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.496269 30797 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.502537 31225 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.508445 31304 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.509357 30970 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
W20260709 12:23:28.547817 30865 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:28.565455 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 56809.2us
I20260709 12:23:28.569005 30865 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:28.577574 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:28.556185 31408 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:23:28.586549 31401 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.587070 31401 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.588938 31092 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:28.589390 31092 ts_tablet_manager.cc:1403] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.218s	user 0.015s	sys 0.001s
I20260709 12:23:28.589999 31401 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.591871 31406 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.592445 31406 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:28.585784 31411 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.602057 31092 raft_consensus.cc:359] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.603029 31092 raft_consensus.cc:385] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.603330 31092 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
W20260709 12:23:28.596452 30864 leader_election.cc:343] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.603965 31092 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.591918 31225 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:28.605216 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:28.606097 31092 ts_tablet_manager.cc:1434] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:23:28.606940 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:28.607550 30893 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
W20260709 12:23:28.607568 31014 leader_election.cc:343] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.608417 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:28.609272 30864 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:28.611568 31092 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
W20260709 12:23:28.611801 30865 leader_election.cc:343] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.593287 31406 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.613834 31412 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.614243 31013 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:28.619335 31304 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.628052 31304 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.628527 31304 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.662590 30795 catalog_manager.cc:5697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.663465 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:28.648881 31225 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:23:28.666843 31046 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:28.670733 31093 tablet_bootstrap.cc:654] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.671891 31091 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:28.672343 31091 ts_tablet_manager.cc:1403] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.328s	user 0.018s	sys 0.010s
I20260709 12:23:28.678445 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:23:28.679147 31415 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:23:28.671232 31401 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:28.680382 31401 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.680685 31401 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.680889 31401 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:28.697796 31014 consensus_peers.cc:597] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.696609 31091 raft_consensus.cc:359] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.700476 31091 raft_consensus.cc:385] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.700796 31091 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.707314 30797 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.752331 31304 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.750806 31412 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 12:23:28.763525 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:23:28.779296 31418 log.cc:927] Time spent T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:28.787031 31092 tablet_bootstrap.cc:654] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.792171 31304 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:28.793597 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:28.795359 31091 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:28.797235 31014 leader_election.cc:343] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.798691 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:28.799232 30899 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.808561 31091 ts_tablet_manager.cc:1434] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.136s	user 0.021s	sys 0.044s
I20260709 12:23:28.809695 31091 tablet_bootstrap.cc:492] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:28.823830 31401 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.836265 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:28.838201 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:28.838825 31044 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:28.838981 30865 leader_election.cc:343] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.826925 31401 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:28.850342 31091 tablet_bootstrap.cc:654] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.855808 31044 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:28.856933 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:28.857316 31092 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:28.857800 31092 ts_tablet_manager.cc:1403] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.246s	user 0.003s	sys 0.007s
I20260709 12:23:28.863212 30899 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:28.865386 31382 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.865912 31382 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:28.866698 31382 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.869434 31013 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:28.871501 31417 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.872026 31417 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:28.872882 31417 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.917325 31093 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:28.918325 31093 ts_tablet_manager.cc:1403] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.431s	user 0.020s	sys 0.024s
I20260709 12:23:28.916574 30796 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.919298 31092 raft_consensus.cc:359] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.919946 31092 raft_consensus.cc:385] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.920207 31092 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.921341 31092 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.926040 31092 ts_tablet_manager.cc:1434] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.006s
I20260709 12:23:28.930917 31092 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:28.973181 31390 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:28.981565 31093 raft_consensus.cc:359] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.986294 31093 raft_consensus.cc:385] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.987006 31093 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.988332 31093 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:28.991843 31093 ts_tablet_manager.cc:1434] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 12:23:28.992996 31153 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:28.994411 31093 tablet_bootstrap.cc:492] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:28.988734 30797 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.013882 31091 tablet_bootstrap.cc:492] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:29.014370 31091 ts_tablet_manager.cc:1403] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.205s	user 0.006s	sys 0.021s
I20260709 12:23:29.018360 31417 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.019744 31401 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.030488 30795 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.031837 30795 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.038105 31091 raft_consensus.cc:359] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.038901 31091 raft_consensus.cc:385] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.039180 31091 raft_consensus.cc:740] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.039878 31091 consensus_queue.cc:260] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.042048 31091 ts_tablet_manager.cc:1434] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 12:23:29.042907 31091 tablet_bootstrap.cc:492] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:29.068728 31092 tablet_bootstrap.cc:654] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.079299 31093 tablet_bootstrap.cc:654] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.085084 31091 tablet_bootstrap.cc:654] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.107585 31048 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.119324 31146 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.119848 31146 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.122233 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:29.123798 30865 leader_election.cc:343] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.129417 31146 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.130844 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:29.131500 31044 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:29.132774 30864 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:29.134236 31401 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.134641 31401 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.135032 31401 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.134807 31408 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.140668 31417 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.143239 31417 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.143757 31417 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.150130 31093 tablet_bootstrap.cc:492] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:29.150698 31093 ts_tablet_manager.cc:1403] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.156s	user 0.029s	sys 0.017s
I20260709 12:23:29.163559 31417 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:29.164914 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.166805 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:29.173725 31401 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.169018 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:29.153666 31093 raft_consensus.cc:359] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.183314 31093 raft_consensus.cc:385] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.183676 31093 raft_consensus.cc:740] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.184370 31093 consensus_queue.cc:260] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.186470 31093 ts_tablet_manager.cc:1434] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:23:29.187566 31093 tablet_bootstrap.cc:492] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:29.192688 31390 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.197166 31092 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:29.197741 31092 ts_tablet_manager.cc:1403] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.267s	user 0.018s	sys 0.010s
I20260709 12:23:29.200642 31092 raft_consensus.cc:359] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.201110 31092 raft_consensus.cc:385] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.201329 31092 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.201812 31092 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.203516 31092 ts_tablet_manager.cc:1434] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:23:29.194284 31390 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.204972 31092 tablet_bootstrap.cc:492] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:29.205955 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:29.207377 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:23:29.207520 30865 leader_election.cc:343] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.207981 31044 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.209268 31390 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.210928 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.212172 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:29.214308 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:29.215029 31153 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.212744 31401 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.223330 31044 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:29.224529 30864 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:29.226372 31146 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.226938 31092 tablet_bootstrap.cc:654] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.227788 31146 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:29.228428 31146 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.230834 31091 tablet_bootstrap.cc:492] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:29.239857 31091 ts_tablet_manager.cc:1403] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.197s	user 0.024s	sys 0.011s
I20260709 12:23:29.240592 31304 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:29.251044 31093 tablet_bootstrap.cc:654] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.254361 31091 raft_consensus.cc:359] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.257823 31091 raft_consensus.cc:385] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.258153 31091 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.261341 31302 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.261904 31302 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.264026 31302 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.267807 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:29.267535 30796 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.267918 31091 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.268152 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.269165 30894 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:29.270081 31091 ts_tablet_manager.cc:1434] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
W20260709 12:23:29.270599 30939 leader_election.cc:343] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.270913 31091 tablet_bootstrap.cc:492] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:29.271229 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:29.272729 31302 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.273375 31302 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.273792 31302 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.278244 30973 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.279368 31092 tablet_bootstrap.cc:492] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:29.279886 31092 ts_tablet_manager.cc:1403] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.005s
I20260709 12:23:29.285507 31302 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.288210 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:29.288857 30894 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.295006 31302 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.295533 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:23:29.296837 30939 leader_election.cc:343] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.300269 30894 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:29.301716 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:29.303474 31092 raft_consensus.cc:359] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.304286 31092 raft_consensus.cc:385] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.304546 31092 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.305199 31092 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.305612 31093 tablet_bootstrap.cc:492] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:29.306072 31093 ts_tablet_manager.cc:1403] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.119s	user 0.003s	sys 0.009s
I20260709 12:23:29.305909 31302 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.307613 31302 raft_consensus.cc:697] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:29.308702 31092 ts_tablet_manager.cc:1434] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:23:29.309087 31304 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.309563 31304 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.310209 31390 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.310678 31390 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.311549 31304 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:29.312582 31390 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.313516 31304 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.313669 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.314040 31304 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.314896 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:29.316144 31014 leader_election.cc:343] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:29.316898 30939 leader_election.cc:343] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.318337 31091 tablet_bootstrap.cc:654] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.319258 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:29.308492 31302 consensus_queue.cc:237] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.319820 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:23:29.321439 31013 leader_election.cc:343] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.322862 31092 tablet_bootstrap.cc:492] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:29.319845 31048 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:29.324537 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:29.327039 31093 raft_consensus.cc:359] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.327524 31093 raft_consensus.cc:385] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.327770 31093 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.326691 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.325559 31390 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.328647 31390 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.328771 31304 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:29.329003 31390 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.338964 31390 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.331668 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:29.333335 31093 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.345039 30894 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:29.346314 31013 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:29.347788 31417 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.347836 31304 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.348232 31417 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.348564 31417 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.373500 31093 ts_tablet_manager.cc:1434] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 12:23:29.374614 31093 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
W20260709 12:23:29.398380 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 63224us
I20260709 12:23:29.398200 30973 raft_consensus.cc:2393] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:29.383670 31408 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:23:29.412575 30865 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.413503 31390 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.413650 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:29.409004 31417 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.422709 31417 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:29.423493 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:29.424125 30899 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.426473 31093 tablet_bootstrap.cc:654] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.427356 31091 tablet_bootstrap.cc:492] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:29.428282 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:29.428478 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:29.429698 31048 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.419075 30796 catalog_manager.cc:5697] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.433691 30899 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:29.434907 31013 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:29.435734 31304 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.436170 31304 raft_consensus.cc:697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:29.436936 31304 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.438651 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:23:29.439867 31014 leader_election.cc:343] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:29.431751 30939 leader_election.cc:343] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.445910 31091 ts_tablet_manager.cc:1403] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.175s	user 0.033s	sys 0.013s
I20260709 12:23:29.452791 31048 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:29.453735 31417 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:29.454669 31014 consensus_peers.cc:597] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.456651 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:29.457379 31390 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.457829 31390 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:29.460494 31091 raft_consensus.cc:359] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.461241 31091 raft_consensus.cc:385] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.461499 31091 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.464315 31092 tablet_bootstrap.cc:654] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.463500 31390 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.467710 31091 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.472244 31091 ts_tablet_manager.cc:1434] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:23:29.474283 31091 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:29.521945 31091 tablet_bootstrap.cc:654] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.528450 31093 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:29.528962 31093 ts_tablet_manager.cc:1403] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.155s	user 0.029s	sys 0.032s
I20260709 12:23:29.578349 31092 tablet_bootstrap.cc:492] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:29.579890 31092 ts_tablet_manager.cc:1403] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.257s	user 0.026s	sys 0.007s
I20260709 12:23:29.580490 30796 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.584481 30797 catalog_manager.cc:5697] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:29.580993 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 50628.7us
I20260709 12:23:29.586921 31092 raft_consensus.cc:359] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.587791 31092 raft_consensus.cc:385] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.605335 31092 raft_consensus.cc:740] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.606827 31092 consensus_queue.cc:260] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.608039 31093 raft_consensus.cc:359] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.608693 31093 raft_consensus.cc:385] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.608923 31092 ts_tablet_manager.cc:1434] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:23:29.609850 31092 tablet_bootstrap.cc:492] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:29.608938 31093 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.610925 31093 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.613320 31093 ts_tablet_manager.cc:1434] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.009s
I20260709 12:23:29.614241 31093 tablet_bootstrap.cc:492] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:29.617534 31091 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:29.617980 31091 ts_tablet_manager.cc:1403] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.013s
I20260709 12:23:29.618505 31401 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.618950 31401 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.621006 31401 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.621739 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:29.622457 30974 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:29.623577 31091 raft_consensus.cc:359] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.624222 31091 raft_consensus.cc:385] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.624492 31091 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.627091 30865 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:29.629526 31401 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.629921 31401 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.630247 31401 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.630954 31093 tablet_bootstrap.cc:654] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.625059 31091 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.642408 31092 tablet_bootstrap.cc:654] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.644081 31091 ts_tablet_manager.cc:1434] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:23:29.645740 31091 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:29.652693 31401 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.657330 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:29.676697 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:29.677297 30973 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:29.679425 30864 leader_election.cc:343] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.694528 30973 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:29.705139 30865 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:29.706017 31382 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.706476 31382 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:29.707482 31382 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.720315 31091 tablet_bootstrap.cc:654] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.719501 31401 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.720789 31304 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.721283 31304 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.723306 31304 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:29.728020 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:29.734174 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.743764 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:29.743767 30893 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:29.747467 31014 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:29.748529 31304 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.754822 31304 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.754956 31093 tablet_bootstrap.cc:492] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:29.755556 31093 ts_tablet_manager.cc:1403] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.012s
I20260709 12:23:29.758085 31093 raft_consensus.cc:359] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.758772 31093 raft_consensus.cc:385] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.759079 31093 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.759964 31093 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.766186 31382 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.766750 31093 ts_tablet_manager.cc:1434] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:23:29.766584 31390 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.768987 31093 tablet_bootstrap.cc:492] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:29.769120 31092 tablet_bootstrap.cc:492] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:29.769702 31092 ts_tablet_manager.cc:1403] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.160s	user 0.016s	sys 0.005s
I20260709 12:23:29.772341 31092 raft_consensus.cc:359] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.772955 31092 raft_consensus.cc:385] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.773211 31092 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.773797 31092 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.775166 30796 catalog_manager.cc:5697] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.780841 31091 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
W20260709 12:23:29.767843 30864 leader_election.cc:343] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.781675 31091 ts_tablet_manager.cc:1403] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.003s
I20260709 12:23:29.785912 31091 raft_consensus.cc:359] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.787658 31091 raft_consensus.cc:385] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.788023 31091 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.791714 31091 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.792832 31092 ts_tablet_manager.cc:1434] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:23:29.793756 31092 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:29.790354 31093 tablet_bootstrap.cc:654] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.796363 31091 ts_tablet_manager.cc:1434] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:23:29.799829 31091 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:29.832541 31092 tablet_bootstrap.cc:654] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.845949 31093 tablet_bootstrap.cc:492] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:29.846513 31093 ts_tablet_manager.cc:1403] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.004s
I20260709 12:23:29.848598 31390 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.849074 31390 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.850296 31093 raft_consensus.cc:359] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.851552 31093 raft_consensus.cc:385] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.851881 31093 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.852653 31093 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.853228 30973 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.851140 31390 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.851277 31091 tablet_bootstrap.cc:654] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.857702 31093 ts_tablet_manager.cc:1434] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:23:29.859438 31093 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:29.870152 31093 tablet_bootstrap.cc:654] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.873492 31091 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:29.875681 31091 ts_tablet_manager.cc:1403] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.005s
I20260709 12:23:29.878597 31091 raft_consensus.cc:359] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.882529 31091 raft_consensus.cc:385] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.883186 31091 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.884210 31091 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:29.893457 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:29.895871 31092 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:29.896413 31092 ts_tablet_manager.cc:1403] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.040s
I20260709 12:23:29.898931 31092 raft_consensus.cc:359] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.899643 31092 raft_consensus.cc:385] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.899544 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.900059 31092 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.900805 31092 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.902143 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:29.902930 31092 ts_tablet_manager.cc:1434] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:29.905413 31092 tablet_bootstrap.cc:492] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:29.906179 31091 ts_tablet_manager.cc:1434] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 12:23:29.907713 31091 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:29.910835 31092 tablet_bootstrap.cc:654] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.915778 31146 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.916280 31146 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.918684 31146 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.921792 31091 tablet_bootstrap.cc:654] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.924430 31146 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.934787 31093 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:29.935356 31093 ts_tablet_manager.cc:1403] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.011s
I20260709 12:23:29.937810 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:29.938036 31093 raft_consensus.cc:359] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.940335 31093 raft_consensus.cc:385] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.940672 31093 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.941404 31093 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:29.941947 30864 leader_election.cc:343] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.943509 31093 ts_tablet_manager.cc:1434] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:29.945909 31093 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:29.954457 31091 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:29.954167 31304 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.955076 31091 ts_tablet_manager.cc:1403] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 12:23:29.957820 31091 raft_consensus.cc:359] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.958539 31091 raft_consensus.cc:385] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.958838 31091 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.961017 31093 tablet_bootstrap.cc:654] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.961431 31304 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.961572 31091 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.963014 31304 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:29.964814 31014 consensus_peers.cc:597] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.965061 31304 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:29.966495 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:29.966624 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:29.967770 30894 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
W20260709 12:23:29.968884 31014 leader_election.cc:343] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.969327 31014 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:29.970083 31092 tablet_bootstrap.cc:492] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:29.969668 31091 ts_tablet_manager.cc:1434] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:23:29.970816 31092 ts_tablet_manager.cc:1403] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.019s
I20260709 12:23:29.972261 31304 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.972702 31091 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:29.972645 31304 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.973272 31304 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.974741 31092 raft_consensus.cc:359] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.975387 31092 raft_consensus.cc:385] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.975881 31092 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.978560 31092 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.979591 31446 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.980075 31446 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.980863 31092 ts_tablet_manager.cc:1434] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:29.981747 31092 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:29.982002 31446 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.984611 31091 tablet_bootstrap.cc:654] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.987165 31092 tablet_bootstrap.cc:654] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.988399 31446 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.988854 31446 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:29.990705 31446 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:29.993546 31093 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:29.994048 31093 ts_tablet_manager.cc:1403] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.005s
I20260709 12:23:30.003278 31446 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.004565 31304 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.006516 31093 raft_consensus.cc:359] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.007483 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:30.009548 30894 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.011669 31092 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.012167 31092 ts_tablet_manager.cc:1403] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.002s
I20260709 12:23:30.014706 31092 raft_consensus.cc:359] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.015326 31092 raft_consensus.cc:385] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.016794 30894 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:30.018281 31093 raft_consensus.cc:385] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.018623 31093 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.020694 31093 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.015583 31092 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.021538 31013 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:30.025051 31387 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.024797 31092 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.025522 31387 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:30.026331 31387 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.026871 31092 ts_tablet_manager.cc:1434] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:23:30.028146 31092 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:30.023814 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.024098 31091 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:30.032505 31091 ts_tablet_manager.cc:1403] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 12:23:30.035341 31091 raft_consensus.cc:359] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.036046 31091 raft_consensus.cc:385] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.036306 31091 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.036903 31091 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.038897 31091 ts_tablet_manager.cc:1434] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:30.039460 31146 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.039932 31146 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.041299 31093 ts_tablet_manager.cc:1434] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.002s
I20260709 12:23:30.041702 31146 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.042208 31093 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:30.042699 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.043475 31044 raft_consensus.cc:2393] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:30.049899 31092 tablet_bootstrap.cc:654] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.052790 31091 tablet_bootstrap.cc:492] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:30.057113 30939 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:30.061717 31470 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.058738 31091 tablet_bootstrap.cc:654] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.059612 31093 tablet_bootstrap.cc:654] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.083500 31093 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:30.084043 31093 ts_tablet_manager.cc:1403] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.002s
I20260709 12:23:30.086799 31093 raft_consensus.cc:359] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.088150 31093 raft_consensus.cc:385] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.089526 31093 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.093075 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.089911 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.091277 31417 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.091145 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.093401 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:30.097055 30865 leader_election.cc:343] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.097534 30865 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.094255 31417 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.102239 31093 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.109562 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.101032 31417 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.107420 31304 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.125277 30939 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:30.113023 31412 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.128086 30939 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:30.131279 31092 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.131837 31092 ts_tablet_manager.cc:1403] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.017s
I20260709 12:23:30.137295 30973 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.128822 31446 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.133891 31390 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:30.140291 31401 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.141850 31401 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.143882 31401 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.150004 30865 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.140113 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.151664 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.152544 31390 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.153352 31091 tablet_bootstrap.cc:492] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:30.153030 31390 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.153810 31091 ts_tablet_manager.cc:1403] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.017s
W20260709 12:23:30.155300 30864 leader_election.cc:343] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.168532 31093 ts_tablet_manager.cc:1434] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.084s	user 0.011s	sys 0.012s
I20260709 12:23:30.166106 31408 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.175231 31044 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.177642 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.193670 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.196059 31146 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.196362 31390 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.195618 31092 raft_consensus.cc:359] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.197124 31092 raft_consensus.cc:385] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.197405 31092 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.196502 31146 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.198734 31092 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.179939 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.202862 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:23:30.205142 30865 leader_election.cc:343] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.206012 31146 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:23:30.197625 31013 leader_election.cc:343] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.222276 31093 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:30.224510 31091 raft_consensus.cc:359] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.235898 31091 raft_consensus.cc:385] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.235999 31092 ts_tablet_manager.cc:1434] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260709 12:23:30.237064 31092 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
W20260709 12:23:30.237341 31014 leader_election.cc:343] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.238605 31014 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.239370 31387 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:30.240391 31473 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:23:30.224262 30796 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.208118 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:30.243414 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 48453.7us
I20260709 12:23:30.205716 31390 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
W20260709 12:23:30.212509 30865 leader_election.cc:343] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.249234 30865 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.210951 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:30.236225 31091 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
W20260709 12:23:30.245458 30864 leader_election.cc:343] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.250422 30864 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.252447 31382 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.253046 31382 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.259498 31464 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.273945 31146 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.276211 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.253901 31408 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.270752 31091 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.280270 30939 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:30.301187 31302 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.307646 31092 tablet_bootstrap.cc:654] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.309247 31091 ts_tablet_manager.cc:1434] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.155s	user 0.009s	sys 0.004s
I20260709 12:23:30.310039 31091 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:30.298641 30971 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.330618 31478 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.331471 31093 tablet_bootstrap.cc:654] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.331144 31478 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.337973 31478 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.340519 31470 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.340747 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.346527 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.348066 30972 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.348626 31478 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.349109 31478 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.351836 30976 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.347206 30892 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:30.359501 31091 tablet_bootstrap.cc:654] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.364287 31478 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:23:30.356282 31014 leader_election.cc:343] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.368057 31464 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.368533 31464 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.370460 31464 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.370929 31013 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.371244 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.371953 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.376097 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.376327 30895 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:30.376500 31304 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.376709 31045 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
W20260709 12:23:30.389205 31014 leader_election.cc:343] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.383788 31304 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.396068 31304 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.404784 30864 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:30.425959 30971 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:30.426808 31464 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.427217 31464 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.427524 31464 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.428524 31013 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.429584 31478 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.429922 31478 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.430246 31478 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.431500 31092 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.431996 31092 ts_tablet_manager.cc:1403] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.195s	user 0.006s	sys 0.023s
I20260709 12:23:30.444456 31464 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.434409 31304 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.445672 30968 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.448755 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:30.456189 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.449326 30898 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.461565 31093 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:30.462077 31093 ts_tablet_manager.cc:1403] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.240s	user 0.018s	sys 0.008s
I20260709 12:23:30.465698 31304 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:23:30.472221 30865 leader_election.cc:343] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.474903 31093 raft_consensus.cc:359] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.475634 31093 raft_consensus.cc:385] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.475929 31093 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.481593 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:23:30.484683 31014 leader_election.cc:343] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.486951 31092 raft_consensus.cc:359] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.487689 31092 raft_consensus.cc:385] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.493554 31092 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.493208 31093 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.491266 31478 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.492789 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:30.490531 31464 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.498268 31092 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.498066 31044 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 1: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:23:30.502730 31093 ts_tablet_manager.cc:1434] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:23:30.503530 31093 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:30.501757 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:30.508051 31146 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.508514 31146 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.509215 31092 ts_tablet_manager.cc:1434] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 12:23:30.513284 31092 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:30.502790 31478 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.509899 30892 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:30.514410 31146 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.515311 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:30.518734 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.521528 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:30.520298 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.533496 31044 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:30.541127 30898 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
W20260709 12:23:30.541848 30865 leader_election.cc:343] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.542301 31013 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.543409 31478 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.543910 31478 raft_consensus.cc:697] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:30.539131 31091 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:30.545114 31091 ts_tablet_manager.cc:1403] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.235s	user 0.030s	sys 0.015s
I20260709 12:23:30.544684 31478 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:30.539496 31014 leader_election.cc:343] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:30.548317 30865 leader_election.cc:343] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.548756 30865 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.550104 31146 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.550740 31014 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.553958 31417 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.548342 30864 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.557947 31091 raft_consensus.cc:359] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.558665 31091 raft_consensus.cc:385] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.558878 31401 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.559384 31401 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.559760 31401 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.558917 31091 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.570211 31091 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.578109 31091 ts_tablet_manager.cc:1434] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 12:23:30.579058 31091 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:30.582875 31093 tablet_bootstrap.cc:654] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.590122 31304 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.591677 31092 tablet_bootstrap.cc:654] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.590441 31401 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.612761 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:30.613365 31049 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.609269 31401 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.625640 30795 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.636922 31304 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.645818 31093 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:30.646306 31093 ts_tablet_manager.cc:1403] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.008s
I20260709 12:23:30.645725 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:30.662693 31049 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
W20260709 12:23:30.665248 30865 leader_election.cc:343] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.666009 30864 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.667104 31464 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.667614 31464 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:30.668452 31464 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:30.682827 31496 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:30.679322 31093 raft_consensus.cc:359] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.684693 31091 tablet_bootstrap.cc:654] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.685016 31093 raft_consensus.cc:385] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.685333 31093 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.687318 31093 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.695431 31302 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.697611 31092 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.697669 31093 ts_tablet_manager.cc:1434] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:23:30.698189 31092 ts_tablet_manager.cc:1403] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.185s	user 0.022s	sys 0.027s
I20260709 12:23:30.696040 31302 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.699115 31093 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:30.710023 31302 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.712558 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.713442 30894 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:30.713655 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.714438 31049 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:23:30.713418 31092 raft_consensus.cc:359] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.715199 31092 raft_consensus.cc:385] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.715448 31092 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.716388 30796 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.718847 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:30.719643 31485 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.716238 31092 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.724594 31093 tablet_bootstrap.cc:654] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.726114 31091 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:30.728955 31091 ts_tablet_manager.cc:1403] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.150s	user 0.013s	sys 0.007s
I20260709 12:23:30.724107 31092 ts_tablet_manager.cc:1434] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:23:30.738152 31091 raft_consensus.cc:359] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.738900 31091 raft_consensus.cc:385] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.740476 31091 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.741191 31091 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.743219 31091 ts_tablet_manager.cc:1434] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.001s
I20260709 12:23:30.744061 31091 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:30.753590 31092 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:30.759920 31092 tablet_bootstrap.cc:654] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.766752 31485 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.775632 31092 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.776209 31092 ts_tablet_manager.cc:1403] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.004s
I20260709 12:23:30.778882 31092 raft_consensus.cc:359] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.779615 31092 raft_consensus.cc:385] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.779908 31092 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.780591 31092 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.782202 31092 ts_tablet_manager.cc:1434] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:30.783160 31092 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:30.788007 31093 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:30.788489 31093 ts_tablet_manager.cc:1403] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.026s
I20260709 12:23:30.788817 31092 tablet_bootstrap.cc:654] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.785606 31091 tablet_bootstrap.cc:654] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.800417 31092 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.790946 31093 raft_consensus.cc:359] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.801029 31092 ts_tablet_manager.cc:1403] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:23:30.801110 31093 raft_consensus.cc:385] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.801487 31093 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.802193 31093 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.803699 31092 raft_consensus.cc:359] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.804389 31092 raft_consensus.cc:385] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.804644 31092 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.805653 31093 ts_tablet_manager.cc:1434] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:23:30.805317 31092 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.806591 31093 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:30.808000 31092 ts_tablet_manager.cc:1434] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:30.808894 31092 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
I20260709 12:23:30.812958 31093 tablet_bootstrap.cc:654] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.813642 31091 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:30.814097 31091 ts_tablet_manager.cc:1403] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.004s
I20260709 12:23:30.807497 31225 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.816082 31225 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.816561 31091 raft_consensus.cc:359] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.817219 31091 raft_consensus.cc:385] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.817467 31091 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.818285 31225 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.818156 31091 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.819419 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.819957 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.820644 30892 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:30.820351 31091 ts_tablet_manager.cc:1434] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:30.821943 31091 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
W20260709 12:23:30.820909 31014 leader_election.cc:343] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.840620 31013 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.846390 31092 tablet_bootstrap.cc:654] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.842700 31225 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.850481 31225 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.850857 31225 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.850687 31093 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:30.851521 31093 ts_tablet_manager.cc:1403] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.005s
I20260709 12:23:30.857822 31093 raft_consensus.cc:359] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.858567 31093 raft_consensus.cc:385] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.858870 31093 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.859812 31093 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.854334 31091 tablet_bootstrap.cc:654] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.864537 31093 ts_tablet_manager.cc:1434] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:30.865797 31093 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Bootstrap starting.
I20260709 12:23:30.874439 31092 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.874917 31092 ts_tablet_manager.cc:1403] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 12:23:30.873821 31093 tablet_bootstrap.cc:654] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.877377 31092 raft_consensus.cc:359] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.877996 31091 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:30.878037 31092 raft_consensus.cc:385] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.878472 31092 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.879213 31092 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.880069 31091 ts_tablet_manager.cc:1403] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.002s
I20260709 12:23:30.880174 31225 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.881588 31092 ts_tablet_manager.cc:1434] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:30.882683 31091 raft_consensus.cc:359] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.883389 31091 raft_consensus.cc:385] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.883695 31091 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.884312 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:30.884382 31091 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.885116 30894 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.882396 31304 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.888018 31304 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.882215 31225 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.886921 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:30.900864 31092 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: Bootstrap starting.
W20260709 12:23:30.901978 31014 leader_election.cc:343] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.907075 31092 tablet_bootstrap.cc:654] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.889814 31304 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.891223 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.916119 30892 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:30.892679 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.917490 31013 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:30.918303 31417 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.918751 31417 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.920778 31417 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.921252 31417 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.921576 31417 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.921908 31417 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.912218 30894 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:30.927026 31013 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.928366 31478 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.929852 31478 raft_consensus.cc:697] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:30.930684 31478 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.936131 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.936848 30894 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:30.938012 31387 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.938532 31387 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.940104 31093 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: No bootstrap required, opened a new log
I20260709 12:23:30.940367 31387 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.940562 31093 ts_tablet_manager.cc:1403] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.004s
I20260709 12:23:30.940403 31485 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.941135 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.941272 31485 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.943293 31485 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.944487 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:30.944808 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.945133 31051 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:30.945443 30894 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:30.943250 31093 raft_consensus.cc:359] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.945767 31092 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: No bootstrap required, opened a new log
I20260709 12:23:30.946033 31093 raft_consensus.cc:385] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.946213 31092 ts_tablet_manager.cc:1403] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.011s
I20260709 12:23:30.946374 31093 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.946950 30939 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:30.947572 31013 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:30.947747 31390 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.948477 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:30.948226 31093 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.948726 31390 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.949183 31390 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.950119 31304 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.950459 31304 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.950749 31304 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:30.954001 31014 leader_election.cc:343] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:30.955078 31014 leader_election.cc:343] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.956357 31390 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.960335 31390 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.958628 31093 ts_tablet_manager.cc:1434] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:23:30.957206 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:30.961647 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:30.962001 30894 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 0.
I20260709 12:23:30.962203 31051 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.948868 31092 raft_consensus.cc:359] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.962976 31092 raft_consensus.cc:385] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.962870 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:30.963532 30892 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.963577 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.964557 30968 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 1: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:23:30.970480 31304 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.971185 31092 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.972043 31092 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.974695 30892 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:30.975855 31092 ts_tablet_manager.cc:1434] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:23:30.976444 31464 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.976919 31464 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.972237 31304 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:30.978165 30939 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:30.978883 31464 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.979131 31390 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.980021 31390 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:30.980235 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:30.980959 31390 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:30.981289 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:30.981489 30865 leader_election.cc:343] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.981968 31045 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 0.
I20260709 12:23:30.983119 30864 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:30.984239 31401 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.984586 31401 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.984944 31401 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.986352 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:30.988590 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:30.989189 30894 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.001690 31051 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:31.007599 31401 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.008808 30894 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
W20260709 12:23:30.999521 31014 leader_election.cc:343] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.010324 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:31.010591 31304 raft_consensus.cc:2764] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:31.006131 31417 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.010960 31401 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:30.887293 31091 ts_tablet_manager.cc:1434] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:23:31.011693 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:23:31.011996 30865 leader_election.cc:343] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.012241 31051 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.012068 31091 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:31.010675 31013 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:31.014897 31225 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.015275 31417 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:31.015383 31225 raft_consensus.cc:697] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:31.020529 31225 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.023000 31091 tablet_bootstrap.cc:654] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.013892 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:31.016465 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:23:31.024991 31014 leader_election.cc:343] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.025072 30894 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.027215 31304 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.027657 31304 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.030476 31304 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:31.032433 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:23:31.033056 30972 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:31.034372 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:31.035106 31225 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.035444 31225 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.036147 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:31.036783 30892 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 0.
I20260709 12:23:31.038496 31051 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:23:31.039690 30864 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:31.041028 31464 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.041497 31464 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:31.041147 30894 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:31.042300 31464 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.043293 31013 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:31.044392 31417 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.044823 31417 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:31.045578 31417 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.052871 30795 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:31.053464 31014 consensus_peers.cc:597] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.035780 31225 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.050240 30797 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 1, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.078537 31091 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:31.079025 31091 ts_tablet_manager.cc:1403] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.000s
I20260709 12:23:31.081578 31091 raft_consensus.cc:359] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.082238 31091 raft_consensus.cc:385] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.082499 31091 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.100414 31091 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.102537 31091 ts_tablet_manager.cc:1434] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:23:31.108340 31091 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
W20260709 12:23:31.107340 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:31.136724 31091 tablet_bootstrap.cc:654] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.112867 31225 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.199046 31478 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.201344 31485 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.201896 31485 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.208266 31485 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:31.276937 31225 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:31.280145 30968 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.282788 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:31.283680 31046 raft_consensus.cc:2393] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 1: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:23:31.294714 31518 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.306417 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:31.307072 30894 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.312119 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:31.313068 30971 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.314896 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:31.320614 30971 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:31.320160 30797 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.323487 31091 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:31.324057 31091 ts_tablet_manager.cc:1403] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.216s	user 0.035s	sys 0.028s
I20260709 12:23:31.337606 30795 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.339497 30795 catalog_manager.cc:5697] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.342655 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:31.344519 31387 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.344995 31387 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:31.345906 31387 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.350844 30939 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:31.353471 31390 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.355532 31091 raft_consensus.cc:359] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.356330 31091 raft_consensus.cc:385] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.356596 31091 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.357276 31091 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.358536 30894 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:23:31.369729 31091 ts_tablet_manager.cc:1434] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:23:31.370680 31091 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
W20260709 12:23:31.458066 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 85978.9us
W20260709 12:23:31.456526 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 67577.2us
I20260709 12:23:31.481118 31302 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.481644 31302 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.509035 31302 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:23:31.515587 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 62575.9us
I20260709 12:23:31.533226 30797 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.543586 31091 tablet_bootstrap.cc:654] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.549728 31478 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.556234 31382 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.565281 31225 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:31.579515 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 93645.9us
I20260709 12:23:31.575598 31387 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:31.588351 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:31.594653 31091 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:31.595150 31091 ts_tablet_manager.cc:1403] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.225s	user 0.021s	sys 0.020s
I20260709 12:23:31.597031 31091 raft_consensus.cc:359] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.597469 31091 raft_consensus.cc:385] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.597652 31091 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.598156 31091 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:31.632943 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 74234.8us
I20260709 12:23:31.643095 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:31.580147 30971 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.661206 30967 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.670959 31401 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.685285 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:31.696794 31091 ts_tablet_manager.cc:1434] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.005s
I20260709 12:23:31.698689 31091 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
W20260709 12:23:31.741950 31014 consensus_peers.cc:597] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.746840 31485 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:31.743467 31014 consensus_peers.cc:597] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.779150 31091 tablet_bootstrap.cc:654] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.781154 31387 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.831919 31304 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:31.890748 31091 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:31.891258 31091 ts_tablet_manager.cc:1403] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.009s
I20260709 12:23:31.920316 31091 raft_consensus.cc:359] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.924453 31091 raft_consensus.cc:385] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.926445 31091 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.929625 31091 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.932515 31091 ts_tablet_manager.cc:1434] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:23:31.935818 31091 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: Bootstrap starting.
I20260709 12:23:31.937507 31304 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.956688 31524 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:23:31.957278 31524 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:31.965097 31524 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:31.990399 31091 tablet_bootstrap.cc:654] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.004563 30968 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.007980 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:32.012804 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:23:32.027518 30865 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:32.030943 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 61129.1us
I20260709 12:23:32.035813 31549 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.060279 31524 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.074405 31091 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: No bootstrap required, opened a new log
I20260709 12:23:32.074986 31091 ts_tablet_manager.cc:1403] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: Time spent bootstrapping tablet: real 0.139s	user 0.010s	sys 0.014s
I20260709 12:23:32.077636 31091 raft_consensus.cc:359] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:32.081286 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:32.081311 31091 raft_consensus.cc:385] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.082167 31091 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.082835 31091 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:32.086205 31533 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:32.089847 31091 ts_tablet_manager.cc:1434] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:23:32.095093 30971 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:32.221843 30847 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:32.234037 31524 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.234543 31524 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:32.236117 31524 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:32.236981 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:32.237295 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:32.238679 30939 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:32.239549 31524 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.261549 30970 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.406373 31524 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.406955 31524 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:32.409029 31524 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:32.410629 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:23:32.411280 30894 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:32.412333 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:32.412547 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:23:32.413122 31390 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:32.413321 31044 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:23:32.413496 31390 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.413898 31390 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.421439 31390 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:32.424163 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:32.424741 30894 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.424929 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:32.425626 31044 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.426573 31390 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:32.431339 30894 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:23:32.432013 31044 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:23:32.432693 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:32.433951 31390 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.434396 31390 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:32.435775 31390 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:32.447786 30795 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 0 to 2, leader changed from <none> to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.846510 30896 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:32.847810 31524 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.901438 31044 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:32.902700 31533 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.412981 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:34.463013 31578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:34.463428 31579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:34.468870 31581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:34.471232 29732 server_base.cc:1061] running on GCE node
I20260709 12:23:34.472275 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:34.472497 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:34.472684 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599814472667 us; error 0 us; skew 500 ppm
I20260709 12:23:34.473250 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:34.476351 29732 webserver.cc:533] Webserver started at http://127.29.9.4:41077/ using document root <none> and password file <none>
I20260709 12:23:34.476850 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:34.477104 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:34.477571 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:34.481848 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-3-root/instance:
uuid: "9f38f761eded4f28b9d802f6570ee71e"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-ftzc"
I20260709 12:23:34.498260 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.003s	sys 0.008s
I20260709 12:23:34.506225 31586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.507082 29732 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:34.507367 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-3-root
uuid: "9f38f761eded4f28b9d802f6570ee71e"
format_stamp: "Formatted at 2026-07-09 12:23:34 on dist-test-slave-ftzc"
I20260709 12:23:34.507827 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:34.525540 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:34.527343 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:34.529368 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:34.532745 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:34.533025 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.533329 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:34.533563 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:34.631369 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.4:39869
I20260709 12:23:34.631919 31649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.4:39869 every 8 connection(s)
I20260709 12:23:34.635849 29732 auto_leader_rebalancer-test.cc:439] add a tserver: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:34.652426 31650 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46357
I20260709 12:23:34.652827 31650 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:34.653695 31650 heartbeater.cc:507] Master 127.29.9.62:46357 requested a full tablet report, sending...
I20260709 12:23:34.655750 30795 ts_manager.cc:194] Registered new tserver with Master: 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:23:34.657552 30795 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48640
I20260709 12:23:35.414958 30968 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:35.421036 31051 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.421815 30899 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.424659 31636 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.425680 31524 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.439426 31524 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:23:35.441191 30942 consensus_peers.cc:597] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 661cc7685b074dd3a1a2ca4dbb1d2eee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.441843 30899 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.442924 31050 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.459743 30795 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.479836 30899 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:35.489225 31050 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.493661 31577 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:35.496903 30968 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.498495 31544 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:35.509737 30867 consensus_peers.cc:597] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dbd739a4ac24132b2b04caeed573906. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.509985 31668 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.511706 30968 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.525050 30899 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:35.529841 30795 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.539041 31050 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:23:35.547106 30867 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07b3f75bb9e3426a95aa33d2f0472a36. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.565025 31051 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.565104 30968 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.566375 31577 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.568998 31577 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:35.575923 31670 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.577551 30968 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.579128 31051 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.589675 30894 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:35.594126 30797 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:35.613193 30867 consensus_peers.cc:597] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bf1075e43344e4c85d09b6aeac40c55. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.614297 31051 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.615586 31577 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.624051 30968 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:35.628376 31577 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.631228 31051 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.636857 31670 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:35.648382 30796 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.660107 31650 heartbeater.cc:499] Master 127.29.9.62:46357 was elected leader, sending a full tablet report...
I20260709 12:23:35.660398 30968 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:35.833918 31681 ts_tablet_manager.cc:933] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:35.840866 31681 tablet_copy_client.cc:323] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:35.852802 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:35.853433 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet 661cc7685b074dd3a1a2ca4dbb1d2eee from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-661cc7685b074dd3a1a2ca4dbb1d2eee
I20260709 12:23:35.861792 30986 tablet_copy_source_session.cc:215] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:35.865638 31681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:35.893707 31681 tablet_copy_client.cc:806] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:35.894775 31681 tablet_copy_client.cc:670] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.590623 31681 tablet_copy_client.cc:538] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.609058 31697 ts_tablet_manager.cc:933] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:36.611272 31699 ts_tablet_manager.cc:933] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:36.624760 31681 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
W20260709 12:23:36.640677 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 136506us
I20260709 12:23:36.656852 31697 tablet_copy_client.cc:323] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:36.711139 31698 ts_tablet_manager.cc:933] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:36.712105 31699 tablet_copy_client.cc:323] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:36.721364 31698 tablet_copy_client.cc:323] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:36.756052 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 07b3f75bb9e3426a95aa33d2f0472a36 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:36.756364 30910 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 1dbd739a4ac24132b2b04caeed573906 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:36.756692 30909 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 9bf1075e43344e4c85d09b6aeac40c55 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:36.756768 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 07b3f75bb9e3426a95aa33d2f0472a36 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-07b3f75bb9e3426a95aa33d2f0472a36
I20260709 12:23:36.757553 30910 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 1dbd739a4ac24132b2b04caeed573906 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-1dbd739a4ac24132b2b04caeed573906
I20260709 12:23:36.759819 30909 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 9bf1075e43344e4c85d09b6aeac40c55 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-9bf1075e43344e4c85d09b6aeac40c55
W20260709 12:23:36.766583 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 124617us
I20260709 12:23:36.772373 30909 tablet_copy_source_session.cc:215] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.775889 30910 tablet_copy_source_session.cc:215] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.776230 31698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf1075e43344e4c85d09b6aeac40c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.779021 31699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbd739a4ac24132b2b04caeed573906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.796039 31699 tablet_copy_client.cc:806] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.796909 31699 tablet_copy_client.cc:670] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.798704 30911 tablet_copy_source_session.cc:215] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:36.801719 31697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b3f75bb9e3426a95aa33d2f0472a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:36.815342 31699 tablet_copy_client.cc:538] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.820161 31681 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.821239 31681 tablet_bootstrap.cc:492] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:36.821978 31681 ts_tablet_manager.cc:1403] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.197s	user 0.031s	sys 0.008s
I20260709 12:23:36.827849 31681 raft_consensus.cc:359] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.830127 31699 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:36.831902 31681 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:36.832041 31697 tablet_copy_client.cc:806] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.835235 31681 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.835951 31698 tablet_copy_client.cc:806] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:36.836333 31697 tablet_copy_client.cc:670] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.836534 31698 tablet_copy_client.cc:670] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:36.845000 31681 ts_tablet_manager.cc:1434] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:23:36.846333 31698 tablet_copy_client.cc:538] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.847154 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-661cc7685b074dd3a1a2ca4dbb1d2eee received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:36.847618 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-661cc7685b074dd3a1a2ca4dbb1d2eee on tablet 661cc7685b074dd3a1a2ca4dbb1d2eee with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:36.850251 31697 tablet_copy_client.cc:538] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:36.855177 31698 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:36.864724 31697 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:36.906690 31698 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.909699 31698 tablet_bootstrap.cc:492] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:36.916193 31698 ts_tablet_manager.cc:1403] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.012s
I20260709 12:23:36.904489 31699 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.919350 31698 raft_consensus.cc:359] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.920522 31698 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:36.920801 31699 tablet_bootstrap.cc:492] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:36.921612 31699 ts_tablet_manager.cc:1403] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.019s
I20260709 12:23:36.926586 31699 raft_consensus.cc:359] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.921190 31698 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.937345 31698 ts_tablet_manager.cc:1434] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:23:36.939013 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-9bf1075e43344e4c85d09b6aeac40c55 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:36.939432 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-9bf1075e43344e4c85d09b6aeac40c55 on tablet 9bf1075e43344e4c85d09b6aeac40c55 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:36.942836 31699 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:36.943622 31699 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.946208 31699 ts_tablet_manager.cc:1434] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:23:36.947038 31697 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:36.947894 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-1dbd739a4ac24132b2b04caeed573906 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:36.948033 31697 tablet_bootstrap.cc:492] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:36.948359 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-1dbd739a4ac24132b2b04caeed573906 on tablet 1dbd739a4ac24132b2b04caeed573906 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:36.950419 31697 ts_tablet_manager.cc:1403] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.009s
I20260709 12:23:36.954517 31697 raft_consensus.cc:359] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.956604 31697 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:36.964664 31697 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:36.977284 31697 ts_tablet_manager.cc:1434] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:23:36.982707 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-07b3f75bb9e3426a95aa33d2f0472a36 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:36.983142 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-07b3f75bb9e3426a95aa33d2f0472a36 on tablet 07b3f75bb9e3426a95aa33d2f0472a36 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:37.145067 31621 raft_consensus.cc:1217] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:37.150419 31621 raft_consensus.cc:1217] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:37.297863 31621 raft_consensus.cc:1217] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:37.309813 31621 raft_consensus.cc:1217] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:23:37.463693 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800095e40 after lost signal to thread 29735
W20260709 12:23:37.464576 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800083ca0 after lost signal to thread 30833
W20260709 12:23:37.466329 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb4e0 after lost signal to thread 31000
W20260709 12:23:37.467319 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebba0 after lost signal to thread 31075
W20260709 12:23:37.468310 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002fcca0 after lost signal to thread 31649
W20260709 12:23:37.468636 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002fcd00 after lost signal to thread 31656
I20260709 12:23:37.666146 31687 raft_consensus.cc:1064] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:37.668931 31687 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:37.696900 31621 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.698925 31695 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.704572 30967 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.705976 31046 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.707823 31691 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.709643 31691 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.733593 31691 raft_consensus.cc:1064] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:37.738180 31691 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:37.743780 31687 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:37.797662 31713 raft_consensus.cc:1064] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:37.804414 31046 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:37.810752 31050 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.813994 30971 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.817762 31621 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.822705 31722 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:37.825084 31721 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.818668 31713 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:37.841553 30967 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:37.843447 31621 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:37.856732 31718 raft_consensus.cc:1064] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:37.856387 31695 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.859166 31718 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:37.863714 30796 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.878141 31051 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.879549 31687 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.884729 30967 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.899047 31721 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.923086 31622 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.924999 31713 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.932186 31046 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.941666 31621 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.946067 31718 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:37.949301 31718 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:37.957942 30898 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:37.958401 31621 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:37.967905 31636 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:37.970007 31050 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:37.998443 30898 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:38.014472 31695 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:23:38.018625 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 51587.2us
I20260709 12:23:38.027534 31636 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:38.031790 31045 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.036306 30796 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.081262 31621 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.085916 31721 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.089188 30976 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.089895 30968 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.139072 31721 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.140810 31624 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.141141 31621 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.139110 30796 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.158723 31636 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.173497 30799 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.175973 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1dbd739a4ac24132b2b04caeed573906 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:38.179279 31721 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:38.187348 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dbd739a4ac24132b2b04caeed573906 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:38.192466 30893 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:38.204102 31621 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.203545 30901 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.205938 30968 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.209131 31687 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.216379 30796 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.218231 31687 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.220112 30976 raft_consensus.cc:2955] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.223330 30970 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.225144 31050 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.224905 31622 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.179443 31624 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.251797 30970 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:38.252871 31744 tablet_replica.cc:333] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:38.255103 31721 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.237354 30896 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:38.264532 30796 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.269035 31621 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.269550 31050 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.271044 31695 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.272949 31718 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:38.282703 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bf1075e43344e4c85d09b6aeac40c55 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:38.283703 31744 raft_consensus.cc:2243] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.284554 31744 raft_consensus.cc:2272] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.287411 31722 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.293648 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9bf1075e43344e4c85d09b6aeac40c55 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:38.293864 31050 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.297510 31621 raft_consensus.cc:2955] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.306862 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07b3f75bb9e3426a95aa33d2f0472a36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:38.309062 31744 ts_tablet_manager.cc:1916] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:38.310966 31622 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.316954 31741 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:38.317297 30796 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.324810 31742 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.329475 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 07b3f75bb9e3426a95aa33d2f0472a36 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:38.329568 31621 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.329607 31744 ts_tablet_manager.cc:1929] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:38.331471 31744 log.cc:1199] T 1dbd739a4ac24132b2b04caeed573906 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/1dbd739a4ac24132b2b04caeed573906
I20260709 12:23:38.333069 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet 1dbd739a4ac24132b2b04caeed573906 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:38.333567 31744 tablet_replica.cc:333] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:38.334637 31744 raft_consensus.cc:2243] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.335275 31744 raft_consensus.cc:2272] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.338173 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:38.339282 31744 ts_tablet_manager.cc:1916] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:38.347790 30795 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.360070 31050 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:38.362432 31744 ts_tablet_manager.cc:1929] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:38.362849 31744 log.cc:1199] T 9bf1075e43344e4c85d09b6aeac40c55 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/9bf1075e43344e4c85d09b6aeac40c55
I20260709 12:23:38.363936 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 661cc7685b074dd3a1a2ca4dbb1d2eee with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:38.364732 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet 9bf1075e43344e4c85d09b6aeac40c55 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:38.370461 31745 tablet_replica.cc:333] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:38.371763 31745 raft_consensus.cc:2243] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.372646 31745 raft_consensus.cc:2272] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.376253 31745 ts_tablet_manager.cc:1916] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:38.388424 31746 tablet_replica.cc:333] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:38.387742 30968 raft_consensus.cc:2955] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.408564 31740 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:38.413050 31746 raft_consensus.cc:2243] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.413800 31746 raft_consensus.cc:2272] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.417842 31746 ts_tablet_manager.cc:1916] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:38.426460 31745 ts_tablet_manager.cc:1929] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:38.426934 31745 log.cc:1199] T 07b3f75bb9e3426a95aa33d2f0472a36 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/07b3f75bb9e3426a95aa33d2f0472a36
I20260709 12:23:38.429129 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 07b3f75bb9e3426a95aa33d2f0472a36 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:38.435634 31050 raft_consensus.cc:2955] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:38.453651 31746 ts_tablet_manager.cc:1929] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:38.454114 31746 log.cc:1199] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/661cc7685b074dd3a1a2ca4dbb1d2eee
I20260709 12:23:38.455814 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 661cc7685b074dd3a1a2ca4dbb1d2eee (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:39.488919 31046 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:39.495867 30971 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.497705 31528 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.500865 30898 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.502360 31528 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.522651 31528 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.530476 30898 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:23:39.546948 31016 consensus_peers.cc:597] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af9423709bcf457ab89f49d71d157085. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.560801 30893 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:39.585661 30795 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.594551 31046 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:39.597020 30867 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 174b12b6011c47a2baad4ae805c60e15. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.599366 31749 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.598146 30971 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.607411 30975 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.609254 31749 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.638857 31695 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.655900 30967 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:39.661731 30975 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.675199 31046 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.682127 31050 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:39.683677 30942 consensus_peers.cc:597] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9e2b6ed092748a1a4b34148ab6d2923. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.683848 31740 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.690697 30901 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:39.692123 31742 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.714107 31741 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.714581 30797 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.726958 30893 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.740535 31050 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.746752 30967 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:39.750240 30796 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.768581 31050 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:39.769326 30942 consensus_peers.cc:597] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbcdd6eee3294377852452b4989be45f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.772585 31741 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.773205 30898 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:39.781936 31742 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:39.792799 31742 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.796254 30898 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.823654 30797 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.831667 31046 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:39.920572 31772 ts_tablet_manager.cc:933] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:39.959749 31772 tablet_copy_client.cc:323] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:23:39.976287 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet af9423709bcf457ab89f49d71d157085 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:23:39.976797 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet af9423709bcf457ab89f49d71d157085 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-af9423709bcf457ab89f49d71d157085
I20260709 12:23:39.981874 31061 tablet_copy_source_session.cc:215] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.984462 31772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9423709bcf457ab89f49d71d157085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.997853 31772 tablet_copy_client.cc:806] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.998471 31772 tablet_copy_client.cc:670] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:40.006973 31772 tablet_copy_client.cc:538] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:40.015667 31772 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:40.064709 31772 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.065701 31772 tablet_bootstrap.cc:492] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:40.066357 31772 ts_tablet_manager.cc:1403] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.009s
I20260709 12:23:40.069243 31772 raft_consensus.cc:359] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.070073 31772 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:40.070712 31772 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.080191 31772 ts_tablet_manager.cc:1434] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.005s
I20260709 12:23:40.084837 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-af9423709bcf457ab89f49d71d157085 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:23:40.085438 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-af9423709bcf457ab89f49d71d157085 on tablet af9423709bcf457ab89f49d71d157085 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:40.120416 31772 ts_tablet_manager.cc:933] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:40.122087 31772 tablet_copy_client.cc:323] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:40.123656 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet e9e2b6ed092748a1a4b34148ab6d2923 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:40.124210 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet e9e2b6ed092748a1a4b34148ab6d2923 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-e9e2b6ed092748a1a4b34148ab6d2923
I20260709 12:23:40.131590 30986 tablet_copy_source_session.cc:215] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:40.135396 31772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e2b6ed092748a1a4b34148ab6d2923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.145443 31778 ts_tablet_manager.cc:933] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:40.159473 31772 tablet_copy_client.cc:806] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:40.160126 31772 tablet_copy_client.cc:670] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:40.172824 31772 tablet_copy_client.cc:538] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:40.187594 31772 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:40.215165 31778 tablet_copy_client.cc:323] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:40.217278 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 174b12b6011c47a2baad4ae805c60e15 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:40.217818 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 174b12b6011c47a2baad4ae805c60e15 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-174b12b6011c47a2baad4ae805c60e15
I20260709 12:23:40.228917 30911 tablet_copy_source_session.cc:215] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:40.233836 31778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174b12b6011c47a2baad4ae805c60e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.236438 31772 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.237404 31772 tablet_bootstrap.cc:492] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:40.238176 31772 ts_tablet_manager.cc:1403] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.016s
I20260709 12:23:40.237370 31782 ts_tablet_manager.cc:933] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:40.241070 31772 raft_consensus.cc:359] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.241894 31772 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:40.242507 31772 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.249243 31772 ts_tablet_manager.cc:1434] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:23:40.251911 31782 tablet_copy_client.cc:323] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:40.252310 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-e9e2b6ed092748a1a4b34148ab6d2923 received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:40.252761 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-e9e2b6ed092748a1a4b34148ab6d2923 on tablet e9e2b6ed092748a1a4b34148ab6d2923 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:40.254827 31778 tablet_copy_client.cc:806] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:40.255435 31778 tablet_copy_client.cc:670] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:40.255574 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet bbcdd6eee3294377852452b4989be45f from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:40.256129 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet bbcdd6eee3294377852452b4989be45f from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-bbcdd6eee3294377852452b4989be45f
I20260709 12:23:40.266127 30986 tablet_copy_source_session.cc:215] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:40.261168 31778 tablet_copy_client.cc:538] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:40.272519 31782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbcdd6eee3294377852452b4989be45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.278496 31778 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:40.311100 31778 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.311977 31778 tablet_bootstrap.cc:492] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:40.326987 31778 ts_tablet_manager.cc:1403] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.049s	user 0.031s	sys 0.003s
I20260709 12:23:40.330295 31778 raft_consensus.cc:359] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.331111 31778 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:40.334853 31778 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.337436 31778 ts_tablet_manager.cc:1434] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:40.338977 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-174b12b6011c47a2baad4ae805c60e15 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:40.339403 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-174b12b6011c47a2baad4ae805c60e15 on tablet 174b12b6011c47a2baad4ae805c60e15 with peer 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:23:40.373313 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 82387.3us
I20260709 12:23:40.388631 31782 tablet_copy_client.cc:806] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:40.389284 31782 tablet_copy_client.cc:670] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:40.397145 31621 raft_consensus.cc:1217] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.402299 31782 tablet_copy_client.cc:538] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:40.420145 31782 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:40.443301 31782 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:40.444228 31782 tablet_bootstrap.cc:492] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:40.444911 31782 ts_tablet_manager.cc:1403] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 12:23:40.448218 31782 raft_consensus.cc:359] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.449054 31782 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:40.450093 31782 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:40.452806 31782 ts_tablet_manager.cc:1434] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:23:40.454955 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-bbcdd6eee3294377852452b4989be45f received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:40.455582 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-bbcdd6eee3294377852452b4989be45f on tablet bbcdd6eee3294377852452b4989be45f with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:40.570714 31621 raft_consensus.cc:1217] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.725421 31621 raft_consensus.cc:1217] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:40.757216 31621 raft_consensus.cc:1217] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:23:40.819216 31790 raft_consensus.cc:1064] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:40.822273 31790 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:23:40.861603 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 55584.2us
I20260709 12:23:40.870973 31621 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.873507 31703 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.879370 30967 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.887331 31792 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:40.888911 30898 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.895426 31790 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:40.926712 31792 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:40.930824 30967 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:40.928529 31621 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:40.952767 30796 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:40.953004 30898 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:40.981158 31787 raft_consensus.cc:1064] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:40.983705 31787 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:41.002677 31621 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.004195 31787 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.008509 30893 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.010967 31046 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.015064 31740 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.015990 31787 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:41.037245 31045 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:41.043371 31621 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.043972 30967 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.045508 31789 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.050000 31790 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.054231 31528 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.056188 30967 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.065588 31621 raft_consensus.cc:2955] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.074026 31786 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.077947 30797 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.084240 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af9423709bcf457ab89f49d71d157085 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.086615 31045 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.088343 30893 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.093775 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet af9423709bcf457ab89f49d71d157085 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:41.113149 31622 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.122318 31805 tablet_replica.cc:333] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:41.123382 31805 raft_consensus.cc:2243] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.124011 31805 raft_consensus.cc:2272] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.126223 30796 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.143748 31805 ts_tablet_manager.cc:1916] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.173020 31805 ts_tablet_manager.cc:1929] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.173405 31805 log.cc:1199] T af9423709bcf457ab89f49d71d157085 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/af9423709bcf457ab89f49d71d157085
I20260709 12:23:41.179627 30967 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:41.180455 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet af9423709bcf457ab89f49d71d157085 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:41.190732 31050 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.192076 31622 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.193917 31786 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.197918 31786 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.200551 31740 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.208724 31622 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.213721 31050 raft_consensus.cc:2955] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.223487 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9e2b6ed092748a1a4b34148ab6d2923 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.228164 30796 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.248044 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet e9e2b6ed092748a1a4b34148ab6d2923 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:41.248994 31805 tablet_replica.cc:333] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:41.249928 31805 raft_consensus.cc:2243] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.250607 31805 raft_consensus.cc:2272] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.258646 31805 ts_tablet_manager.cc:1916] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.281435 31805 ts_tablet_manager.cc:1929] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.281821 31805 log.cc:1199] T e9e2b6ed092748a1a4b34148ab6d2923 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/e9e2b6ed092748a1a4b34148ab6d2923
I20260709 12:23:41.283170 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet e9e2b6ed092748a1a4b34148ab6d2923 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:41.318075 31722 raft_consensus.cc:1064] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:41.320626 31722 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:41.334726 31622 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.336400 31050 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.336283 31695 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.337996 31695 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.345459 31787 raft_consensus.cc:1064] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:41.351823 30968 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:41.352866 31787 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:41.355013 31722 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.405771 31622 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:41.406287 31046 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:41.407090 31787 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.408382 30898 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:41.411783 31786 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.412669 31787 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.414424 31695 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.422969 31046 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.454186 30968 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.456000 31780 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.460431 31045 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.461290 30796 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.553958 31622 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.579238 30796 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:23:41.591769 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 46111.1us
I20260709 12:23:41.600649 31622 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.608954 30898 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:41.615530 31046 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.617136 31763 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.616117 30967 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:41.626283 31722 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.629000 31622 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:41.630522 31817 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.638415 31621 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:41.646353 31807 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.641942 31046 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.652294 31621 raft_consensus.cc:2955] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.658010 31787 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.665380 31622 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.672401 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 174b12b6011c47a2baad4ae805c60e15 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.673127 30795 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.678557 30898 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.684687 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 174b12b6011c47a2baad4ae805c60e15 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:41.687268 31819 tablet_replica.cc:333] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:41.696049 31819 raft_consensus.cc:2243] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.701207 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbcdd6eee3294377852452b4989be45f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:41.701424 31819 raft_consensus.cc:2272] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.705489 31819 ts_tablet_manager.cc:1916] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.706812 30799 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.709311 30898 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:41.724380 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet bbcdd6eee3294377852452b4989be45f with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:41.726999 31819 ts_tablet_manager.cc:1929] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:41.727502 31819 log.cc:1199] T 174b12b6011c47a2baad4ae805c60e15 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/174b12b6011c47a2baad4ae805c60e15
I20260709 12:23:41.733466 31821 tablet_replica.cc:333] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:41.734402 31821 raft_consensus.cc:2243] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.734913 31821 raft_consensus.cc:2272] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.738049 31821 ts_tablet_manager.cc:1916] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:41.758957 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 174b12b6011c47a2baad4ae805c60e15 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:41.777493 31787 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:41.797135 30898 raft_consensus.cc:2955] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:41.855837 31821 ts_tablet_manager.cc:1929] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:41.856695 31821 log.cc:1199] T bbcdd6eee3294377852452b4989be45f P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/bbcdd6eee3294377852452b4989be45f
I20260709 12:23:41.859350 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet bbcdd6eee3294377852452b4989be45f (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:42.799444 30901 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:42.805058 31050 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:42.805531 30867 consensus_peers.cc:597] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7010d5d8a0647a9ab67a7f9250845ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.806361 30975 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.806305 31763 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.807667 31807 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.814297 31695 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.816905 31050 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.818380 30975 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.833288 30799 catalog_manager.cc:5697] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.836983 30901 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
W20260709 12:23:42.849123 30867 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8311babaa554788b3a614d3f27a53f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.850625 31050 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.850968 30971 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.852134 31695 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.853379 31825 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.866058 31695 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.878391 30976 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:42.878131 31050 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.882404 30971 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.889618 30798 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.911656 31050 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:42.912145 30942 consensus_peers.cc:597] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d26d779b278e4014b0368920ddf7529f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.912897 30901 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.913224 31787 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.914390 31786 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.920738 31834 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.922573 31045 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.923223 30901 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.936216 30901 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:42.939882 30795 catalog_manager.cc:5697] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.960906 31045 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.961705 30971 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:42.963186 31695 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:42.964733 31695 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:42.965431 30867 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2426f61afbf24698969bfa651d747ae9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.975862 31825 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.977526 31050 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.984126 30971 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:42.995527 30798 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.184005 31841 ts_tablet_manager.cc:933] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:43.186115 31841 tablet_copy_client.cc:323] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:43.187917 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet f7010d5d8a0647a9ab67a7f9250845ea from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:43.188483 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet f7010d5d8a0647a9ab67a7f9250845ea from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-f7010d5d8a0647a9ab67a7f9250845ea
I20260709 12:23:43.195226 30911 tablet_copy_source_session.cc:215] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:43.198623 31841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7010d5d8a0647a9ab67a7f9250845ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:43.211349 31841 tablet_copy_client.cc:806] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.211997 31841 tablet_copy_client.cc:670] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.228585 31841 tablet_copy_client.cc:538] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.235780 31841 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:43.255810 31841 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.257948 31841 tablet_bootstrap.cc:492] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:43.258682 31841 ts_tablet_manager.cc:1403] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 12:23:43.261827 31841 raft_consensus.cc:359] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.262646 31841 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:43.263293 31841 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.266702 31841 ts_tablet_manager.cc:1434] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:43.268950 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f7010d5d8a0647a9ab67a7f9250845ea received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:43.269393 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f7010d5d8a0647a9ab67a7f9250845ea on tablet f7010d5d8a0647a9ab67a7f9250845ea with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:43.385821 31841 ts_tablet_manager.cc:933] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:43.387493 31841 tablet_copy_client.cc:323] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:43.388851 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 2426f61afbf24698969bfa651d747ae9 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:43.389370 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 2426f61afbf24698969bfa651d747ae9 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-2426f61afbf24698969bfa651d747ae9
I20260709 12:23:43.399889 30911 tablet_copy_source_session.cc:215] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:43.403165 31841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2426f61afbf24698969bfa651d747ae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:43.414690 31841 tablet_copy_client.cc:806] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.415194 31841 tablet_copy_client.cc:670] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.420883 31841 tablet_copy_client.cc:538] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.430331 31841 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:43.448576 31841 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.449419 31841 tablet_bootstrap.cc:492] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:43.450042 31841 ts_tablet_manager.cc:1403] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:23:43.452760 31841 raft_consensus.cc:359] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.453528 31841 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:43.454178 31841 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.458407 31841 ts_tablet_manager.cc:1434] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:43.461016 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-2426f61afbf24698969bfa651d747ae9 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:43.461424 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-2426f61afbf24698969bfa651d747ae9 on tablet 2426f61afbf24698969bfa651d747ae9 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:43.463933 31841 ts_tablet_manager.cc:933] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:43.472226 31841 tablet_copy_client.cc:323] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:43.473193 31847 ts_tablet_manager.cc:933] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:43.474309 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet d26d779b278e4014b0368920ddf7529f from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:43.474887 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet d26d779b278e4014b0368920ddf7529f from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-d26d779b278e4014b0368920ddf7529f
I20260709 12:23:43.475131 31847 tablet_copy_client.cc:323] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:43.476718 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet f8311babaa554788b3a614d3f27a53f4 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:43.477218 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet f8311babaa554788b3a614d3f27a53f4 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-f8311babaa554788b3a614d3f27a53f4
I20260709 12:23:43.485060 30911 tablet_copy_source_session.cc:215] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:43.493232 30986 tablet_copy_source_session.cc:215] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:43.496739 31841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26d779b278e4014b0368920ddf7529f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:43.508201 31847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8311babaa554788b3a614d3f27a53f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:43.527179 31841 tablet_copy_client.cc:806] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.527698 31841 tablet_copy_client.cc:670] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.530550 31847 tablet_copy_client.cc:806] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.531064 31847 tablet_copy_client.cc:670] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.531988 31841 tablet_copy_client.cc:538] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.535760 31847 tablet_copy_client.cc:538] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.540390 31841 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:43.548796 31847 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:43.575423 31841 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.576468 31841 tablet_bootstrap.cc:492] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:43.577068 31841 ts_tablet_manager.cc:1403] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.013s
I20260709 12:23:43.579664 31841 raft_consensus.cc:359] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.580443 31841 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:43.581307 31622 raft_consensus.cc:1217] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.581038 31841 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.590710 31841 ts_tablet_manager.cc:1434] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:23:43.592312 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-d26d779b278e4014b0368920ddf7529f received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:43.592746 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-d26d779b278e4014b0368920ddf7529f on tablet d26d779b278e4014b0368920ddf7529f with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:43.604427 31847 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:43.605430 31847 tablet_bootstrap.cc:492] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:43.606135 31847 ts_tablet_manager.cc:1403] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.058s	user 0.029s	sys 0.000s
I20260709 12:23:43.609133 31847 raft_consensus.cc:359] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.610100 31847 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:43.610736 31847 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:43.613222 31847 ts_tablet_manager.cc:1434] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:43.615517 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f8311babaa554788b3a614d3f27a53f4 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:43.615896 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f8311babaa554788b3a614d3f27a53f4 on tablet f8311babaa554788b3a614d3f27a53f4 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:43.885238 31622 raft_consensus.cc:1217] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.961159 31622 raft_consensus.cc:1217] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.996119 31695 raft_consensus.cc:1064] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:43.997738 31695 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.004735 31622 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.006204 31046 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.007766 31807 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.018921 31855 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.029891 31807 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.035849 31046 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.041872 31622 raft_consensus.cc:1217] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:44.071059 30971 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.135654 31861 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:44.152648 30795 catalog_manager.cc:5697] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:23:44.156549 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 99117.4us
I20260709 12:23:44.159229 31622 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.199539 30971 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.233821 30901 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.239535 31622 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.239951 31045 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.241295 31825 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.242188 31856 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.246989 31825 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.249488 31622 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.251225 31045 raft_consensus.cc:2955] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.258163 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7010d5d8a0647a9ab67a7f9250845ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.267922 30799 catalog_manager.cc:5697] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.278280 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet f7010d5d8a0647a9ab67a7f9250845ea with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:44.280241 31871 tablet_replica.cc:333] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:44.282305 31871 raft_consensus.cc:2243] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.282899 31871 raft_consensus.cc:2272] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.286046 31871 ts_tablet_manager.cc:1916] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.303068 31871 ts_tablet_manager.cc:1929] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.303479 31871 log.cc:1199] T f7010d5d8a0647a9ab67a7f9250845ea P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/f7010d5d8a0647a9ab67a7f9250845ea
I20260709 12:23:44.305104 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet f7010d5d8a0647a9ab67a7f9250845ea (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:44.449891 31825 raft_consensus.cc:1064] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:44.452476 31825 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.459054 31622 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.459837 31045 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.460624 31825 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.461575 30971 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.461508 31856 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.464498 31862 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:44.471992 31853 raft_consensus.cc:1064] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:44.474349 31853 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.496213 31621 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.497772 30901 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.497925 31046 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.499514 31870 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:44.499845 31856 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.503520 31622 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.506536 31870 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.506141 31046 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.509641 31868 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:44.526022 30795 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.531025 31825 raft_consensus.cc:1064] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:44.533535 31825 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.545631 30971 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.549288 31837 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.559862 31622 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.561833 31860 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:44.566170 30901 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.569742 30968 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.573369 31860 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.582760 31045 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.552685 31046 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.587406 31621 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.589059 30971 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.588837 31862 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:44.589514 31860 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.591274 31807 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.599803 31624 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.600543 31825 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.602114 30901 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.607232 31621 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.614392 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2426f61afbf24698969bfa651d747ae9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.616755 30799 catalog_manager.cc:5697] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.622303 30968 raft_consensus.cc:2955] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.637346 31862 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.638679 30976 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.646795 31622 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.648875 31863 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.653501 31046 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.663615 31051 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.665225 31623 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.656225 31621 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.666340 31837 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.667943 31863 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.669528 30798 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.678476 30798 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.664335 30971 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.688647 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d26d779b278e4014b0368920ddf7529f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.688535 31045 raft_consensus.cc:2955] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.744688 30796 catalog_manager.cc:5697] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.749069 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2426f61afbf24698969bfa651d747ae9 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:44.754640 30901 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:44.761247 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet d26d779b278e4014b0368920ddf7529f with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:44.762449 31885 tablet_replica.cc:333] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:44.763598 31885 raft_consensus.cc:2243] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.764346 31885 raft_consensus.cc:2272] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.766573 31621 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.768009 31051 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:44.769750 31859 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:44.771533 31860 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:44.774075 31885 ts_tablet_manager.cc:1916] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.779821 31860 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.784536 31051 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.790805 31885 ts_tablet_manager.cc:1929] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.793383 31885 log.cc:1199] T 2426f61afbf24698969bfa651d747ae9 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/2426f61afbf24698969bfa651d747ae9
I20260709 12:23:44.798671 31621 raft_consensus.cc:2955] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:44.799585 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet 2426f61afbf24698969bfa651d747ae9 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:44.779575 31886 tablet_replica.cc:333] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:44.800958 31886 raft_consensus.cc:2243] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.801745 31886 raft_consensus.cc:2272] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.807446 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8311babaa554788b3a614d3f27a53f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:44.811185 31886 ts_tablet_manager.cc:1916] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.818411 30798 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.833313 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet f8311babaa554788b3a614d3f27a53f4 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:44.837916 31886 ts_tablet_manager.cc:1929] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.838306 31886 log.cc:1199] T d26d779b278e4014b0368920ddf7529f P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/d26d779b278e4014b0368920ddf7529f
I20260709 12:23:44.840277 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet d26d779b278e4014b0368920ddf7529f (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:44.841638 31887 tablet_replica.cc:333] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:44.842496 31887 raft_consensus.cc:2243] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:44.843101 31887 raft_consensus.cc:2272] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:44.845803 31887 ts_tablet_manager.cc:1916] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:44.856312 31887 ts_tablet_manager.cc:1929] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:44.856626 31887 log.cc:1199] T f8311babaa554788b3a614d3f27a53f4 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/f8311babaa554788b3a614d3f27a53f4
I20260709 12:23:44.858047 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet f8311babaa554788b3a614d3f27a53f4 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:45.906960 30967 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
W20260709 12:23:45.912658 30942 consensus_peers.cc:597] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b8a0dad5f8a44e9b54943368c8d3758. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.912819 31051 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:45.913091 30898 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:45.913926 31863 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:45.914665 31890 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:45.922531 31863 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:45.925179 30898 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:45.926682 31051 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:45.939677 30971 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:45.941197 30797 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:23:45.946460 30942 consensus_peers.cc:597] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c42f8452db3546feaba1bef22141480f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.947144 31051 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:45.948246 31890 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:45.950938 30898 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:45.952346 31890 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:45.956314 31863 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:45.964581 31051 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:45.971450 30901 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:45.974794 30898 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:45.980203 30795 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:45.990406 30867 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cce46c39c1e64c35bd5af558239d31e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.993180 30971 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:45.994078 31051 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:45.994580 31860 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:45.995357 31862 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.004976 31862 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.006385 31051 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.008576 30971 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.018715 31051 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.024537 30798 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.057410 30971 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.058074 30901 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:46.058821 31904 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:46.059773 31884 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:46.062314 31016 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 412c07102f934870a9035bbc8463f79a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:46.070400 31789 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.071579 30971 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.073553 30898 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.088387 30797 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:46.312990 31907 ts_tablet_manager.cc:933] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:46.326541 31907 tablet_copy_client.cc:323] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:46.328473 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet 8b8a0dad5f8a44e9b54943368c8d3758 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:46.328996 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet 8b8a0dad5f8a44e9b54943368c8d3758 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-8b8a0dad5f8a44e9b54943368c8d3758
I20260709 12:23:46.335992 30986 tablet_copy_source_session.cc:215] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.339306 31907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8a0dad5f8a44e9b54943368c8d3758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.361121 31907 tablet_copy_client.cc:806] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.361732 31907 tablet_copy_client.cc:670] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.366868 31907 tablet_copy_client.cc:538] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.375312 31907 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:46.395057 31907 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.395931 31907 tablet_bootstrap.cc:492] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:46.396997 31907 ts_tablet_manager.cc:1403] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 12:23:46.399827 31907 raft_consensus.cc:359] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.400620 31907 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:46.401229 31907 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.404865 31907 ts_tablet_manager.cc:1434] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:23:46.406625 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-8b8a0dad5f8a44e9b54943368c8d3758 received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:46.406893 31912 ts_tablet_manager.cc:933] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:46.407027 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-8b8a0dad5f8a44e9b54943368c8d3758 on tablet 8b8a0dad5f8a44e9b54943368c8d3758 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:46.413496 31912 tablet_copy_client.cc:323] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:46.417042 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet c42f8452db3546feaba1bef22141480f from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:46.417539 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet c42f8452db3546feaba1bef22141480f from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-c42f8452db3546feaba1bef22141480f
I20260709 12:23:46.423699 30986 tablet_copy_source_session.cc:215] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.426092 31912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f8452db3546feaba1bef22141480f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.438001 31912 tablet_copy_client.cc:806] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.438432 31912 tablet_copy_client.cc:670] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.441768 31912 tablet_copy_client.cc:538] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.448695 31912 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:46.464629 31912 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.465272 31912 tablet_bootstrap.cc:492] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:46.465773 31912 ts_tablet_manager.cc:1403] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:23:46.468565 31912 raft_consensus.cc:359] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.469370 31912 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:46.469973 31912 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.472571 31912 ts_tablet_manager.cc:1434] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:23:46.474167 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c42f8452db3546feaba1bef22141480f received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:46.474558 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c42f8452db3546feaba1bef22141480f on tablet c42f8452db3546feaba1bef22141480f with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:46.514031 31912 ts_tablet_manager.cc:933] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:46.515470 31912 tablet_copy_client.cc:323] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:46.517058 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet cce46c39c1e64c35bd5af558239d31e0 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:46.517571 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet cce46c39c1e64c35bd5af558239d31e0 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-cce46c39c1e64c35bd5af558239d31e0
I20260709 12:23:46.524876 30911 tablet_copy_source_session.cc:215] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.527772 31912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce46c39c1e64c35bd5af558239d31e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.538017 31912 tablet_copy_client.cc:806] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.538579 31912 tablet_copy_client.cc:670] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.541898 31912 tablet_copy_client.cc:538] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.547839 31912 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:46.566031 31912 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.566793 31912 tablet_bootstrap.cc:492] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:46.567294 31912 ts_tablet_manager.cc:1403] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 12:23:46.569875 31912 raft_consensus.cc:359] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.570628 31912 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:46.571259 31912 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.573992 31912 ts_tablet_manager.cc:1434] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 12:23:46.576162 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-cce46c39c1e64c35bd5af558239d31e0 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:46.576633 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-cce46c39c1e64c35bd5af558239d31e0 on tablet cce46c39c1e64c35bd5af558239d31e0 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:46.620435 31912 ts_tablet_manager.cc:933] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:46.631580 31912 tablet_copy_client.cc:323] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:23:46.633975 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 412c07102f934870a9035bbc8463f79a from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:23:46.634510 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 412c07102f934870a9035bbc8463f79a from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-412c07102f934870a9035bbc8463f79a
I20260709 12:23:46.641680 31061 tablet_copy_source_session.cc:215] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:46.645927 31912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412c07102f934870a9035bbc8463f79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:46.656456 31912 tablet_copy_client.cc:806] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:46.656884 31912 tablet_copy_client.cc:670] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:46.660209 31912 tablet_copy_client.cc:538] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:46.666456 31912 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:46.682077 31912 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:46.682859 31912 tablet_bootstrap.cc:492] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:46.683465 31912 ts_tablet_manager.cc:1403] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 12:23:46.686108 31912 raft_consensus.cc:359] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.686821 31912 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:46.687364 31912 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:46.689414 31912 ts_tablet_manager.cc:1434] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:46.693827 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-412c07102f934870a9035bbc8463f79a received from {username='slave'} at 127.0.0.1:34990
I20260709 12:23:46.694278 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-412c07102f934870a9035bbc8463f79a on tablet 412c07102f934870a9035bbc8463f79a with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:46.856035 31623 raft_consensus.cc:1217] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:46.883039 31623 raft_consensus.cc:1217] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:23:46.957435 31623 raft_consensus.cc:1217] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:47.073199 31623 raft_consensus.cc:1217] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:47.395040 31909 raft_consensus.cc:1064] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:47.397742 31909 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.409421 31862 raft_consensus.cc:1064] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:47.412240 31862 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.430578 31623 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.434286 31863 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.437458 31621 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.439005 31919 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.443050 31924 raft_consensus.cc:1064] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:47.446249 31924 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.451288 31051 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.452945 30971 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.453392 30901 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.455022 31051 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.454998 31890 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:47.452674 31862 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:23:47.457029 31922 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.457827 31863 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.484921 31045 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.489566 30898 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.489952 31922 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.484957 31863 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.494410 30971 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.498634 31051 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.506981 31621 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.512799 30795 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.515704 31046 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:47.524230 31789 raft_consensus.cc:1064] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:47.526645 31789 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.528585 31890 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.531620 31623 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:47.536741 31909 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:47.537556 31623 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.560120 30901 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:47.574884 31863 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.588902 30971 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.589687 31623 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.590799 31789 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.591140 30901 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:47.592875 31938 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.593220 31924 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.600791 31884 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:47.604878 31623 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.619947 31051 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.628513 31920 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.630280 30896 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.670132 30896 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.673312 30967 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.677443 31621 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.752655 30796 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.754717 30896 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.770020 30797 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.771571 30797 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.774590 31621 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.775607 31045 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.793474 31922 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.798359 31860 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.808432 31860 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.815116 31621 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.818957 30967 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.819053 30971 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.825660 31623 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.825621 31051 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:47.829205 31934 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.836616 30796 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.829692 31623 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:47.832010 30898 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.841895 31623 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.842626 31890 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.843344 30898 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.845392 31045 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:47.847812 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet cce46c39c1e64c35bd5af558239d31e0 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:47.845324 31890 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.851027 31789 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.856568 31924 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.856662 31789 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.858356 31863 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:47.860299 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cce46c39c1e64c35bd5af558239d31e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:47.862560 31863 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.863436 30898 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.865837 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c42f8452db3546feaba1bef22141480f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:47.869027 31938 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.874876 31947 tablet_replica.cc:333] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:47.877628 30896 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.879825 30798 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.881376 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 412c07102f934870a9035bbc8463f79a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:23:47.881858 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 70163.4us
I20260709 12:23:47.885985 31051 raft_consensus.cc:2955] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.890425 31624 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.875929 31947 raft_consensus.cc:2243] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.892237 31947 raft_consensus.cc:2272] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.897433 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet c42f8452db3546feaba1bef22141480f with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:47.909914 31947 ts_tablet_manager.cc:1916] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:47.915226 31045 raft_consensus.cc:2955] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.912165 31621 raft_consensus.cc:2955] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.921293 31623 raft_consensus.cc:2955] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.926250 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b8a0dad5f8a44e9b54943368c8d3758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:47.934810 30796 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.943869 30797 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:47.949118 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b8a0dad5f8a44e9b54943368c8d3758 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:47.959072 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 412c07102f934870a9035bbc8463f79a with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:47.961153 31948 tablet_replica.cc:333] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:47.962432 31948 raft_consensus.cc:2243] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.963122 31948 raft_consensus.cc:2272] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.970583 31948 ts_tablet_manager.cc:1916] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:47.975975 31950 tablet_replica.cc:333] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:47.976909 31950 raft_consensus.cc:2243] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.977682 31950 raft_consensus.cc:2272] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.982868 31950 ts_tablet_manager.cc:1916] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:23:47.992316 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 51998.4us
I20260709 12:23:47.998484 31947 ts_tablet_manager.cc:1929] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:48.000483 31947 log.cc:1199] T cce46c39c1e64c35bd5af558239d31e0 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/cce46c39c1e64c35bd5af558239d31e0
I20260709 12:23:48.002075 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet cce46c39c1e64c35bd5af558239d31e0 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:48.003173 31947 tablet_replica.cc:333] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:48.010890 31948 ts_tablet_manager.cc:1929] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:48.011458 31948 log.cc:1199] T c42f8452db3546feaba1bef22141480f P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/c42f8452db3546feaba1bef22141480f
I20260709 12:23:48.012239 31947 raft_consensus.cc:2243] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:48.013042 31947 raft_consensus.cc:2272] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:48.013298 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet c42f8452db3546feaba1bef22141480f (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:48.013684 31950 ts_tablet_manager.cc:1929] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:48.014081 31950 log.cc:1199] T 8b8a0dad5f8a44e9b54943368c8d3758 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/8b8a0dad5f8a44e9b54943368c8d3758
I20260709 12:23:48.015919 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 8b8a0dad5f8a44e9b54943368c8d3758 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:48.016552 31947 ts_tablet_manager.cc:1916] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:48.029443 31947 ts_tablet_manager.cc:1929] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:48.029893 31947 log.cc:1199] T 412c07102f934870a9035bbc8463f79a P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/412c07102f934870a9035bbc8463f79a
I20260709 12:23:48.031293 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 412c07102f934870a9035bbc8463f79a (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:49.048152 30901 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
W20260709 12:23:49.054181 30867 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6741df8b39c94364bb06b6b75ab50bac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.054211 31045 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.054590 30967 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.055635 31922 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.056502 31919 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.076787 30971 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.076815 31919 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.081197 31045 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.092832 31051 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.097730 30797 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.103408 30971 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.104581 30901 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:49.104810 31016 consensus_peers.cc:597] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 404ba35beca1446e838b7d720c8a6281. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.104842 31789 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:49.106148 31938 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:49.144526 30896 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.140785 31938 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.157604 30971 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.165441 30796 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.175779 31051 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.189559 30896 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:49.192157 31016 consensus_peers.cc:597] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9ebc983d26c40eda93f030abf94ac78. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.191453 30971 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.192904 31965 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.195585 31789 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.206019 31789 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.207837 30896 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.208643 30971 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.219142 31050 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.226042 30796 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:23:49.227941 31016 consensus_peers.cc:597] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b078c36427749489d90f67c6504ea82. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:49.228996 30971 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.228945 30896 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:49.237380 31969 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.238243 31789 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:49.247402 31938 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.248760 30896 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.252972 30971 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.269276 30798 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:49.490912 31972 ts_tablet_manager.cc:933] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:49.492769 31972 tablet_copy_client.cc:323] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:23:49.494104 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 404ba35beca1446e838b7d720c8a6281 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:23:49.494613 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 404ba35beca1446e838b7d720c8a6281 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-404ba35beca1446e838b7d720c8a6281
I20260709 12:23:49.502447 31061 tablet_copy_source_session.cc:215] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.507853 31972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404ba35beca1446e838b7d720c8a6281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.523347 31972 tablet_copy_client.cc:806] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.523976 31972 tablet_copy_client.cc:670] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.527398 31972 tablet_copy_client.cc:538] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.535807 31972 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:49.556380 31972 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.557332 31972 tablet_bootstrap.cc:492] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:49.558248 31972 ts_tablet_manager.cc:1403] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.007s
I20260709 12:23:49.561273 31972 raft_consensus.cc:359] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.562307 31972 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:49.563019 31972 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.573040 31972 ts_tablet_manager.cc:1434] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:23:49.574963 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-404ba35beca1446e838b7d720c8a6281 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:23:49.575418 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-404ba35beca1446e838b7d720c8a6281 on tablet 404ba35beca1446e838b7d720c8a6281 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:49.586269 31972 ts_tablet_manager.cc:933] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:49.589499 31972 tablet_copy_client.cc:323] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:49.599475 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 6741df8b39c94364bb06b6b75ab50bac from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:49.600057 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 6741df8b39c94364bb06b6b75ab50bac from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-6741df8b39c94364bb06b6b75ab50bac
I20260709 12:23:49.608500 30911 tablet_copy_source_session.cc:215] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.611404 31972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6741df8b39c94364bb06b6b75ab50bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.628096 31972 tablet_copy_client.cc:806] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.628711 31972 tablet_copy_client.cc:670] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.631991 31972 tablet_copy_client.cc:538] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.638111 31972 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:49.653527 31972 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.654277 31972 tablet_bootstrap.cc:492] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:49.654784 31972 ts_tablet_manager.cc:1403] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:23:49.657438 31972 raft_consensus.cc:359] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.657998 31972 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:49.658457 31972 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.660410 31972 ts_tablet_manager.cc:1434] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:23:49.662146 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-6741df8b39c94364bb06b6b75ab50bac received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:49.662523 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-6741df8b39c94364bb06b6b75ab50bac on tablet 6741df8b39c94364bb06b6b75ab50bac with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:49.762487 31972 ts_tablet_manager.cc:933] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:49.764171 31972 tablet_copy_client.cc:323] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:23:49.766373 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet b9ebc983d26c40eda93f030abf94ac78 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:23:49.766945 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet b9ebc983d26c40eda93f030abf94ac78 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-b9ebc983d26c40eda93f030abf94ac78
I20260709 12:23:49.774550 31061 tablet_copy_source_session.cc:215] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.777403 31972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ebc983d26c40eda93f030abf94ac78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.791465 31972 tablet_copy_client.cc:806] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.791999 31972 tablet_copy_client.cc:670] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.795331 31972 tablet_copy_client.cc:538] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.802214 31972 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:49.816553 31975 ts_tablet_manager.cc:933] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:49.825068 31975 tablet_copy_client.cc:323] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:23:49.826812 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 9b078c36427749489d90f67c6504ea82 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:23:49.827337 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 9b078c36427749489d90f67c6504ea82 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-9b078c36427749489d90f67c6504ea82
I20260709 12:23:49.828406 31972 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.829231 31972 tablet_bootstrap.cc:492] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:49.829730 31972 ts_tablet_manager.cc:1403] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.001s
I20260709 12:23:49.831995 31972 raft_consensus.cc:359] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.832703 31972 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:49.833575 31972 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.836561 31972 ts_tablet_manager.cc:1434] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:49.839385 31060 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-b9ebc983d26c40eda93f030abf94ac78 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:23:49.839845 31060 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-b9ebc983d26c40eda93f030abf94ac78 on tablet b9ebc983d26c40eda93f030abf94ac78 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:49.838500 31061 tablet_copy_source_session.cc:215] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.852430 31975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b078c36427749489d90f67c6504ea82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.870648 31975 tablet_copy_client.cc:806] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.871251 31975 tablet_copy_client.cc:670] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.875370 31975 tablet_copy_client.cc:538] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.886919 31975 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:49.908008 31975 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.908891 31975 tablet_bootstrap.cc:492] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:49.909523 31975 ts_tablet_manager.cc:1403] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 12:23:49.912380 31975 raft_consensus.cc:359] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.913175 31975 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:49.913777 31975 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:49.916113 31975 ts_tablet_manager.cc:1434] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:49.917737 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-9b078c36427749489d90f67c6504ea82 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:23:49.918144 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-9b078c36427749489d90f67c6504ea82 on tablet 9b078c36427749489d90f67c6504ea82 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:49.996181 31623 raft_consensus.cc:1217] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.096601 31623 raft_consensus.cc:1217] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.255558 31623 raft_consensus.cc:1217] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.354081 31623 raft_consensus.cc:1217] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:50.540062 31955 raft_consensus.cc:1064] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:50.542528 31955 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:50.549057 31623 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.550496 31946 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.550993 31050 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.552522 31955 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.554306 30975 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.559608 31946 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.566283 31955 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.572419 31051 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.588528 31623 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.594312 30798 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:50.605964 30975 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.632232 30901 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:50.636351 31623 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.637784 31993 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.638651 30975 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.640550 31993 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.677829 31955 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.680143 31623 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.689045 30975 raft_consensus.cc:2955] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.710737 30796 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.717778 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6741df8b39c94364bb06b6b75ab50bac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.714200 31985 raft_consensus.cc:1064] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:50.726692 31985 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:50.740684 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet 6741df8b39c94364bb06b6b75ab50bac with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:50.752663 31999 tablet_replica.cc:333] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:50.756487 31999 raft_consensus.cc:2243] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.757251 31999 raft_consensus.cc:2272] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.760114 30971 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.761057 31999 ts_tablet_manager.cc:1916] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:50.761368 30901 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.763165 31623 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.763459 31964 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.765410 31964 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.766498 31981 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.777415 31999 ts_tablet_manager.cc:1929] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:50.777988 31999 log.cc:1199] T 6741df8b39c94364bb06b6b75ab50bac P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/6741df8b39c94364bb06b6b75ab50bac
I20260709 12:23:50.779789 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet 6741df8b39c94364bb06b6b75ab50bac (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:50.794725 31981 raft_consensus.cc:1064] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:50.798760 31981 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:50.801939 31964 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.807878 31623 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.815459 30898 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.830036 30798 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.811992 30971 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.870265 31045 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:50.877177 31623 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.877290 30975 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.883121 31964 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.883968 31623 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.885283 31986 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.896358 31964 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:50.910486 31623 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.909148 31986 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:23:50.916515 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 63569.6us
I20260709 12:23:50.920001 30901 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.923444 31985 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.926043 30975 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.941855 30796 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.948793 31985 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.957489 31985 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.962388 30975 raft_consensus.cc:2955] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:50.967942 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 404ba35beca1446e838b7d720c8a6281 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:50.972529 30898 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:23:51.034621 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 45704.4us
I20260709 12:23:51.100421 30796 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.105165 32009 tablet_replica.cc:333] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:51.144148 32009 raft_consensus.cc:2243] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.144897 32009 raft_consensus.cc:2272] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:51.149199 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 122423us
I20260709 12:23:51.155314 32009 ts_tablet_manager.cc:1916] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.157923 31964 raft_consensus.cc:1064] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:51.159863 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 404ba35beca1446e838b7d720c8a6281 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:51.161479 31964 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:23:51.178733 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 50895.7us
I20260709 12:23:51.181782 30976 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.193292 32009 ts_tablet_manager.cc:1929] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:51.200443 31623 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.216666 32009 log.cc:1199] T 404ba35beca1446e838b7d720c8a6281 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/404ba35beca1446e838b7d720c8a6281
I20260709 12:23:51.219671 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 404ba35beca1446e838b7d720c8a6281 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:51.220297 31621 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.221740 32014 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.220214 30898 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.224109 32014 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.228828 31045 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:51.231544 30968 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.235056 31624 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.236541 32022 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:51.237018 30901 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.238438 32014 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:51.246361 31981 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.246601 32018 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.253623 30896 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.254914 31624 raft_consensus.cc:2955] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.257599 30901 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.261514 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b078c36427749489d90f67c6504ea82 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:51.262218 31964 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.264508 31621 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.283372 30798 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.295501 30968 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.309544 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b078c36427749489d90f67c6504ea82 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:51.308471 30796 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:51.319993 32028 tablet_replica.cc:333] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:51.324980 32028 raft_consensus.cc:2243] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:51.331413 32028 raft_consensus.cc:2272] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:51.334508 32028 ts_tablet_manager.cc:1916] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:51.348443 32028 ts_tablet_manager.cc:1929] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:51.348896 32028 log.cc:1199] T 9b078c36427749489d90f67c6504ea82 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/9b078c36427749489d90f67c6504ea82
I20260709 12:23:51.350512 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 9b078c36427749489d90f67c6504ea82 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:51.870508 31045 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:51.904963 31621 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.907042 31985 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:51.907466 30967 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:51.910964 31985 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:51.918197 31964 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.921525 31624 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.943300 30967 raft_consensus.cc:2955] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:51.995584 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9ebc983d26c40eda93f030abf94ac78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:52.005748 30797 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:52.080183 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet b9ebc983d26c40eda93f030abf94ac78 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:52.093094 32039 tablet_replica.cc:333] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:52.094223 32039 raft_consensus.cc:2243] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.095050 32039 raft_consensus.cc:2272] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.098160 32039 ts_tablet_manager.cc:1916] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:52.111009 32039 ts_tablet_manager.cc:1929] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:52.111330 32039 log.cc:1199] T b9ebc983d26c40eda93f030abf94ac78 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/b9ebc983d26c40eda93f030abf94ac78
I20260709 12:23:52.113090 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet b9ebc983d26c40eda93f030abf94ac78 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:53.164839 30967 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.171346 31045 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:53.172037 30901 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:53.172787 30942 consensus_peers.cc:597] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2b6f99bf7a54d65868d8e55cbb466b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.172807 32040 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:53.173800 32020 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:53.182688 32040 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.184281 31045 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.190202 30901 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.197574 30967 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.199558 30798 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:53.208827 30942 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a623118fdd9441959cededdcb6981b04. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.215066 31045 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:53.216176 30901 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:53.218269 32015 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:53.219132 32020 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:53.238539 32020 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.241849 30901 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.247491 31046 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.258311 31045 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.274662 30967 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:53.276026 30901 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:53.277491 31964 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:53.278319 32018 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:53.279562 30797 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:23:53.281157 31016 consensus_peers.cc:597] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1166342933745c5b82da4ee4032736c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.289939 30896 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.288233 32018 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.297091 30968 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.317240 30797 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.322974 30896 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.333491 31045 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:53.334331 30968 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:53.335038 31946 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:53.337798 30867 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4045483bdd0047e8a04aade3faadf9d6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:53.338613 32048 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:53.358065 31946 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.361531 31045 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.361932 30968 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:53.376346 30798 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:53.685750 32062 ts_tablet_manager.cc:933] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:53.691473 32062 tablet_copy_client.cc:323] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:53.693511 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet d2b6f99bf7a54d65868d8e55cbb466b0 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:53.693964 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet d2b6f99bf7a54d65868d8e55cbb466b0 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-d2b6f99bf7a54d65868d8e55cbb466b0
I20260709 12:23:53.701277 30986 tablet_copy_source_session.cc:215] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.704023 32062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2b6f99bf7a54d65868d8e55cbb466b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.717087 32062 tablet_copy_client.cc:806] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.717617 32062 tablet_copy_client.cc:670] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.722036 32062 tablet_copy_client.cc:538] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.729065 32062 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:53.749346 32062 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.750142 32062 tablet_bootstrap.cc:492] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:53.750773 32062 ts_tablet_manager.cc:1403] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:23:53.752985 32062 raft_consensus.cc:359] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.753597 32062 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:53.754297 32062 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.783349 32062 ts_tablet_manager.cc:1434] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 12:23:53.789741 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-d2b6f99bf7a54d65868d8e55cbb466b0 received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:53.790233 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-d2b6f99bf7a54d65868d8e55cbb466b0 on tablet d2b6f99bf7a54d65868d8e55cbb466b0 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:53.794337 32062 ts_tablet_manager.cc:933] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:53.805549 32067 ts_tablet_manager.cc:933] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:53.806722 32062 tablet_copy_client.cc:323] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:53.807233 32068 ts_tablet_manager.cc:933] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:53.808837 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 4045483bdd0047e8a04aade3faadf9d6 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:53.809329 32068 tablet_copy_client.cc:323] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:53.809403 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 4045483bdd0047e8a04aade3faadf9d6 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-4045483bdd0047e8a04aade3faadf9d6
I20260709 12:23:53.818147 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet a623118fdd9441959cededdcb6981b04 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:53.818595 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet a623118fdd9441959cededdcb6981b04 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-a623118fdd9441959cededdcb6981b04
I20260709 12:23:53.825173 30986 tablet_copy_source_session.cc:215] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.827257 30911 tablet_copy_source_session.cc:215] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.830892 32068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a623118fdd9441959cededdcb6981b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.831640 32062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4045483bdd0047e8a04aade3faadf9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.838553 32067 tablet_copy_client.cc:323] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:23:53.840581 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet b1166342933745c5b82da4ee4032736c from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:23:53.841091 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet b1166342933745c5b82da4ee4032736c from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-b1166342933745c5b82da4ee4032736c
I20260709 12:23:53.849226 31061 tablet_copy_source_session.cc:215] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:53.853624 32062 tablet_copy_client.cc:806] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.854267 32062 tablet_copy_client.cc:670] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.856582 32067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1166342933745c5b82da4ee4032736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:53.859545 32062 tablet_copy_client.cc:538] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.870765 32062 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:53.874414 32068 tablet_copy_client.cc:806] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.875072 32068 tablet_copy_client.cc:670] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.883349 32068 tablet_copy_client.cc:538] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.889709 32067 tablet_copy_client.cc:806] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:53.890429 32067 tablet_copy_client.cc:670] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:53.893931 32068 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:53.898245 32067 tablet_copy_client.cc:538] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:53.910883 32067 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:53.930101 32062 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.933624 32062 tablet_bootstrap.cc:492] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:53.934291 32062 ts_tablet_manager.cc:1403] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.010s
I20260709 12:23:53.937183 32062 raft_consensus.cc:359] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.937990 32062 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:53.938694 32062 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.944207 32062 ts_tablet_manager.cc:1434] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:53.947093 32068 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.948601 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-4045483bdd0047e8a04aade3faadf9d6 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:53.948897 32068 tablet_bootstrap.cc:492] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:53.949047 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-4045483bdd0047e8a04aade3faadf9d6 on tablet 4045483bdd0047e8a04aade3faadf9d6 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:53.949559 32068 ts_tablet_manager.cc:1403] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.007s
I20260709 12:23:53.956830 32068 raft_consensus.cc:359] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.957934 32068 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:53.958595 32068 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.961268 32068 ts_tablet_manager.cc:1434] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:23:53.963531 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-a623118fdd9441959cededdcb6981b04 received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:53.963949 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-a623118fdd9441959cededdcb6981b04 on tablet a623118fdd9441959cededdcb6981b04 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:53.967118 32067 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:53.968277 32067 tablet_bootstrap.cc:492] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:53.968914 32067 ts_tablet_manager.cc:1403] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.003s
I20260709 12:23:53.971748 32067 raft_consensus.cc:359] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.972525 32067 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:53.973137 32067 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:53.975873 32067 ts_tablet_manager.cc:1434] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:23:53.977495 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-b1166342933745c5b82da4ee4032736c received from {username='slave'} at 127.0.0.1:34990
I20260709 12:23:53.977824 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-b1166342933745c5b82da4ee4032736c on tablet b1166342933745c5b82da4ee4032736c with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:54.134876 31624 raft_consensus.cc:1217] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:54.194969 31624 raft_consensus.cc:1217] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:54.219897 31624 raft_consensus.cc:1217] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:54.308157 31624 raft_consensus.cc:1217] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:54.569283 32015 raft_consensus.cc:1064] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:54.571513 32015 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:54.580147 31046 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.581470 30896 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.582094 31624 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.582198 32040 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.583271 32015 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.585037 32020 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.612632 32020 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.615855 31624 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.616504 31046 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.624696 30896 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.633551 30798 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.661321 30968 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:54.670990 30896 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.672468 32078 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.672518 31624 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.678740 32040 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.684000 32015 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.687387 30896 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.693486 32048 raft_consensus.cc:1064] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:54.694267 31623 raft_consensus.cc:2955] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.696398 32048 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:54.720765 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2b6f99bf7a54d65868d8e55cbb466b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:54.725147 30795 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.736387 31046 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.743933 31623 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.744663 32087 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.746874 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet d2b6f99bf7a54d65868d8e55cbb466b0 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:54.753458 31946 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.777781 30968 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.779444 32048 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.780162 32088 tablet_replica.cc:333] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:54.781337 32088 raft_consensus.cc:2243] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.782692 32088 raft_consensus.cc:2272] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.787431 32088 ts_tablet_manager.cc:1916] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.789331 32090 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.791654 31623 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.796324 30968 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.801635 31045 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.806701 30796 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.811970 32078 raft_consensus.cc:1064] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:54.812088 32058 raft_consensus.cc:1064] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:54.814359 32058 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:54.814500 32078 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:54.822727 30901 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:54.831049 31621 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.832533 31946 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.840011 31621 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.839316 31946 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.841459 32077 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.843258 31624 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.849337 31050 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.850693 30901 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.853021 32078 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.853791 32077 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.867254 32088 ts_tablet_manager.cc:1929] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:54.867908 32088 log.cc:1199] T d2b6f99bf7a54d65868d8e55cbb466b0 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/d2b6f99bf7a54d65868d8e55cbb466b0
I20260709 12:23:54.869863 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet d2b6f99bf7a54d65868d8e55cbb466b0 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:54.879813 31046 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.882392 30968 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.883983 31964 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.891887 30795 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.902112 31623 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.905112 32040 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.908223 30898 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.906847 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 4045483bdd0047e8a04aade3faadf9d6 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:54.911911 31622 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.923174 32075 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:54.927681 31045 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.937707 32107 tablet_replica.cc:333] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:54.940673 32107 raft_consensus.cc:2243] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.941440 30795 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:54.948416 32089 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:54.933974 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 47127.5us
I20260709 12:23:54.958407 30901 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:54.964861 31964 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:54.967698 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4045483bdd0047e8a04aade3faadf9d6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:54.970160 30968 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:54.965674 31050 raft_consensus.cc:2955] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:54.978053 32107 raft_consensus.cc:2272] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.980307 31624 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.990360 32107 ts_tablet_manager.cc:1916] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.990819 32040 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.994282 30896 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:23:54.995311 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 50647.7us
I20260709 12:23:55.007026 32040 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:55.012285 32105 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.014184 31621 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.069499 32077 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.076838 31622 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.087065 30901 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.091336 30898 raft_consensus.cc:2955] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.089707 32107 ts_tablet_manager.cc:1929] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:55.093977 32107 log.cc:1199] T 4045483bdd0047e8a04aade3faadf9d6 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/4045483bdd0047e8a04aade3faadf9d6
I20260709 12:23:55.095742 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 4045483bdd0047e8a04aade3faadf9d6 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:55.096727 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a623118fdd9441959cededdcb6981b04 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:55.105010 30796 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.110816 30968 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.114007 30797 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.131419 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet a623118fdd9441959cededdcb6981b04 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:55.132314 32088 tablet_replica.cc:333] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:55.133352 32088 raft_consensus.cc:2243] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:55.134058 32088 raft_consensus.cc:2272] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:55.137459 32088 ts_tablet_manager.cc:1916] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:55.150386 31045 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.156813 31624 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:55.159242 32075 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:55.162264 30968 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:55.162814 32088 ts_tablet_manager.cc:1929] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:55.163204 32088 log.cc:1199] T a623118fdd9441959cededdcb6981b04 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/a623118fdd9441959cededdcb6981b04
I20260709 12:23:55.165273 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet a623118fdd9441959cededdcb6981b04 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:55.165956 31964 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:55.176728 32075 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.179275 31621 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.180269 30968 raft_consensus.cc:2955] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.187436 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1166342933745c5b82da4ee4032736c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:55.189729 30795 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:55.194618 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:55.212685 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet b1166342933745c5b82da4ee4032736c with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:55.214323 32110 tablet_replica.cc:333] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:23:55.215569 32110 raft_consensus.cc:2243] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:55.216488 32110 raft_consensus.cc:2272] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:55.219619 32110 ts_tablet_manager.cc:1916] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:55.231711 32110 ts_tablet_manager.cc:1929] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:55.232059 32110 log.cc:1199] T b1166342933745c5b82da4ee4032736c P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/b1166342933745c5b82da4ee4032736c
I20260709 12:23:55.233286 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet b1166342933745c5b82da4ee4032736c (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:55.255062 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:55.255560 30901 raft_consensus.cc:606] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:55.257728 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:55.258160 30901 raft_consensus.cc:606] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:55.260231 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:55.260613 30901 raft_consensus.cc:606] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:55.262578 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:55.262951 30901 raft_consensus.cc:606] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:55.275635 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:55.276149 30968 raft_consensus.cc:606] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:55.278277 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:55.278730 30901 raft_consensus.cc:606] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:55.279575 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:55.280676 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:55.281395 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:55.516651 32048 raft_consensus.cc:993] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.517087 32103 raft_consensus.cc:1081] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.518389 31621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:23:55.518954 31621 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:55.519217 31621 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.524199 31621 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.527650 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:55.528349 30901 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.529109 30901 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:55.528460 31621 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:55.530440 30901 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.531652 30901 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.532064 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:55.532541 31045 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.540648 31045 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.544028 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:23:55.544791 32065 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:55.548494 30901 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.549579 32065 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:55.550413 32065 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.556488 32115 raft_consensus.cc:993] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.556974 32115 raft_consensus.cc:1081] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.558635 31622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:23:55.559122 31622 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:55.559444 31622 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.565536 30795 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.574900 31622 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.577800 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:55.578557 30901 raft_consensus.cc:3055] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.578894 30901 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:55.579676 30901 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.580847 30901 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.585065 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:55.585654 31045 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.587981 31622 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:55.591741 30901 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.591866 31045 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.592679 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:23:55.593379 32065 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:55.593830 32065 raft_consensus.cc:697] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:55.594605 32065 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.599555 32114 raft_consensus.cc:993] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:55.600116 32114 raft_consensus.cc:1081] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:55.602376 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:23:55.602875 31046 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:55.603117 31046 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.607067 31046 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:55.608565 31046 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:55.609352 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:55.609434 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:55.610189 30901 raft_consensus.cc:3055] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.610241 30967 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.609509 30795 catalog_manager.cc:5697] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.610639 30901 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:55.611474 30901 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:55.612511 30901 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.615554 30967 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:55.617690 30901 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:55.617827 31014 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:55.618620 31964 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:55.619022 31964 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:55.619707 31964 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:55.629390 30795 catalog_manager.cc:5697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.711652 32077 raft_consensus.cc:993] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:55.712229 32078 raft_consensus.cc:1081] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:55.713810 31045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46192
I20260709 12:23:55.716073 31045 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:55.716352 31045 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.722326 31045 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:55.724046 31045 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:55.724885 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:55.725127 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:55.725476 30901 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.725644 30967 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.725963 30967 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:55.726547 30967 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:55.727378 30967 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.730360 30901 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:55.731415 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:55.732220 32075 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:55.732684 32075 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:55.733563 30967 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:55.737469 32048 raft_consensus.cc:993] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.738052 32048 raft_consensus.cc:1081] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.733596 32075 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:55.740018 31622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:23:55.740564 31622 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:55.740839 31622 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.750756 31622 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.750372 30795 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.752683 31622 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:55.753824 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:55.753752 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:55.754380 31045 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.754457 30901 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.754850 30901 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:55.755633 30901 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.758622 30901 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.762858 31045 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.763942 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:23:55.764691 32065 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:55.765172 32065 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:55.765631 30901 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.765937 32065 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.772115 32048 raft_consensus.cc:993] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.772545 32114 raft_consensus.cc:1081] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:55.773836 31622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:23:55.774317 31622 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:55.774574 31622 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.774472 30795 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.780303 31622 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.782770 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:55.784512 31622 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:55.784511 30901 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:55.785007 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:55.785614 30968 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.785136 30901 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:55.788590 30901 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.789603 30901 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:55.791028 30968 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.791973 31588 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:55.792551 32065 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:55.792914 32065 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:55.793607 32065 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:55.794194 30901 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:55.801819 30795 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.973047 30901 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:55.974018 32065 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:55.985090 31045 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:55.987104 32065 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:56.060642 30968 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:56.061905 31964 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.072360 30901 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:56.073694 31964 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.134295 31050 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:56.136102 32065 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:56.155879 30901 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:56.158054 32135 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:56.219102 30898 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:56.220791 32135 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:56.230772 31050 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:56.232398 32134 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:56.254709 30967 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:56.256160 32120 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.259366 30901 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:56.260609 31964 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.292449 30967 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:56.294402 31050 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:56.295743 32116 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:56.311818 30898 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:56.313489 32134 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:56.318445 31016 consensus_peers.cc:597] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c16ae54ff14e49b6877d162ad00f3ac4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.319533 30901 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.319911 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:56.322206 32075 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.329167 30967 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.332823 31964 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.349179 31964 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.353049 30968 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.381146 30976 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:56.384768 30797 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.399649 31050 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:56.400657 30942 consensus_peers.cc:597] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a99465fc591541cf808078e4fb820f06. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.398554 30901 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.404440 32149 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.407017 30898 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.408272 32040 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.416533 30898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:56.417086 30898 raft_consensus.cc:606] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:56.420496 30976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:56.421188 30976 raft_consensus.cc:606] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:56.446055 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1166342933745c5b82da4ee4032736c"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:23:56.446645 31046 raft_consensus.cc:606] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:56.447052 32149 raft_consensus.cc:993] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:56.447491 32149 raft_consensus.cc:1081] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:56.449472 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb8d20fced0547649402e6668241468c"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:23:56.450563 31046 raft_consensus.cc:606] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:56.450592 32040 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.452318 30901 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.456218 30898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:23:56.459772 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:56.460361 30896 raft_consensus.cc:606] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:56.463361 30898 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.463781 30898 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.471306 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:56.473785 30896 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:56.476363 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:56.476068 30898 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:56.477077 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:56.477788 31050 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.477938 30798 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.505219 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:56.505436 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:56.505821 30968 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.506007 31050 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.506214 30968 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:56.507018 30968 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:56.508301 30968 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.506224 30898 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:56.515654 31046 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.517701 30976 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.518440 30968 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
W20260709 12:23:56.517386 30867 consensus_peers.cc:597] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 367bf3d3c48d46dc88329ac7bc92fceb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.520658 32114 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.521989 31050 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:23:56.522573 30865 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:56.522751 32048 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.523339 32114 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.538162 32114 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:56.538936 32048 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.539405 32114 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:56.553161 30795 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.552505 30968 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.570631 31045 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.576195 30896 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:56.576821 30795 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.589784 30968 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.591922 31045 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.593122 32160 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:56.597496 30867 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73ffaf8ce697442c8bbb38cea5ba4136. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.598650 32160 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.603708 32122 raft_consensus.cc:993] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:56.604187 32122 raft_consensus.cc:1081] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:56.605831 31622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1166342933745c5b82da4ee4032736c"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44888
I20260709 12:23:56.606377 31622 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.606707 31622 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.606635 32048 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.608270 30968 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.611120 31045 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:56.613317 31622 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:56.616003 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:56.616519 30976 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.622967 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:56.623545 30896 raft_consensus.cc:606] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:56.624046 30798 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.636745 31622 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:56.638595 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:56.639168 31050 raft_consensus.cc:3055] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.639462 31050 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:56.640199 31050 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:56.641312 31050 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.638782 32160 raft_consensus.cc:993] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:56.642437 32160 raft_consensus.cc:1081] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:56.643010 30976 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:56.644116 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:23:56.644636 31046 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.644981 31046 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.645120 31588 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:56.647908 32116 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.648368 32116 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:56.649132 32116 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:56.655139 31050 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:56.679409 30898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:56.680018 30898 raft_consensus.cc:606] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:56.677037 31046 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.683306 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:56.683833 30967 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:56.684556 30783 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for a99465fc591541cf808078e4fb820f06 already in progress
I20260709 12:23:56.689666 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:56.690227 30896 raft_consensus.cc:3055] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.690502 30896 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:56.693382 30798 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.691185 30896 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.696493 30896 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.703138 30896 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:56.693253 30967 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:56.704209 31013 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:56.705145 32122 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.705708 32122 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:56.706590 32122 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.710886 31046 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:56.722028 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37068
I20260709 12:23:56.722574 30896 raft_consensus.cc:606] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:23:56.728307 30847 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:23:56.728724 30847 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for a99465fc591541cf808078e4fb820f06 already in progress
W20260709 12:23:56.729218 30847 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for a99465fc591541cf808078e4fb820f06 already in progress
I20260709 12:23:56.728727 30795 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.790141 32160 raft_consensus.cc:993] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:56.790550 32048 raft_consensus.cc:1081] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:56.791929 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:23:56.792446 31046 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.792773 31046 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.799607 31046 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.802218 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:56.802409 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:56.802789 30898 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.802914 30976 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.803156 30898 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:56.803982 30898 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.805011 30898 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.807451 30976 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:56.808548 31046 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:56.808575 31014 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:56.810124 31964 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.810536 31964 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:56.811254 31964 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.814213 30898 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:56.821861 30795 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.848081 32122 raft_consensus.cc:993] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:56.848610 32075 raft_consensus.cc:1081] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:56.850248 30898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb8d20fced0547649402e6668241468c"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:23:56.850698 30898 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:56.851027 30898 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.855774 30898 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.857219 30898 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:56.857823 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:56.858174 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:56.858413 30976 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.858700 31046 raft_consensus.cc:3055] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:56.858978 31046 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:56.859625 31046 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.860579 31046 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.864470 31046 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:23:56.864667 30976 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:23:56.865705 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:56.866544 32048 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:56.866972 32048 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:56.867687 32048 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:56.883693 30795 catalog_manager.cc:5697] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.897792 32171 ts_tablet_manager.cc:933] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:56.899346 32171 tablet_copy_client.cc:323] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:23:56.900866 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet c16ae54ff14e49b6877d162ad00f3ac4 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:23:56.901432 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet c16ae54ff14e49b6877d162ad00f3ac4 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-c16ae54ff14e49b6877d162ad00f3ac4
I20260709 12:23:56.902242 32173 ts_tablet_manager.cc:933] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:56.905056 32173 tablet_copy_client.cc:323] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:56.906859 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 367bf3d3c48d46dc88329ac7bc92fceb from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:56.907377 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 367bf3d3c48d46dc88329ac7bc92fceb from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-367bf3d3c48d46dc88329ac7bc92fceb
I20260709 12:23:56.908018 31061 tablet_copy_source_session.cc:215] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.912137 32171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c16ae54ff14e49b6877d162ad00f3ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.914160 30911 tablet_copy_source_session.cc:215] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.917523 32173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367bf3d3c48d46dc88329ac7bc92fceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.930150 32171 tablet_copy_client.cc:806] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.930730 32171 tablet_copy_client.cc:670] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.939864 32171 tablet_copy_client.cc:538] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.946409 32173 tablet_copy_client.cc:806] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.947018 32173 tablet_copy_client.cc:670] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.962271 32173 tablet_copy_client.cc:538] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.967535 32171 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:56.975749 32173 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:57.001907 32173 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:57.002774 32173 tablet_bootstrap.cc:492] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:57.003398 32173 ts_tablet_manager.cc:1403] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 12:23:57.003432 32171 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:57.004472 32171 tablet_bootstrap.cc:492] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
W20260709 12:23:57.004498 30867 consensus_peers.cc:597] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a99465fc591541cf808078e4fb820f06. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.005297 32171 ts_tablet_manager.cc:1403] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.042s	user 0.033s	sys 0.005s
I20260709 12:23:57.006001 32173 raft_consensus.cc:359] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.006587 32173 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:57.007058 32173 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.008081 32171 raft_consensus.cc:359] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.008869 32171 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:57.009131 32173 ts_tablet_manager.cc:1434] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:57.009486 32171 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.011622 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-367bf3d3c48d46dc88329ac7bc92fceb received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:57.012075 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-367bf3d3c48d46dc88329ac7bc92fceb on tablet 367bf3d3c48d46dc88329ac7bc92fceb with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:57.014091 32171 ts_tablet_manager.cc:1434] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:57.015589 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c16ae54ff14e49b6877d162ad00f3ac4 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:23:57.016006 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c16ae54ff14e49b6877d162ad00f3ac4 on tablet c16ae54ff14e49b6877d162ad00f3ac4 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:57.028528 30967 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:57.030052 32048 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.033953 30976 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:57.035312 32116 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:57.041810 32048 raft_consensus.cc:993] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:23:57.042474 32162 raft_consensus.cc:1081] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:23:57.047397 30968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:59150
I20260709 12:23:57.065735 31046 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:57.067404 32162 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.080772 30968 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:57.081236 30968 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.088464 30968 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.091421 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:57.091993 30898 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:57.092279 30898 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:57.093007 30898 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.094307 30898 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.088536 31045 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:57.101835 32065 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:57.110947 30968 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:57.112079 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:57.112638 31045 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.112880 30898 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:23:57.114070 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:57.115520 32078 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:57.115993 32078 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:57.116788 32078 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.126242 31045 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:23:57.134902 30798 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 2 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.145661 32171 ts_tablet_manager.cc:933] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:23:57.147447 32171 tablet_copy_client.cc:323] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:23:57.148891 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 73ffaf8ce697442c8bbb38cea5ba4136 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:23:57.149411 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 73ffaf8ce697442c8bbb38cea5ba4136 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-73ffaf8ce697442c8bbb38cea5ba4136
I20260709 12:23:57.157169 30911 tablet_copy_source_session.cc:215] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:57.160333 32171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ffaf8ce697442c8bbb38cea5ba4136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:57.176400 32171 tablet_copy_client.cc:806] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:57.176944 32171 tablet_copy_client.cc:670] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:57.180248 32171 tablet_copy_client.cc:538] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:57.186767 32171 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:57.207468 32171 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:57.208391 32171 tablet_bootstrap.cc:492] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:57.209106 32171 ts_tablet_manager.cc:1403] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 12:23:57.212086 32171 raft_consensus.cc:359] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.212881 32171 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:57.213505 32171 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:57.216107 32171 ts_tablet_manager.cc:1434] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:23:57.218762 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-73ffaf8ce697442c8bbb38cea5ba4136 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:23:57.219151 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-73ffaf8ce697442c8bbb38cea5ba4136 on tablet 73ffaf8ce697442c8bbb38cea5ba4136 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:57.231573 30898 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.232793 31964 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.240391 30968 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.241793 31964 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.256359 30896 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.258124 31964 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.295152 30976 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.305190 31964 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.392973 31622 raft_consensus.cc:1217] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:57.414428 31045 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.416184 32048 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.432003 30968 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:57.433658 32160 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.495890 31621 raft_consensus.cc:1217] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:57.524016 30901 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:57.525177 32195 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:57.541222 30942 consensus_peers.cc:597] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a99465fc591541cf808078e4fb820f06. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.544034 31045 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:57.547411 32149 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:57.550668 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:57.617869 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:57.618425 30968 raft_consensus.cc:606] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:57.622186 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:23:57.622659 31046 raft_consensus.cc:606] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:57.626176 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:57.626683 30968 raft_consensus.cc:606] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:57.628904 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af9423709bcf457ab89f49d71d157085"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:23:57.629304 31046 raft_consensus.cc:606] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:57.631955 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:57.632475 30901 raft_consensus.cc:606] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:57.633876 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:57.635355 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:57.636073 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:57.706301 31621 raft_consensus.cc:1217] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:57.815796 31964 raft_consensus.cc:993] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:57.816267 31964 raft_consensus.cc:1081] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:57.818717 31621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44888
I20260709 12:23:57.819296 31621 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:57.819680 31621 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.825261 31621 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:57.831079 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:57.831245 31621 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:57.831638 30968 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.836215 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:57.836822 31046 raft_consensus.cc:3055] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:57.837097 31046 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:57.835860 30968 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:57.838420 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:57.838269 31046 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:57.839231 32197 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:57.839458 31046 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.842223 32197 raft_consensus.cc:697] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:57.843535 32197 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:57.847747 31046 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:57.852942 30796 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.858618 32078 raft_consensus.cc:993] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:57.859140 32149 raft_consensus.cc:1081] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:57.865319 30901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:23:57.865931 30901 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:57.866277 30901 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.870528 32190 raft_consensus.cc:1064] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:57.873222 32190 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:57.877249 30901 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:57.878923 30901 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:57.879884 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:57.880478 30968 raft_consensus.cc:3055] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:57.880791 30968 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:57.881259 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:57.881457 30968 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:57.881875 31046 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.882644 30968 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.886430 30967 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.887830 32191 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.889722 30968 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:23:57.890758 30865 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:57.891559 32114 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:57.892078 32114 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:57.892968 32114 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:57.900396 31621 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.901897 32190 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.903824 30901 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.905580 32191 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.920301 32161 raft_consensus.cc:1064] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:57.920449 32191 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:57.921892 30795 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.923122 32161 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:57.929857 31046 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:23:57.934527 32160 raft_consensus.cc:993] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:57.934973 32160 raft_consensus.cc:1081] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:57.936088 31621 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:57.938979 31622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:23:57.939561 31622 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:57.939915 31622 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.954598 31051 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.958335 30967 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.960104 32162 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.968273 31624 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.973436 32114 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.974677 30898 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:57.978402 32162 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.994984 30968 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:57.994755 30795 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.009404 31045 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.009209 31622 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.018082 31620 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.019677 31964 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.020308 31622 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:58.024987 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:58.025581 31045 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.028613 31964 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.034065 31620 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.041656 31045 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:58.042721 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:23:58.043498 32197 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.043967 32197 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:58.044776 32197 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.048522 32150 raft_consensus.cc:993] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:58.048964 32150 raft_consensus.cc:1081] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:58.054879 31045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46192
I20260709 12:23:58.055650 31045 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.056046 31045 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.068974 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:58.069787 30901 raft_consensus.cc:3055] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.084739 30896 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:23:58.097520 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 94071.7us
I20260709 12:23:58.099210 30901 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:58.104605 30901 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.105856 30901 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.107956 32190 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.110832 32212 ts_tablet_manager.cc:933] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:58.117184 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c16ae54ff14e49b6877d162ad00f3ac4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:58.118261 30896 raft_consensus.cc:2955] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.125732 30795 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.132874 30901 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:58.144748 30796 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.146934 32212 tablet_copy_client.cc:323] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:23:58.147205 32211 raft_consensus.cc:1064] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:58.149833 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet a99465fc591541cf808078e4fb820f06 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:23:58.150355 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet a99465fc591541cf808078e4fb820f06 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-a99465fc591541cf808078e4fb820f06
I20260709 12:23:58.150487 32208 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.155587 32211 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.160079 32190 raft_consensus.cc:993] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:58.160538 32190 raft_consensus.cc:1081] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:58.161641 31045 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.163406 31045 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:58.164251 30967 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.165688 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet c16ae54ff14e49b6877d162ad00f3ac4 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:58.165302 31046 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.167397 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:58.168082 30968 raft_consensus.cc:3055] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.168363 30968 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:58.168702 30986 tablet_copy_source_session.cc:215] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:58.169037 30968 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.170038 30968 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.174141 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:58.174750 30901 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.179553 32212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a99465fc591541cf808078e4fb820f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.187530 31623 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.179425 31620 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.190716 30976 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.191232 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af9423709bcf457ab89f49d71d157085"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44888
I20260709 12:23:58.196823 32208 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.199234 30901 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:58.200016 31624 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.201073 31624 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.213856 31013 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:58.214708 31964 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.215305 31964 raft_consensus.cc:697] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:58.215854 31046 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.216293 31964 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.217576 32208 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.217916 32212 tablet_copy_client.cc:806] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:58.219044 32212 tablet_copy_client.cc:670] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:58.221020 32217 tablet_replica.cc:333] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:58.218317 32161 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.224673 32217 raft_consensus.cc:2243] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.223287 30798 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.230481 32217 raft_consensus.cc:2272] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.222811 32212 tablet_copy_client.cc:538] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:58.197935 30968 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:58.226377 31624 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.236778 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:58.236907 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:58.237417 30967 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.237478 31045 raft_consensus.cc:3055] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.237875 31045 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:58.238583 31045 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.239569 31045 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.244403 30967 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:58.252095 31588 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:58.253014 32197 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.253504 32197 raft_consensus.cc:697] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:58.254346 32197 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.257406 31624 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:58.247848 31045 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:58.264232 30898 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.274307 32217 ts_tablet_manager.cc:1916] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:58.277307 30798 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.278620 32161 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.280550 30797 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.286396 30968 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.286164 30971 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.289161 31623 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.290375 32212 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:23:58.280361 31624 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.294548 32114 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.303077 30967 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.305034 32208 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:58.309453 30797 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.311156 32208 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.320293 30976 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.335822 32211 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.340298 32217 ts_tablet_manager.cc:1929] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:58.340814 32217 log.cc:1199] T c16ae54ff14e49b6877d162ad00f3ac4 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/c16ae54ff14e49b6877d162ad00f3ac4
I20260709 12:23:58.342957 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet c16ae54ff14e49b6877d162ad00f3ac4 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:58.348387 31624 raft_consensus.cc:2955] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.381639 30797 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.396632 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet 367bf3d3c48d46dc88329ac7bc92fceb with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:23:58.403479 32228 tablet_replica.cc:333] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:23:58.404290 32228 raft_consensus.cc:2243] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.404950 32228 raft_consensus.cc:2272] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.409826 31046 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.412853 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 367bf3d3c48d46dc88329ac7bc92fceb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:58.414091 32228 ts_tablet_manager.cc:1916] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:58.420753 31045 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.435611 32197 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:23:58.470651 32212 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:58.471681 32212 tablet_bootstrap.cc:492] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:23:58.472024 30968 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.472404 32212 ts_tablet_manager.cc:1403] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.188s	user 0.041s	sys 0.016s
I20260709 12:23:58.473658 32196 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:58.476263 31046 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.477730 32162 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:58.481775 30901 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.485308 32212 raft_consensus.cc:359] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:58.486488 32212 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:23:58.487411 32212 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:58.495359 31624 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.496826 31046 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.497951 32162 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.499012 32211 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.507594 32227 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.508519 31046 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:58.510030 32212 ts_tablet_manager.cc:1434] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:23:58.529527 30901 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.533949 32196 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:58.537492 31624 raft_consensus.cc:2955] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:23:58.549250 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 50295us
I20260709 12:23:58.569099 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73ffaf8ce697442c8bbb38cea5ba4136 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:58.572000 32228 ts_tablet_manager.cc:1929] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:58.575968 30796 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.579404 31051 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.593096 32228 log.cc:1199] T 367bf3d3c48d46dc88329ac7bc92fceb P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/367bf3d3c48d46dc88329ac7bc92fceb
I20260709 12:23:58.593609 32197 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:58.598817 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-a99465fc591541cf808078e4fb820f06 received from {username='slave'} at 127.0.0.1:59852
I20260709 12:23:58.599241 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-a99465fc591541cf808078e4fb820f06 on tablet a99465fc591541cf808078e4fb820f06 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:58.601054 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet 367bf3d3c48d46dc88329ac7bc92fceb (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:58.606688 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 73ffaf8ce697442c8bbb38cea5ba4136 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:23:58.607926 32217 tablet_replica.cc:333] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:23:58.608877 32217 raft_consensus.cc:2243] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.609617 32217 raft_consensus.cc:2272] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.619011 32217 ts_tablet_manager.cc:1916] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:58.623634 31623 raft_consensus.cc:1217] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Deduplicated request from leader. Original: 2.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:23:58.642392 32217 ts_tablet_manager.cc:1929] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:58.642951 32217 log.cc:1199] T 73ffaf8ce697442c8bbb38cea5ba4136 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/73ffaf8ce697442c8bbb38cea5ba4136
I20260709 12:23:58.644949 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 73ffaf8ce697442c8bbb38cea5ba4136 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:23:58.662573 30968 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.663854 32191 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:58.673662 30901 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.674968 31964 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:58.688570 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:58.732677 30898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:58.733179 30898 raft_consensus.cc:606] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:58.735574 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:23:58.736109 31046 raft_consensus.cc:606] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:58.738662 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:58.739128 30968 raft_consensus.cc:606] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:58.741326 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:58.741768 30968 raft_consensus.cc:606] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:58.744174 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4086d50310462885b584b6297df730"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:58.744781 30968 raft_consensus.cc:606] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:23:58.745877 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:58.748107 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:58.748854 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:58.778263 32161 raft_consensus.cc:993] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:58.778887 32225 raft_consensus.cc:1081] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:58.780328 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:23:58.780836 31046 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.781076 31046 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.785215 31046 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.787909 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:58.788463 30898 raft_consensus.cc:3055] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.788378 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:58.789103 30968 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.788869 30898 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:58.789489 31046 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:58.792667 30898 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.793730 30898 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.797140 30968 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:58.800292 31014 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:58.801403 32191 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.801856 32191 raft_consensus.cc:697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:58.802683 32191 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.809866 30967 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.812188 30898 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:58.812070 32239 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:23:58.827312 30798 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.838444 31051 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.839915 32196 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:58.861510 32236 raft_consensus.cc:993] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:58.861913 32236 raft_consensus.cc:1081] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:23:58.863121 31623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44878
I20260709 12:23:58.863535 31623 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.863802 31623 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.868453 31623 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.870846 31623 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:58.870793 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:58.871512 30898 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.871430 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:58.872074 30967 raft_consensus.cc:3055] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.872360 30967 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:58.873054 30967 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.874207 30967 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.877923 30898 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:58.879546 31587 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:23:58.880335 30967 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:23:58.880440 32245 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.881065 32245 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:23:58.881886 32245 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:58.889693 30795 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.945480 32190 raft_consensus.cc:993] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:58.945886 32191 raft_consensus.cc:1081] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:58.947167 30898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:23:58.947587 30898 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.947877 30898 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.952212 30898 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.953912 30898 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:58.954017 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:58.954748 30967 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.954778 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:58.955308 31046 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.955524 31046 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:58.956151 31046 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.957036 31046 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.959113 30967 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:23:58.960112 30865 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:58.960918 32225 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.961404 32225 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:58.962096 31046 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:23:58.962230 32225 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:58.972564 30795 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.091207 32236 raft_consensus.cc:1064] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
W20260709 12:23:59.091545 32236 raft_consensus.cc:1068] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Unable to promote non-voter 9f38f761eded4f28b9d802f6570ee71e: Service unavailable: leader transfer in progress
I20260709 12:23:59.108400 32040 raft_consensus.cc:993] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:59.108866 32040 raft_consensus.cc:1081] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:23:59.110258 31051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4086d50310462885b584b6297df730"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46192
I20260709 12:23:59.110679 31051 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.110925 31051 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.116436 31051 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:59.117769 31051 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:23:59.119006 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:59.119335 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:59.119637 30898 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.119874 30967 raft_consensus.cc:3055] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.120204 30967 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:59.120885 30967 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:59.122021 30967 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.128695 30898 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:59.129593 31013 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:59.130332 32191 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.130846 32191 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:59.131354 30967 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:23:59.131629 32191 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:59.139684 30795 catalog_manager.cc:5697] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.166940 32040 raft_consensus.cc:993] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:59.167385 32236 raft_consensus.cc:1081] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:23:59.168749 30898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:23:59.169153 30898 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.169402 30898 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.174683 30898 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:59.176324 30898 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:59.178074 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:23:59.178826 30967 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:59.179111 30967 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:59.180089 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:59.180689 31051 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.180110 30967 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:59.183089 30971 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.186105 32190 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:59.190307 31051 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:23:59.195982 30864 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:23:59.196695 32208 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:59.197122 32208 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:23:59.197929 32208 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:59.211536 30901 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.213369 32190 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.189800 30967 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.239748 30798 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 3 to 4, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 4 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.248109 30967 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:23:59.350476 30901 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:59.351424 32245 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.360813 30967 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:59.362430 32239 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.413187 31046 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.414098 32253 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.423072 30967 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.426587 32253 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.553015 30901 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.554185 32255 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.556460 30967 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:59.557711 32191 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.639554 31623 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Advancing to term 4
I20260709 12:23:59.644120 31623 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:59.645152 32208 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.653007 32161 raft_consensus.cc:1064] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
W20260709 12:23:59.653424 32161 raft_consensus.cc:1068] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Unable to promote non-voter 9f38f761eded4f28b9d802f6570ee71e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:59.657313 30967 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:59.658682 32161 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.674331 31045 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:59.675853 32225 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.675625 31051 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:59.686134 32225 raft_consensus.cc:1064] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:23:59.689307 32225 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:23:59.699838 31623 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.712757 30968 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.712960 31051 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.713526 32253 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.715775 32253 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.717130 32253 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.707999 30967 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:59.708765 31016 consensus_peers.cc:597] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8bf63aa28c9f4ce492e2f2d77216b2ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:59.709599 30896 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:59.721524 32255 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.723235 32255 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.725003 32208 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:59.728698 30967 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:59.731005 31045 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:59.736503 31623 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:59.747404 30798 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 6, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:23:59.765458 32255 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.770258 30896 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.772797 30968 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.787212 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:59.787739 30898 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
W20260709 12:23:59.794390 30867 consensus_peers.cc:597] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c41891dd6716497eaa34a9558f696ee1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:59.797502 31051 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:59.798273 30968 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:59.800196 32208 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.803282 32253 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.817137 32161 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.820711 30968 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.833545 31045 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.843868 30796 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.849062 30796 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.847062 31051 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:59.871031 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:23:59.871667 30896 raft_consensus.cc:606] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:23:59.875105 30968 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:59.875222 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:23:59.875473 30896 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:59.875825 31016 consensus_peers.cc:597] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9e712edd3ac45e9b088a4dbd226c616. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:59.876693 31045 raft_consensus.cc:606] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:23:59.878338 32255 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.880098 32255 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:59.881794 30968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:23:59.882552 30968 raft_consensus.cc:606] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:23:59.883929 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:59.885713 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:59.886415 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:59.889053 31964 raft_consensus.cc:993] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:23:59.893250 31964 raft_consensus.cc:1081] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:23:59.891381 32191 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.895295 30968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:41634
I20260709 12:23:59.895804 30968 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.896140 30968 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.899484 30971 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.909225 31045 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:23:59.909951 30797 catalog_manager.cc:5697] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.901031 30896 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.926524 30968 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:59.929236 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:23:59.929839 30901 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.932250 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:23:59.932817 31051 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:59.933094 31051 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:23:59.933750 31051 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:23:59.934713 31051 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.929416 30968 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:23:59.943538 30901 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:23:59.946974 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:23:59.947708 32040 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:59.948179 32040 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:23:59.948908 32040 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:23:59.954222 31016 consensus_peers.cc:597] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f62100297c3841e0914543cebffb2ce0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:59.956329 30971 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:59.956733 30901 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:59.957857 32190 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.958706 32191 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.958817 31051 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:23:59.965811 30797 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.977708 32191 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.994099 30901 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:23:59.997757 30971 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:00.004909 30797 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.019429 32208 raft_consensus.cc:993] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:00.019964 32208 raft_consensus.cc:1081] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:00.021517 31623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:24:00.021960 31623 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.022240 31623 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.027813 31623 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:00.030680 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:00.031240 30901 raft_consensus.cc:3055] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.031562 30901 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:00.032286 30901 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:00.032776 31623 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:00.033257 30901 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.039165 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:00.039472 30901 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:00.039803 30971 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.040649 31587 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:00.041481 32239 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.042632 32239 raft_consensus.cc:697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:00.045135 32239 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:00.052587 30971 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:00.066407 30796 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:00.129112 32236 raft_consensus.cc:993] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:00.129596 32236 raft_consensus.cc:1081] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:00.131515 30901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:24:00.132134 30901 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:00.132639 30901 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.139168 30901 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:00.141716 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:00.141948 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:00.142504 31045 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.142292 30971 raft_consensus.cc:3055] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.143024 30971 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:00.143699 30971 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:00.144441 30901 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:00.144721 30971 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:00.149303 31045 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:00.150303 30864 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:00.150959 30971 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:00.151185 32161 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:00.151713 32161 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:00.153033 32161 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:00.162436 30796 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:00.242930 32286 ts_tablet_manager.cc:933] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:00.244710 32286 tablet_copy_client.cc:323] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:24:00.246124 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet c41891dd6716497eaa34a9558f696ee1 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:24:00.246644 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet c41891dd6716497eaa34a9558f696ee1 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-c41891dd6716497eaa34a9558f696ee1
I20260709 12:24:00.255565 30911 tablet_copy_source_session.cc:215] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:00.258507 32286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41891dd6716497eaa34a9558f696ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:00.267755 32288 ts_tablet_manager.cc:933] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:00.269304 32288 tablet_copy_client.cc:323] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:24:00.270643 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet e9e712edd3ac45e9b088a4dbd226c616 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:24:00.271064 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet e9e712edd3ac45e9b088a4dbd226c616 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-e9e712edd3ac45e9b088a4dbd226c616
I20260709 12:24:00.275455 32286 tablet_copy_client.cc:806] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:00.276105 32286 tablet_copy_client.cc:670] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:00.277096 31061 tablet_copy_source_session.cc:215] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:00.280107 32286 tablet_copy_client.cc:538] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:00.281044 32288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e712edd3ac45e9b088a4dbd226c616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:00.288864 32286 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:00.293351 32288 tablet_copy_client.cc:806] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:00.293831 32288 tablet_copy_client.cc:670] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:00.298126 32288 tablet_copy_client.cc:538] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:00.308816 32286 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:00.309790 32286 tablet_bootstrap.cc:492] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:00.310480 32286 ts_tablet_manager.cc:1403] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:24:00.308102 32288 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:00.314100 32286 raft_consensus.cc:359] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.314996 32286 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:00.316956 32286 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.326122 32286 ts_tablet_manager.cc:1434] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:24:00.334751 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c41891dd6716497eaa34a9558f696ee1 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:24:00.335157 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c41891dd6716497eaa34a9558f696ee1 on tablet c41891dd6716497eaa34a9558f696ee1 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:00.340694 32286 ts_tablet_manager.cc:933] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:00.342247 32286 tablet_copy_client.cc:323] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:24:00.343920 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:24:00.344412 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 8bf63aa28c9f4ce492e2f2d77216b2ed from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-8bf63aa28c9f4ce492e2f2d77216b2ed
I20260709 12:24:00.353314 31061 tablet_copy_source_session.cc:215] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:00.357369 32286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:00.376623 32286 tablet_copy_client.cc:806] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:00.377183 32286 tablet_copy_client.cc:670] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:00.379372 32288 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:00.380321 32288 tablet_bootstrap.cc:492] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:00.380349 32286 tablet_copy_client.cc:538] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:00.381108 32288 ts_tablet_manager.cc:1403] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.017s
I20260709 12:24:00.384032 32288 raft_consensus.cc:359] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.384831 32288 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:00.385481 32288 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.386618 32286 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:00.388877 32288 ts_tablet_manager.cc:1434] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:00.399036 31051 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:00.400022 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-e9e712edd3ac45e9b088a4dbd226c616 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:24:00.400417 32040 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:00.400467 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-e9e712edd3ac45e9b088a4dbd226c616 on tablet e9e712edd3ac45e9b088a4dbd226c616 with peer 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:00.473624 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 56661.1us
I20260709 12:24:00.478003 30901 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:00.485348 32288 ts_tablet_manager.cc:933] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:00.484350 32298 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:24:00.501170 32288 tablet_copy_client.cc:323] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:24:00.502944 31061 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet f62100297c3841e0914543cebffb2ce0 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:24:00.503458 31061 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet f62100297c3841e0914543cebffb2ce0 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-f62100297c3841e0914543cebffb2ce0
I20260709 12:24:00.518570 30901 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:00.529322 32282 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.529709 31061 tablet_copy_source_session.cc:215] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:00.542064 32288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62100297c3841e0914543cebffb2ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:00.570007 30971 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:00.572907 32282 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.605020 32286 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:00.607913 32286 tablet_bootstrap.cc:492] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:00.608650 32286 ts_tablet_manager.cc:1403] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.024s
I20260709 12:24:00.613049 30968 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.613515 32286 raft_consensus.cc:359] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.614327 32286 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:00.614960 32286 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.615216 32299 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.619320 32288 tablet_copy_client.cc:806] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:00.623163 32286 ts_tablet_manager.cc:1434] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:24:00.620281 32288 tablet_copy_client.cc:670] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:00.625344 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-8bf63aa28c9f4ce492e2f2d77216b2ed received from {username='slave'} at 127.0.0.1:34990
I20260709 12:24:00.625743 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-8bf63aa28c9f4ce492e2f2d77216b2ed on tablet 8bf63aa28c9f4ce492e2f2d77216b2ed with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:00.628125 32288 tablet_copy_client.cc:538] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:00.644513 32288 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:00.666178 31051 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.672291 32225 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.710350 32288 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:00.711025 32288 tablet_bootstrap.cc:492] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:00.711565 32288 ts_tablet_manager.cc:1403] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.017s
I20260709 12:24:00.714780 32288 raft_consensus.cc:359] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.715317 31623 raft_consensus.cc:1217] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:00.715764 32288 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:00.716455 32288 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:00.719030 32288 ts_tablet_manager.cc:1434] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:00.720808 31060 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f62100297c3841e0914543cebffb2ce0 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:24:00.721186 31060 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f62100297c3841e0914543cebffb2ce0 on tablet f62100297c3841e0914543cebffb2ce0 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:00.782464 31623 raft_consensus.cc:1217] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:00.931710 31623 raft_consensus.cc:1217] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:00.956375 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:01.066702 31623 raft_consensus.cc:1217] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:01.073295 30898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:01.074170 30898 raft_consensus.cc:606] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:01.084653 30971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea71eb6769834992980701da50fb499d"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:24:01.085292 30971 raft_consensus.cc:606] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:01.086445 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:01.088312 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:01.088996 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:01.101604 32040 raft_consensus.cc:993] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:01.102141 32236 raft_consensus.cc:1081] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:01.103574 30898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea71eb6769834992980701da50fb499d"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:24:01.104148 30898 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:01.104899 30898 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.112296 30898 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:01.115396 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:01.115912 31051 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.118594 30898 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:01.121719 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:01.122221 30968 raft_consensus.cc:3055] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:01.122499 30968 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:01.123178 30968 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:01.124308 30968 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.125905 31051 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:01.128109 30864 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:01.129383 32225 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:01.129835 32225 raft_consensus.cc:697] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:01.130714 32225 consensus_queue.cc:237] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:01.134039 30968 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:01.171072 30795 catalog_manager.cc:5697] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.210074 32191 raft_consensus.cc:1064] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:01.211840 32191 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:01.222107 31624 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.222098 30968 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.223553 32190 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.225049 32308 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.232415 30898 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.244388 32191 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.248225 32299 raft_consensus.cc:1064] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:01.250975 30971 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.248090 32191 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.252139 32299 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:01.267190 31624 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.273132 30901 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.277599 30795 catalog_manager.cc:5697] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.296058 31623 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.298907 30971 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.300153 31045 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.300823 32161 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.304214 32161 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.305076 32208 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.319972 31051 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:01.352706 30968 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:01.354094 31624 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:01.354391 32190 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.355773 32308 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.362937 32191 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.366673 31623 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.377081 30968 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.380235 30971 raft_consensus.cc:2955] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.371292 32161 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.389532 30795 catalog_manager.cc:5697] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.391068 32190 raft_consensus.cc:1064] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:01.398031 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9e712edd3ac45e9b088a4dbd226c616 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:01.397138 32190 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:01.392366 31045 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.408179 30797 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.410315 31624 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.436766 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet e9e712edd3ac45e9b088a4dbd226c616 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:24:01.439558 30896 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.439698 31623 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.440930 31964 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.442646 32325 tablet_replica.cc:333] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:24:01.441083 30971 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:01.444310 32325 raft_consensus.cc:2243] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:01.445021 32325 raft_consensus.cc:2272] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:01.452777 32325 ts_tablet_manager.cc:1916] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:01.443437 32308 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:01.459851 32191 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:01.481081 31964 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.485878 30968 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.491359 30901 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:01.482045 30896 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.500546 31624 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:01.502138 32208 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.507959 32325 ts_tablet_manager.cc:1929] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:01.508489 32325 log.cc:1199] T e9e712edd3ac45e9b088a4dbd226c616 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/e9e712edd3ac45e9b088a4dbd226c616
I20260709 12:24:01.508153 30798 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.513571 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet e9e712edd3ac45e9b088a4dbd226c616 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:01.515062 30968 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:01.517592 32161 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.518708 32299 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.521052 31624 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.523480 30968 raft_consensus.cc:2955] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.534789 31045 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.536659 32208 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.535552 31623 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.549852 30798 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.559677 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c41891dd6716497eaa34a9558f696ee1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:01.564095 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet c41891dd6716497eaa34a9558f696ee1 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:24:01.571914 32299 raft_consensus.cc:993] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:01.572541 32299 raft_consensus.cc:1081] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:01.575448 31051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:24:01.576014 31051 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:01.576388 31051 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.577342 32191 raft_consensus.cc:1064] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:01.579367 32191 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:01.611044 31051 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:01.613746 31051 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:01.614809 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:01.653033 30968 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.636175 31046 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:01.656126 32334 tablet_replica.cc:333] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:24:01.663254 30971 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:01.664765 31623 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:01.664851 31964 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.666451 32308 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.667191 30968 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:01.669803 30968 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.671074 32225 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.672892 31014 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:01.677222 31964 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:01.677685 31964 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:01.678395 31964 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:01.695065 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:01.695904 30901 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:01.696266 30901 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:01.697006 30901 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:01.698675 30901 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:01.711030 32334 raft_consensus.cc:2243] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:01.712090 32334 raft_consensus.cc:2272] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:01.713049 30968 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.718735 30901 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:01.718901 31624 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:01.735110 32308 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.734992 32336 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.752274 30968 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:24:01.759158 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 54381.5us
I20260709 12:24:01.769122 32334 ts_tablet_manager.cc:1916] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:01.771860 31964 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:01.804608 31623 raft_consensus.cc:2955] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.810788 30798 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:01.847215 30901 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:01.851024 32191 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:24:01.881980 32337 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
I20260709 12:24:01.888772 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:01.892946 30798 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.910000 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf63aa28c9f4ce492e2f2d77216b2ed with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:24:01.910921 32325 tablet_replica.cc:333] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:24:01.911819 32325 raft_consensus.cc:2243] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:01.911408 32191 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.912597 32325 raft_consensus.cc:2272] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:01.913404 32334 ts_tablet_manager.cc:1929] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:01.913877 32334 log.cc:1199] T c41891dd6716497eaa34a9558f696ee1 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/c41891dd6716497eaa34a9558f696ee1
I20260709 12:24:01.915856 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet c41891dd6716497eaa34a9558f696ee1 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:01.916842 30901 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.918752 31620 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.921376 32325 ts_tablet_manager.cc:1916] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:01.928210 30967 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:01.956962 32325 ts_tablet_manager.cc:1929] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:01.957377 32325 log.cc:1199] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/8bf63aa28c9f4ce492e2f2d77216b2ed
W20260709 12:24:01.979426 30783 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 63395.5us
I20260709 12:24:01.998806 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 8bf63aa28c9f4ce492e2f2d77216b2ed (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:02.013478 30797 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:02.080893 31045 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:02.093709 31620 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:02.096868 32347 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:02.106446 32341 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:02.109864 30893 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:02.112740 32191 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:02.117144 31620 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:02.123222 30893 raft_consensus.cc:2955] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:02.125567 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f62100297c3841e0914543cebffb2ce0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:02.130446 30795 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.143821 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet f62100297c3841e0914543cebffb2ce0 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59142
I20260709 12:24:02.151086 32353 tablet_replica.cc:333] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:24:02.159457 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:02.185704 32353 raft_consensus.cc:2243] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.186805 32353 raft_consensus.cc:2272] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.190546 32353 ts_tablet_manager.cc:1916] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:02.208904 32353 ts_tablet_manager.cc:1929] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:02.209573 32353 log.cc:1199] T f62100297c3841e0914543cebffb2ce0 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/f62100297c3841e0914543cebffb2ce0
I20260709 12:24:02.211862 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet f62100297c3841e0914543cebffb2ce0 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:02.217224 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:02.217984 30896 raft_consensus.cc:606] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:02.220619 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:02.221175 31045 raft_consensus.cc:606] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:02.223757 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:02.224277 30896 raft_consensus.cc:606] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:02.226599 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:02.227097 31045 raft_consensus.cc:606] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:02.229979 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:02.231487 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:02.232460 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:02.234898 30896 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:02.236320 32341 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.239162 30968 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:02.242010 32341 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.357571 31964 raft_consensus.cc:993] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:02.358067 32191 raft_consensus.cc:1081] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:02.359586 30967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:41634
I20260709 12:24:02.360512 30967 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.360770 30967 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.366350 30967 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:02.368036 30967 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:02.368783 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:02.369241 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:02.369400 30898 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.369701 31045 raft_consensus.cc:3055] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:02.369941 31045 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:02.370512 31045 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:02.371399 31045 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.375079 30898 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:02.376156 30939 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:02.377004 32040 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:02.377331 31045 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:02.377578 32040 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:02.378429 32040 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:02.388963 30795 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.465096 32333 raft_consensus.cc:993] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:02.465598 32225 raft_consensus.cc:1081] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:02.467460 31045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:24:02.468017 31045 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.468338 31045 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.474925 31045 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:02.476356 31045 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:02.477244 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:02.477403 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:02.477825 30893 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:02.477988 30968 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.478135 30893 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:02.478950 30893 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:02.479871 30893 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.485734 30893 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:02.487985 31013 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:02.488771 30968 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:02.489130 32191 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:02.489598 32191 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:02.490440 32191 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:02.500176 30795 catalog_manager.cc:5697] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.569454 32341 raft_consensus.cc:993] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:02.569984 32191 raft_consensus.cc:1081] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:02.571300 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44888
I20260709 12:24:02.571700 31624 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.572009 31624 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.577927 31624 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:02.580394 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:02.581106 30893 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.581377 31624 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:02.581913 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:02.582500 31045 raft_consensus.cc:3055] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:02.582751 31045 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:02.583420 31045 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:02.584399 31045 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.586381 30893 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:02.587393 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:02.588107 32342 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:02.588464 32342 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:02.589394 31045 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:02.589263 32342 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:02.598691 30795 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.609735 32208 raft_consensus.cc:993] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:02.610262 32333 raft_consensus.cc:1081] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:02.612284 31045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:24:02.612790 31045 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:02.613166 31045 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.619110 31045 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:02.621640 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:02.621945 31045 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:02.622475 30893 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:02.622851 30893 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:02.622893 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:02.624018 31624 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.623757 30893 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:02.625396 30893 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.631186 31624 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:02.631934 30893 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:02.632313 31016 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:02.633031 32191 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:02.633461 32191 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:02.634188 32191 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:02.647236 30795 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.833532 30893 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.834631 32040 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.850284 31045 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.851496 32365 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.970049 30893 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.971276 32341 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.981415 30976 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.985951 32191 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.007126 30893 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:03.008201 32342 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:03.027434 31045 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:03.028924 32282 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:03.183055 31624 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:03.184790 31964 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:03.197753 30893 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:03.199275 32341 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:03.249467 30976 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
W20260709 12:24:03.258399 30942 consensus_peers.cc:597] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6c2e2c3cd614b10b823dd15a66b564a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:03.258742 30893 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:03.258796 31045 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:03.260201 32376 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.260977 32350 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.269562 32376 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.271063 31045 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.286816 30901 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:03.289669 30795 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.291950 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:03.296399 30893 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.303552 31046 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:03.304473 30867 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0f1d02ed7d148238e18e004aa55b7d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:03.305516 32208 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.326479 30976 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:03.329140 32208 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.332379 32208 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.334024 31045 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.345564 30976 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.357108 30901 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
W20260709 12:24:03.372225 30867 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f278da50d600410dbed3af60b0147046. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:03.373283 30976 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:03.374733 31045 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:03.375821 30798 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.380122 32380 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.381445 32333 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.382202 30976 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:24:03.382740 30976 raft_consensus.cc:606] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:03.387552 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4086d50310462885b584b6297df730"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:03.388121 31045 raft_consensus.cc:606] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:03.392982 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:03.393561 31045 raft_consensus.cc:606] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:03.394946 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:03.396818 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:03.397617 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:03.429841 32333 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:24:03.446879 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 46091.4us
I20260709 12:24:03.448684 31046 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.471320 30797 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:03.475468 30976 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
W20260709 12:24:03.476315 30847 auto_rebalancer.cc:629] Failed to schedule move for tablet f09ba14cb7054588ae9fdcdedf04b081: Remote error: Service unavailable: leader transfer in progress
I20260709 12:24:03.502429 32040 raft_consensus.cc:993] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:03.502969 32040 raft_consensus.cc:1081] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:03.505015 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46192
I20260709 12:24:03.505681 31046 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.506421 31046 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.516693 31046 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.519385 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:03.519999 30901 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.527073 30901 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:03.528003 31013 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:03.528800 31046 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:03.529013 31964 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:03.529526 31964 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:03.529670 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:03.530220 30968 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.530524 30968 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:03.530313 31964 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.531255 30968 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.532307 30968 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.538750 30968 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:03.544910 30797 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.633430 32341 raft_consensus.cc:993] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:03.633929 32191 raft_consensus.cc:1081] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:03.635320 30893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:24:03.635752 30893 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.636003 30893 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.642452 30893 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.648754 32191 raft_consensus.cc:993] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:03.649200 31964 raft_consensus.cc:1081] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:03.650185 30893 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:03.651387 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:03.651402 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:03.652269 30901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4086d50310462885b584b6297df730"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:24:03.651947 30976 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.652683 31046 raft_consensus.cc:3055] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:03.653005 30901 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.653175 31046 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:03.653461 30901 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.653985 31046 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.655115 31046 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.660085 30976 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:03.660123 30901 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.661687 30865 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:03.661754 31046 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:03.662251 30901 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:03.662490 32333 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:03.662992 32333 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:03.663877 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:03.664428 30968 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.664625 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:03.665160 31051 raft_consensus.cc:3055] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:03.665374 31051 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:03.665962 31051 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.666735 31051 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.663869 32333 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.670874 30968 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:03.672073 30865 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:03.672922 32380 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:03.673072 31051 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:03.673581 32380 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:03.674523 32380 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:03.681644 30797 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.697211 30797 catalog_manager.cc:5697] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:03.830509 32397 ts_tablet_manager.cc:933] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:03.839093 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 47768.7us
I20260709 12:24:03.850549 32399 ts_tablet_manager.cc:933] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:03.850993 32397 tablet_copy_client.cc:323] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:24:03.853196 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet d6c2e2c3cd614b10b823dd15a66b564a from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:24:03.853739 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet d6c2e2c3cd614b10b823dd15a66b564a from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-d6c2e2c3cd614b10b823dd15a66b564a
I20260709 12:24:03.869736 30986 tablet_copy_source_session.cc:215] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:03.873904 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c2e2c3cd614b10b823dd15a66b564a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:03.876430 32399 tablet_copy_client.cc:323] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:24:03.878383 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet e0f1d02ed7d148238e18e004aa55b7d4 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:24:03.878899 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet e0f1d02ed7d148238e18e004aa55b7d4 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-e0f1d02ed7d148238e18e004aa55b7d4
I20260709 12:24:03.886272 30911 tablet_copy_source_session.cc:215] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:03.891783 32397 tablet_copy_client.cc:806] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:03.892457 32397 tablet_copy_client.cc:670] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:03.893519 32399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f1d02ed7d148238e18e004aa55b7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:03.895697 32397 tablet_copy_client.cc:538] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:03.905355 32397 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:03.915128 32399 tablet_copy_client.cc:806] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:03.917387 32399 tablet_copy_client.cc:670] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:03.921331 32399 tablet_copy_client.cc:538] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:03.930872 32399 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:03.936968 30901 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:03.936932 32397 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:03.938189 32395 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:03.938577 32397 tablet_bootstrap.cc:492] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:03.939265 32397 ts_tablet_manager.cc:1403] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.000s
I20260709 12:24:03.942261 32397 raft_consensus.cc:359] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:03.943115 32397 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:03.943821 32397 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:03.946777 32397 ts_tablet_manager.cc:1434] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:24:03.948752 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-d6c2e2c3cd614b10b823dd15a66b564a received from {username='slave'} at 127.0.0.1:59852
I20260709 12:24:03.949187 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-d6c2e2c3cd614b10b823dd15a66b564a on tablet d6c2e2c3cd614b10b823dd15a66b564a with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:03.957214 32397 ts_tablet_manager.cc:933] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:03.970510 32397 tablet_copy_client.cc:323] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:24:03.972116 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet f278da50d600410dbed3af60b0147046 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:24:03.972646 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet f278da50d600410dbed3af60b0147046 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-f278da50d600410dbed3af60b0147046
I20260709 12:24:03.982111 30911 tablet_copy_source_session.cc:215] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:03.982535 32399 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:03.983479 32399 tablet_bootstrap.cc:492] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:03.984560 32399 ts_tablet_manager.cc:1403] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.003s
I20260709 12:24:03.985363 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f278da50d600410dbed3af60b0147046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:03.988366 32399 raft_consensus.cc:359] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:03.989194 32399 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:03.989832 32399 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:03.994143 32399 ts_tablet_manager.cc:1434] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:24:03.997933 30968 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:03.998306 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-e0f1d02ed7d148238e18e004aa55b7d4 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:24:03.998838 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-e0f1d02ed7d148238e18e004aa55b7d4 on tablet e0f1d02ed7d148238e18e004aa55b7d4 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:03.999912 32395 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.010452 32397 tablet_copy_client.cc:806] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:04.011080 32397 tablet_copy_client.cc:670] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:04.014973 32397 tablet_copy_client.cc:538] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:04.025746 32397 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:04.051707 32397 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:04.052735 32397 tablet_bootstrap.cc:492] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:04.053434 32397 ts_tablet_manager.cc:1403] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.009s
I20260709 12:24:04.056344 32397 raft_consensus.cc:359] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:04.057196 32397 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:04.057849 32397 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:04.061997 32397 ts_tablet_manager.cc:1434] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:04.068792 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f278da50d600410dbed3af60b0147046 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:24:04.069353 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f278da50d600410dbed3af60b0147046 on tablet f278da50d600410dbed3af60b0147046 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:04.135699 31051 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:04.136850 32396 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.149837 30976 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:04.153290 32393 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.218478 31051 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:04.219552 32396 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.228395 30968 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:04.229859 32393 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.345249 31620 raft_consensus.cc:1217] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:04.347252 31624 raft_consensus.cc:1217] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:04.447363 31624 raft_consensus.cc:1217] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:04.526530 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:04.571902 31051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:04.572495 31051 raft_consensus.cc:606] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:04.574990 30893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:04.575435 30893 raft_consensus.cc:606] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:04.577505 30893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:04.577899 30893 raft_consensus.cc:606] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:04.578917 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:04.579946 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:04.580489 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:04.681537 32191 raft_consensus.cc:993] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:04.682080 32191 raft_consensus.cc:1081] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:04.685022 30967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:41634
I20260709 12:24:04.685534 30967 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.685845 30967 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.692339 30967 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:04.693873 30967 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:04.694380 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:04.694963 30893 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.695839 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:04.696378 31046 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.696724 31046 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:04.697594 31046 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:04.699764 31046 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.701560 30893 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:04.702941 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:04.704519 32365 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.704990 32365 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:04.705763 32365 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:04.723284 31046 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:04.729540 30797 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.737515 32376 raft_consensus.cc:1064] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:04.740097 32376 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:04.749725 32394 raft_consensus.cc:1064] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:04.758025 31620 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.760201 32365 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.759195 32394 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:04.771809 30893 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.772114 31046 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.775390 31051 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.776995 30976 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.777859 32365 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.778523 31624 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:04.778416 32394 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.781541 32394 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.790052 32365 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:04.797799 32393 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:04.830230 32396 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.833488 32365 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.840965 31046 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.844395 31045 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.850008 31624 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.853464 31620 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.856348 30797 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.865023 30798 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.872699 30976 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:04.886499 30968 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.892387 30901 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.912652 30893 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:04.914790 31046 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:04.916181 31624 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:04.918923 32040 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:04.922794 32422 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:04.929361 30968 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:04.930822 32423 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.932359 31624 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.935876 32380 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:04.937041 31620 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:04.939170 32393 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:04.948493 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6c2e2c3cd614b10b823dd15a66b564a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:04.952296 32394 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.956318 31623 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.962096 31046 raft_consensus.cc:2955] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.967427 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0f1d02ed7d148238e18e004aa55b7d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:04.973043 30968 raft_consensus.cc:2955] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.984189 30798 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 3 to 4, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:04.990104 30797 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 3 to 4, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:04.998942 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f1d02ed7d148238e18e004aa55b7d4 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46178
I20260709 12:24:05.005963 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet d6c2e2c3cd614b10b823dd15a66b564a with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37068
I20260709 12:24:05.025202 32432 tablet_replica.cc:333] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:24:05.026530 32432 raft_consensus.cc:2243] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.027369 32432 raft_consensus.cc:2272] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.027698 32431 tablet_replica.cc:333] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:24:05.028657 32431 raft_consensus.cc:2243] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.029238 32431 raft_consensus.cc:2272] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.031163 32432 ts_tablet_manager.cc:1916] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:05.033010 32431 ts_tablet_manager.cc:1916] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:05.048218 32432 ts_tablet_manager.cc:1929] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:05.049388 32432 log.cc:1199] T d6c2e2c3cd614b10b823dd15a66b564a P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/d6c2e2c3cd614b10b823dd15a66b564a
I20260709 12:24:05.051682 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet d6c2e2c3cd614b10b823dd15a66b564a (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:05.054612 32394 raft_consensus.cc:993] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:05.055141 32380 raft_consensus.cc:1081] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:05.056808 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:24:05.057395 31046 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.057734 31046 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.059362 32396 raft_consensus.cc:1064] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:05.061961 32396 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.064523 32431 ts_tablet_manager.cc:1929] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:05.065107 32431 log.cc:1199] T e0f1d02ed7d148238e18e004aa55b7d4 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/e0f1d02ed7d148238e18e004aa55b7d4
I20260709 12:24:05.067596 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet e0f1d02ed7d148238e18e004aa55b7d4 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:05.067628 31046 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.070654 31046 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:05.073129 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:05.073766 31624 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.076485 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:05.077118 30893 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.077409 30893 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:05.078146 30893 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.079211 30893 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.082422 31620 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:05.084810 30976 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:05.084576 32394 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:05.086934 32380 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:05.096304 31624 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:05.097437 31016 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:05.097574 31623 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:05.098640 32396 raft_consensus.cc:993] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:05.099188 32380 raft_consensus.cc:1081] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:05.100039 32191 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:05.100479 32191 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:05.101274 30968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:59150
I20260709 12:24:05.101208 32191 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.101809 30968 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.102200 30968 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.108734 30968 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.113332 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:05.113867 30901 raft_consensus.cc:3055] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.114146 30901 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:05.114936 30968 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:05.115027 30893 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:05.114859 30901 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.082506 31046 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:05.115980 30901 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.121165 32380 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:05.114868 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:05.123080 31623 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.122970 32394 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.133116 31623 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:05.133814 30901 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:05.133402 31620 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.134238 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:05.136121 32422 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:05.136619 32422 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:05.136258 30795 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.137403 32422 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.153527 30797 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.165830 30968 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.166067 31051 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.184504 30901 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:05.187742 30901 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.188934 32422 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:05.193430 30795 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.196044 31620 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:05.203881 32380 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.204758 31051 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:05.206117 32394 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:05.219069 32439 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.221633 31620 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.236903 30795 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 1 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.249585 31045 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:05.250248 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet f278da50d600410dbed3af60b0147046 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59142
I20260709 12:24:05.252009 32040 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:05.253139 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f278da50d600410dbed3af60b0147046 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:05.259229 31051 raft_consensus.cc:2955] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:05.262778 32442 tablet_replica.cc:333] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:24:05.263693 32442 raft_consensus.cc:2243] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.264317 32442 raft_consensus.cc:2272] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.300355 32442 ts_tablet_manager.cc:1916] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:05.318581 32442 ts_tablet_manager.cc:1929] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:05.318866 32442 log.cc:1199] T f278da50d600410dbed3af60b0147046 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/f278da50d600410dbed3af60b0147046
I20260709 12:24:05.320183 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet f278da50d600410dbed3af60b0147046 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:05.566722 30901 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:05.567910 32422 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.576023 31620 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:05.577575 32423 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.579841 31620 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:05.581259 32341 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.594910 30901 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:05.596366 32341 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.638662 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.674810 30971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:24:05.675328 30971 raft_consensus.cc:606] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:05.677627 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:05.678165 31046 raft_consensus.cc:606] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:05.680583 30971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:24:05.681042 30971 raft_consensus.cc:606] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:05.682009 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:05.683403 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:05.684048 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.773736 32423 raft_consensus.cc:993] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:05.774366 32423 raft_consensus.cc:1081] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:05.776516 30901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:24:05.777036 30901 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.777387 30901 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:05.782948 30901 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.784575 30901 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:05.785115 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:05.785465 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:05.785655 30971 raft_consensus.cc:3055] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:05.785944 30971 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:05.785957 31620 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:05.786602 30971 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.787505 30971 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:05.790323 31620 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:05.791226 30867 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:05.791882 32439 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:05.792176 30971 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:05.792253 32439 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:05.793149 32439 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.802240 30797 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 3, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:05.896656 32191 raft_consensus.cc:993] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:05.897152 32191 raft_consensus.cc:1081] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:05.898680 31623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44888
I20260709 12:24:05.899194 31623 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:05.899518 31623 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.903961 31623 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.905609 31623 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:05.906149 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:05.906562 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:05.906776 30968 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.907094 31051 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.907433 31051 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:05.908073 31051 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.909013 31051 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.912045 30968 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:05.913058 31588 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:05.913684 32342 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:05.914064 32342 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:05.914228 31051 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:05.914861 32342 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:05.923404 30797 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.139843 32040 raft_consensus.cc:993] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:06.140280 32457 raft_consensus.cc:1081] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:06.141779 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46192
I20260709 12:24:06.142298 31046 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.142640 31046 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.147867 31046 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:06.149273 31046 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:06.149852 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:06.150137 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:06.150414 30896 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.150606 30971 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.150899 30971 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:06.151451 30971 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:06.152303 30971 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.154717 30896 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:06.155629 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:06.156261 32341 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.156725 32341 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:06.156898 30971 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:06.157534 32341 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:06.165886 30797 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 3 to 4, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.303963 30971 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:06.305554 32439 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.321663 30896 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.333432 31623 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:06.334882 32439 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:06.338253 31051 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:06.339874 32465 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.340294 30971 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:24:06.343163 30867 consensus_peers.cc:597] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f09ba14cb7054588ae9fdcdedf04b081. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.348459 32465 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.352288 32461 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.363358 31051 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.370004 31046 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.371263 30968 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.380760 30797 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.402021 30968 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:24:06.402472 31016 consensus_peers.cc:597] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42ef8a4823164a83ae72778108c8d593. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.403662 32415 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.407961 30901 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:06.410705 32341 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.415586 32415 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.418660 30968 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.419579 30896 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.432894 30901 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.433684 30796 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.446987 31046 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:06.447590 30971 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:06.448283 32461 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.449210 32465 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:06.451294 30867 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16482c443f7041fa88ccf619697bd7b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.458840 32464 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.461827 31046 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.461481 30967 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.477845 31044 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.479658 30798 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.482095 30968 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.483806 32433 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.486500 31051 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.493201 32433 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:06.496031 31016 consensus_peers.cc:597] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16bdfcb6fd114ab2865524877be18bd1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:06.498868 30896 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:06.500272 32191 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.509588 30967 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:06.514472 32341 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.522605 32341 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.532631 30896 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.543031 30967 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:06.552011 30798 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.610646 30967 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:06.611909 32341 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.617403 30896 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:06.619632 32341 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.723338 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.769218 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:06.769695 30896 raft_consensus.cc:606] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:06.772022 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b078c36427749489d90f67c6504ea82"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:06.772579 31046 raft_consensus.cc:606] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:06.773778 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:06.775349 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:06.776080 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.782886 32465 raft_consensus.cc:993] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:06.783375 32465 raft_consensus.cc:1081] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:06.784789 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:24:06.785266 31046 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.785568 31046 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.791905 31046 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:06.794349 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:06.794914 30896 raft_consensus.cc:3055] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:06.795213 30896 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:06.802547 30896 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:06.803113 32486 ts_tablet_manager.cc:933] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:06.804797 30896 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.806226 32486 tablet_copy_client.cc:323] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:24:06.807992 31060 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 42ef8a4823164a83ae72778108c8d593 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:24:06.808496 31060 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 42ef8a4823164a83ae72778108c8d593 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-42ef8a4823164a83ae72778108c8d593
I20260709 12:24:06.809603 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:06.810207 30967 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.810752 31046 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:06.817471 30967 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:06.818692 31014 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:06.819446 32341 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:06.819952 32341 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:06.820719 32341 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:06.821154 30896 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:06.819605 31060 tablet_copy_source_session.cc:215] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:06.827473 32486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ef8a4823164a83ae72778108c8d593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.875784 32486 tablet_copy_client.cc:806] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:06.878180 32486 tablet_copy_client.cc:670] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:06.880856 30798 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.882714 32486 tablet_copy_client.cc:538] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:06.893733 32486 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:06.921257 32486 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:06.922233 32486 tablet_bootstrap.cc:492] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:06.922945 32486 ts_tablet_manager.cc:1403] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.004s
I20260709 12:24:06.923379 32491 ts_tablet_manager.cc:933] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:06.925279 32491 tablet_copy_client.cc:323] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:24:06.925820 32486 raft_consensus.cc:359] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.926560 32486 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:06.926837 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet f09ba14cb7054588ae9fdcdedf04b081 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:24:06.927103 32486 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.927404 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet f09ba14cb7054588ae9fdcdedf04b081 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-f09ba14cb7054588ae9fdcdedf04b081
I20260709 12:24:06.929445 32486 ts_tablet_manager.cc:1434] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:06.931216 31060 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-42ef8a4823164a83ae72778108c8d593 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:24:06.931638 31060 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-42ef8a4823164a83ae72778108c8d593 on tablet 42ef8a4823164a83ae72778108c8d593 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:06.936470 30911 tablet_copy_source_session.cc:215] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:06.939826 32491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ba14cb7054588ae9fdcdedf04b081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:06.953755 32491 tablet_copy_client.cc:806] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:06.954269 32491 tablet_copy_client.cc:670] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:06.957716 32491 tablet_copy_client.cc:538] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:06.964666 32491 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:06.988272 32491 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:06.989213 32491 tablet_bootstrap.cc:492] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:06.989781 32491 ts_tablet_manager.cc:1403] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 12:24:06.992069 32491 raft_consensus.cc:359] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.992633 32491 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:06.993105 32491 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:06.994804 32491 ts_tablet_manager.cc:1434] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:24:06.999186 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f09ba14cb7054588ae9fdcdedf04b081 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:24:07.001785 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-f09ba14cb7054588ae9fdcdedf04b081 on tablet f09ba14cb7054588ae9fdcdedf04b081 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:07.005367 32488 raft_consensus.cc:993] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:07.005791 32415 raft_consensus.cc:1081] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:07.007854 30901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b078c36427749489d90f67c6504ea82"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:24:07.008364 30901 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.008698 30901 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.013394 30901 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:07.015586 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:07.016148 31046 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:07.016186 30901 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:07.016525 31046 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:07.016995 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:07.017441 31623 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.017307 31046 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:07.018363 31046 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:07.023171 31623 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:07.024385 30867 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:07.025023 32459 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:07.025472 32459 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:07.025875 31046 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:07.026118 32459 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:07.037364 30798 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.067031 32491 ts_tablet_manager.cc:933] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:07.068606 32491 tablet_copy_client.cc:323] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
I20260709 12:24:07.069947 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 16482c443f7041fa88ccf619697bd7b6 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:24:07.070369 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 16482c443f7041fa88ccf619697bd7b6 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-16482c443f7041fa88ccf619697bd7b6
I20260709 12:24:07.076982 32486 ts_tablet_manager.cc:933] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:07.082162 30911 tablet_copy_source_session.cc:215] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:07.085536 32486 tablet_copy_client.cc:323] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:24:07.086961 32491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16482c443f7041fa88ccf619697bd7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:07.090893 31060 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 16bdfcb6fd114ab2865524877be18bd1 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:24:07.091446 31060 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 16bdfcb6fd114ab2865524877be18bd1 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-16bdfcb6fd114ab2865524877be18bd1
I20260709 12:24:07.099030 31060 tablet_copy_source_session.cc:215] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:07.103667 32486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16bdfcb6fd114ab2865524877be18bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:07.104633 32491 tablet_copy_client.cc:806] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:07.106129 32491 tablet_copy_client.cc:670] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:07.110867 32491 tablet_copy_client.cc:538] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:07.117225 32491 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:07.144119 32486 tablet_copy_client.cc:806] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:07.144865 32486 tablet_copy_client.cc:670] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:07.148653 32486 tablet_copy_client.cc:538] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:07.155288 32491 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.156548 32491 tablet_bootstrap.cc:492] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:07.157231 32491 ts_tablet_manager.cc:1403] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.011s
I20260709 12:24:07.157538 32486 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:07.160246 32491 raft_consensus.cc:359] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:07.161108 32491 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:07.161769 32491 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:07.164202 32491 ts_tablet_manager.cc:1434] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:24:07.169252 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-16482c443f7041fa88ccf619697bd7b6 received from {username='slave'} at 127.0.0.1:35494
I20260709 12:24:07.169626 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-16482c443f7041fa88ccf619697bd7b6 on tablet 16482c443f7041fa88ccf619697bd7b6 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:07.187163 32486 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:07.188011 32486 tablet_bootstrap.cc:492] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:07.188540 32486 ts_tablet_manager.cc:1403] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 12:24:07.190521 32486 raft_consensus.cc:359] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:07.191115 32486 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:07.191762 32486 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:07.194264 32486 ts_tablet_manager.cc:1434] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:24:07.196699 31060 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-16bdfcb6fd114ab2865524877be18bd1 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:24:07.197038 31060 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-16bdfcb6fd114ab2865524877be18bd1 on tablet 16bdfcb6fd114ab2865524877be18bd1 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:07.300457 30901 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:07.301509 32341 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:07.324407 30968 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:07.326009 32341 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:07.392648 31623 raft_consensus.cc:1217] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:24:07.407791 31623 raft_consensus.cc:1217] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:24:07.423867 31623 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:07.427786 32464 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:07.445664 31051 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:07.448354 32459 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:07.555291 31623 raft_consensus.cc:1217] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:07.565526 31623 raft_consensus.cc:1217] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:07.832072 32510 raft_consensus.cc:1064] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:07.834028 32510 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:07.854290 31623 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:07.855638 31044 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:07.855916 30971 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:07.856280 32510 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:07.857551 32508 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:07.858214 32509 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:07.878073 32510 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:07.879917 30971 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:07.893038 31623 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:07.898653 30797 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:07.901326 31044 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:07.905607 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:07.989703 30901 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.006166 30968 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:08.007709 31623 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:08.011324 32459 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.012004 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:08.012544 30901 raft_consensus.cc:606] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:08.014730 32459 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.018116 32415 raft_consensus.cc:1064] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:08.020162 31051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:08.020632 32415 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.020728 31051 raft_consensus.cc:606] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:08.024704 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:08.026296 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:08.024660 32464 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.030442 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:08.031293 31624 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:08.030267 31623 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.033913 30971 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:08.032902 32488 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.036499 30901 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:08.037232 32341 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.042747 30971 raft_consensus.cc:2955] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.044406 32341 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.057406 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f09ba14cb7054588ae9fdcdedf04b081 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:08.089682 30796 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index 5 to 6, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.096057 32488 raft_consensus.cc:1064] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:08.097450 32415 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.106109 30967 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.115235 32488 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.120771 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet f09ba14cb7054588ae9fdcdedf04b081 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46178
W20260709 12:24:08.168658 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 51543.2us
I20260709 12:24:08.173265 32527 tablet_replica.cc:333] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:24:08.175257 32527 raft_consensus.cc:2243] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:08.166628 31623 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.182237 30968 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:08.206607 32488 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.182636 31624 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:08.186002 30901 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.209095 32415 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.181890 30798 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.197257 32527 raft_consensus.cc:2272] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:08.198819 32459 raft_consensus.cc:1064] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:08.199590 30896 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:08.272682 32527 ts_tablet_manager.cc:1916] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:08.274926 32526 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.276929 32415 raft_consensus.cc:993] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:08.283010 32459 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.303864 32415 raft_consensus.cc:1081] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:08.320571 30968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:41634
I20260709 12:24:08.321143 30968 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.321496 30968 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.321403 32524 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.333602 30968 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.339504 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:08.340879 31624 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.346410 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:08.346954 31051 raft_consensus.cc:3055] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:08.347249 31051 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:08.350385 31051 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.351358 31051 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.355257 30971 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.369576 30968 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:08.370281 32464 raft_consensus.cc:993] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:08.373267 32464 raft_consensus.cc:1081] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:24:08.346963 31624 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:08.375303 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:08.376068 32040 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.376500 32040 raft_consensus.cc:697] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:08.377173 32040 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.378403 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:24:08.378937 31624 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.379959 31624 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.377154 31046 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.388671 30967 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:08.390591 32488 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.397632 31623 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:08.398384 31046 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:08.399019 32464 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.400020 32509 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.402153 32524 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.409479 31622 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:08.406806 30968 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.407140 31623 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.415410 32488 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.415998 30967 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:08.417280 32510 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.429448 31622 raft_consensus.cc:2955] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.445043 31051 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:08.447541 30796 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.464069 30797 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.466821 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 42ef8a4823164a83ae72778108c8d593 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:08.448632 30901 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.478104 32464 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.479593 32527 ts_tablet_manager.cc:1929] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:24:08.481478 32527 log.cc:1199] T f09ba14cb7054588ae9fdcdedf04b081 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/f09ba14cb7054588ae9fdcdedf04b081
I20260709 12:24:08.483181 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet f09ba14cb7054588ae9fdcdedf04b081 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:08.482685 30967 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.485679 30797 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 5 to 6, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.509087 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 42ef8a4823164a83ae72778108c8d593 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37068
W20260709 12:24:08.516454 32535 log.cc:927] Time spent T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:24:08.521862 31620 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.532395 30797 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.534915 32539 tablet_replica.cc:333] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:24:08.544488 31624 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.547170 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:08.547688 30901 raft_consensus.cc:3055] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:08.548031 30901 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:08.547856 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:08.548622 30967 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.548808 30901 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.549861 30901 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.555501 32539 raft_consensus.cc:2243] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:08.556383 31046 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.561899 30896 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.558275 31624 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:08.564970 32539 raft_consensus.cc:2272] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:08.562249 30901 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:08.566610 31587 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:08.567430 32503 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.567900 32503 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:08.568639 32503 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.570480 30971 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.571946 32510 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.573385 30967 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:08.573756 31624 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.581537 32539 ts_tablet_manager.cc:1916] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:08.581239 32464 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.583204 32509 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.587616 31051 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:08.588956 30967 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.590216 31624 raft_consensus.cc:2955] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.598628 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16482c443f7041fa88ccf619697bd7b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:08.600540 31620 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.602011 32524 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.609668 30797 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 4 to 5, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.616228 32415 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.625559 30896 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.626266 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet 16482c443f7041fa88ccf619697bd7b6 with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46178
I20260709 12:24:08.627311 32527 tablet_replica.cc:333] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:24:08.628021 32526 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.628386 32527 raft_consensus.cc:2243] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:08.618705 30798 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.629269 32527 raft_consensus.cc:2272] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:08.629925 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16bdfcb6fd114ab2865524877be18bd1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:08.628239 31624 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.632941 32527 ts_tablet_manager.cc:1916] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:08.634672 30896 raft_consensus.cc:2955] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:08.660521 30794 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 4 to 5, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:08.668006 32527 ts_tablet_manager.cc:1929] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:08.668448 32527 log.cc:1199] T 16482c443f7041fa88ccf619697bd7b6 P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/16482c443f7041fa88ccf619697bd7b6
I20260709 12:24:08.670212 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet 16482c443f7041fa88ccf619697bd7b6 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:08.664700 32539 ts_tablet_manager.cc:1929] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:24:08.672050 32539 log.cc:1199] T 42ef8a4823164a83ae72778108c8d593 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/42ef8a4823164a83ae72778108c8d593
I20260709 12:24:08.674265 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 42ef8a4823164a83ae72778108c8d593 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:08.676761 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 16bdfcb6fd114ab2865524877be18bd1 with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59142
I20260709 12:24:08.678437 32541 tablet_replica.cc:333] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:24:08.681286 32541 raft_consensus.cc:2243] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:08.682003 32541 raft_consensus.cc:2272] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:08.686316 32541 ts_tablet_manager.cc:1916] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:08.699064 32541 ts_tablet_manager.cc:1929] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:08.699535 32541 log.cc:1199] T 16bdfcb6fd114ab2865524877be18bd1 P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/16bdfcb6fd114ab2865524877be18bd1
I20260709 12:24:08.701179 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 16bdfcb6fd114ab2865524877be18bd1 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:08.773339 31051 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.774717 32040 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.784153 31624 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.788031 32531 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:08.980005 30896 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.981088 32503 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.989493 30971 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:08.992024 32550 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:09.151983 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.188938 30967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:55610
I20260709 12:24:09.189558 30967 raft_consensus.cc:606] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:09.190615 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:09.192139 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.192725 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.479107 32545 raft_consensus.cc:993] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:09.479530 32531 raft_consensus.cc:1081] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:09.480875 30901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:24:09.481351 30901 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.481586 30901 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.486002 30901 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:09.488082 30901 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:09.488276 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:09.488595 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:09.488862 30967 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:09.489101 31046 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.489224 30967 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:09.489935 30967 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:09.490999 30967 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.495143 31046 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:09.496368 30864 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:09.497222 30967 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:09.497022 32509 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:09.498394 32509 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:09.499828 32509 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:09.510838 30795 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 3, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.741950 30967 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:09.747541 30901 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:09.747846 31051 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:24:09.747987 30942 consensus_peers.cc:597] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 217b561ab05e4c71be81abf723e3c499. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.748709 32545 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:09.749401 32531 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:09.756347 32531 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.757984 31051 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.760468 30896 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.776625 31051 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:09.773264 30795 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.784194 30967 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:09.785892 32524 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:09.788719 31016 consensus_peers.cc:597] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f02e5ab61a44506bdae958f8a275d96. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.790630 30896 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:09.792557 32524 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:09.803025 32526 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.805018 30967 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.818274 31051 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:09.830053 30794 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:09.849020 31016 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94b5c1c64c494cb59ba74a90317df87d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.850257 30971 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:09.864496 32526 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:09.855888 30896 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:09.867452 32526 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:09.863938 30901 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.880645 32526 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.882889 30967 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:09.884689 32509 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:09.890324 30967 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.894781 30968 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:09.927438 30794 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.928934 31046 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:09.931816 32509 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:09.932518 30896 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.935776 31046 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:09.937245 32546 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:09.938838 30942 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c773fc74822844b7aec9509683eb266e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.940392 30901 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:09.943568 32546 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:09.964733 32545 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.967274 31046 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:09.985004 30896 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:10.001266 30799 catalog_manager.cc:5697] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: config changed from index -1 to 2, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 1 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:24:10.127331 32580 ts_tablet_manager.cc:933] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:10.128921 32580 tablet_copy_client.cc:323] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:24:10.130203 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet 217b561ab05e4c71be81abf723e3c499 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:24:10.130617 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet 217b561ab05e4c71be81abf723e3c499 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-217b561ab05e4c71be81abf723e3c499
I20260709 12:24:10.136541 30986 tablet_copy_source_session.cc:215] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:10.140137 32580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217b561ab05e4c71be81abf723e3c499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:10.152226 32580 tablet_copy_client.cc:806] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:10.152726 32580 tablet_copy_client.cc:670] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:10.156903 32580 tablet_copy_client.cc:538] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:10.165992 32580 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:10.189795 32580 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.190671 32580 tablet_bootstrap.cc:492] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:10.191337 32580 ts_tablet_manager.cc:1403] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.009s
I20260709 12:24:10.194257 32580 raft_consensus.cc:359] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.195061 32580 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:10.195698 32580 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.198103 32580 ts_tablet_manager.cc:1434] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:24:10.200001 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-217b561ab05e4c71be81abf723e3c499 received from {username='slave'} at 127.0.0.1:59852
I20260709 12:24:10.200402 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-217b561ab05e4c71be81abf723e3c499 on tablet 217b561ab05e4c71be81abf723e3c499 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:10.228392 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.241478 32580 ts_tablet_manager.cc:933] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:10.243672 32580 tablet_copy_client.cc:323] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:24:10.245326 31060 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 94b5c1c64c494cb59ba74a90317df87d from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:24:10.245800 31060 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 94b5c1c64c494cb59ba74a90317df87d from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-94b5c1c64c494cb59ba74a90317df87d
I20260709 12:24:10.253458 31060 tablet_copy_source_session.cc:215] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:10.256271 32580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b5c1c64c494cb59ba74a90317df87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:10.270932 32580 tablet_copy_client.cc:806] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:10.271518 32580 tablet_copy_client.cc:670] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:10.275595 32580 tablet_copy_client.cc:538] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:10.288877 32584 ts_tablet_manager.cc:933] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:10.289415 32580 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:10.293382 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:10.293977 30896 raft_consensus.cc:606] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:10.299089 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:10.300690 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:10.301416 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.303241 32584 tablet_copy_client.cc:323] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.3:38505
I20260709 12:24:10.305341 31060 tablet_copy_service.cc:140] P 1a7b44e2d0ed440985e5f643a5a54587: Received BeginTabletCopySession request for tablet 8f02e5ab61a44506bdae958f8a275d96 from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:34990)
I20260709 12:24:10.305920 31060 tablet_copy_service.cc:161] P 1a7b44e2d0ed440985e5f643a5a54587: Beginning new tablet copy session on tablet 8f02e5ab61a44506bdae958f8a275d96 from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:34990: session id = 9f38f761eded4f28b9d802f6570ee71e-8f02e5ab61a44506bdae958f8a275d96
I20260709 12:24:10.321668 31060 tablet_copy_source_session.cc:215] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:10.323027 32580 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.324021 32580 tablet_bootstrap.cc:492] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:10.324726 32580 ts_tablet_manager.cc:1403] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.011s
I20260709 12:24:10.328969 32580 raft_consensus.cc:359] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.329839 32580 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:10.330510 32580 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.333230 32580 ts_tablet_manager.cc:1434] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:24:10.336244 31061 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-94b5c1c64c494cb59ba74a90317df87d received from {username='slave'} at 127.0.0.1:34990
I20260709 12:24:10.336663 31061 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-94b5c1c64c494cb59ba74a90317df87d on tablet 94b5c1c64c494cb59ba74a90317df87d with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:10.339123 32584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f02e5ab61a44506bdae958f8a275d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:10.369233 32584 tablet_copy_client.cc:806] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:10.371097 32584 tablet_copy_client.cc:670] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:10.374840 32584 tablet_copy_client.cc:538] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:10.383708 32584 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:10.410491 32584 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.411409 32584 tablet_bootstrap.cc:492] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:10.412083 32584 ts_tablet_manager.cc:1403] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.010s
I20260709 12:24:10.414332 32584 raft_consensus.cc:359] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.414865 32584 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:10.415375 32584 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.417213 32584 ts_tablet_manager.cc:1434] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 12:24:10.418841 31060 tablet_copy_service.cc:342] P 1a7b44e2d0ed440985e5f643a5a54587: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-8f02e5ab61a44506bdae958f8a275d96 received from {username='slave'} at 127.0.0.1:34990
I20260709 12:24:10.419157 31060 tablet_copy_service.cc:434] P 1a7b44e2d0ed440985e5f643a5a54587: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-8f02e5ab61a44506bdae958f8a275d96 on tablet 8f02e5ab61a44506bdae958f8a275d96 with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:10.447952 32459 raft_consensus.cc:993] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:10.448484 32554 raft_consensus.cc:1081] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Signalling peer 1a7b44e2d0ed440985e5f643a5a54587 to start an election
I20260709 12:24:10.450063 31046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:46204
I20260709 12:24:10.450610 31046 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:10.451754 32584 ts_tablet_manager.cc:933] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:10.450976 31046 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.459121 31046 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:10.461972 32584 tablet_copy_client.cc:323] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.2:39975
I20260709 12:24:10.462267 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:10.462831 30896 raft_consensus.cc:3055] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:10.463104 30896 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:10.463371 30986 tablet_copy_service.cc:140] P f868402d5ae640e7b362b9fddacbaf44: Received BeginTabletCopySession request for tablet c773fc74822844b7aec9509683eb266e from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:59852)
I20260709 12:24:10.463896 30986 tablet_copy_service.cc:161] P f868402d5ae640e7b362b9fddacbaf44: Beginning new tablet copy session on tablet c773fc74822844b7aec9509683eb266e from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:59852: session id = 9f38f761eded4f28b9d802f6570ee71e-c773fc74822844b7aec9509683eb266e
I20260709 12:24:10.463778 30896 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:10.464897 30896 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.471570 30986 tablet_copy_source_session.cc:215] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:10.471866 30896 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:10.472977 31046 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:10.474535 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:10.474890 31013 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:10.475036 30968 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.475653 32524 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:10.476140 32524 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:10.476408 32584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c773fc74822844b7aec9509683eb266e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:10.476954 32524 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:10.487037 30968 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:10.491418 32584 tablet_copy_client.cc:806] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:10.492061 32584 tablet_copy_client.cc:670] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:10.497272 32584 tablet_copy_client.cc:538] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:10.500062 30799 catalog_manager.cc:5697] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.515358 32584 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:24:10.543973 32584 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:10.544941 32584 tablet_bootstrap.cc:492] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:24:10.545673 32584 ts_tablet_manager.cc:1403] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 12:24:10.548593 32584 raft_consensus.cc:359] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.549467 32584 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:24:10.550092 32584 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:10.552652 32584 ts_tablet_manager.cc:1434] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:10.556972 30986 tablet_copy_service.cc:342] P f868402d5ae640e7b362b9fddacbaf44: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c773fc74822844b7aec9509683eb266e received from {username='slave'} at 127.0.0.1:59852
I20260709 12:24:10.557405 30986 tablet_copy_service.cc:434] P f868402d5ae640e7b362b9fddacbaf44: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-c773fc74822844b7aec9509683eb266e on tablet c773fc74822844b7aec9509683eb266e with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:10.576884 31624 raft_consensus.cc:1217] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:10.731699 31624 raft_consensus.cc:1217] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:10.849974 31624 raft_consensus.cc:1217] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:24:10.874884 31624 raft_consensus.cc:1217] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:10.937176 30967 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:10.938172 32524 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:10.972483 30901 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:10.976799 32590 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.004607 32578 raft_consensus.cc:1064] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:11.007323 32578 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:11.014288 31046 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:11.015918 31620 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:11.015988 30901 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:11.017251 32578 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:11.018083 32546 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:11.019237 32592 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:11.052688 32546 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:11.055392 31046 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:11.055477 30896 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:11.064358 31620 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:11.068269 30795 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.108345 30967 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:11.113955 31620 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.115819 32546 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.120267 31046 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.121948 32546 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.125897 32546 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:11.129498 31624 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:11.136452 30784 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 217b561ab05e4c71be81abf723e3c499 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:11.141139 31046 raft_consensus.cc:2955] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:11.387663 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:12.243229 30830 debug-util.cc:398] Leaking SignalData structure 0x7b080003a1e0 after lost signal to thread 29735
I20260709 12:24:13.618240 30799 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 4 to 5, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:13.866439 32610 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.868824 32610 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:13.876696 32610 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:13.877385 32610 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:13.878252 32610 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.881268 32610 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:13.882668 32617 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.883049 32611 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.884354 32609 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.886370 32614 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.887094 32609 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:13.887266 32614 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.889773 32609 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:13.890383 32609 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:13.890586 32620 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.891304 32620 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.893180 32611 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:13.893841 32620 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:13.895200 32614 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:13.891176 32609 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.884738 32610 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.896286 32610 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.896319 32617 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:13.898790 32609 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:13.885505 32615 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.885968 32618 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:13.903391 32618 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.902073 32617 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:13.895608 32611 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:13.908970 32620 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:13.916872 32620 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.910802 32619 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:13.919977 32609 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:13.943819 32609 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.945102 32612 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:13.946015 32612 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.947098 32615 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:13.947854 32614 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:13.948572 32614 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.275413 32626 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.280339 32631 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:14.281134 32631 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.278757 32644 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.284989 32621 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.285815 32621 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:14.303929 32625 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:13.998135 31589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.761s	user 0.000s	sys 0.030s
I20260709 12:24:13.975682 32550 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.233292 32459 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:13.953600 32612 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:14.017602 32532 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:13.949856 32615 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:14.274274 32620 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:14.332970 32550 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.005834 32613 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.053350 32526 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.373838 32526 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:14.274121 32609 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:13.982286 32610 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:13.994741 32616 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:14.029922 32546 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:14.366238 31589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.130s	user 0.008s	sys 0.038s
I20260709 12:24:14.064189 32611 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.375877 32637 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:14.256677 32509 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.060456 32590 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:14.279677 32626 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.383792 32627 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.334162 32631 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:14.015941 32599 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.377771 32616 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.284950 32644 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:13.950246 32619 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.792055 32622 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:14.547188 30864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.253s	user 0.039s	sys 0.028s
I20260709 12:24:14.379635 32615 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.835826 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:14.435355 32459 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.736886 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:14.822422 32635 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.076885 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:15.111961 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:14.723883 32624 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.130064 32645 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.123034 32661 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.844913 32641 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.094270 32642 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.465049 32509 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.765550 32633 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.173575 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:15.131757 32644 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.130079 32652 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.228475 32644 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.228580 32619 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.130177 32643 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.132829 32658 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.113127 32631 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:14.954573 32654 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.733628 32550 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:14.681423 32636 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:14.451050 32614 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.129961 32612 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.124223 32649 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.575153 32620 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.176705 32621 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:14.857285 32616 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:14.526103 32629 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.098584 32626 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:14.793699 32618 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:14.412847 32609 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.231895 30899 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:14.816262 32623 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.412593 32610 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:14.622696 32617 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.799633 32656 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.547920 32632 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.572840 32526 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:14.613351 32630 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.575300 32611 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:15.130970 32628 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:14.816357 32590 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.386747 32532 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.801244 32660 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:14.571596 32634 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.096489 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:15.234076 32550 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.226454 32641 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.248922 32618 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.800765 32647 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.800261 32657 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:14.386775 32546 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.112108 32655 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.249727 32609 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.232249 32619 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.888216 32638 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:14.572979 32640 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:14.548847 32637 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.880172 32646 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.225104 32645 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.228675 32652 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.225063 32624 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.225476 32661 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:14.882364 32627 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:14.802160 32662 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:14.885878 32599 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.227319 32642 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.471483 32610 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.231362 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:14.492419 32625 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:14.464831 32613 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.482875 32626 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.336450 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:15.249708 32459 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.249521 32635 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.483444 32637 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.499648 32653 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.471479 32550 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.504482 32641 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.263831 32631 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.471963 32655 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.278961 32509 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:15.314574 30830 debug-util.cc:398] Leaking SignalData structure 0x7b0800067f20 after lost signal to thread 30833
I20260709 12:24:15.246411 32644 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.252434 32621 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.491132 32646 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.491451 32618 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.506042 32590 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.457860 32612 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.471566 32620 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.271330 32615 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.513329 30901 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:24:15.522270 32648 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.525300 32613 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.526959 32599 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.528628 32642 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.530287 32625 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.281570 32654 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.491052 32650 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.532452 31624 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:15.516752 32637 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.470716 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412c07102f934870a9035bbc8463f79a"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:15.516572 32617 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.250231 32622 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.471563 32647 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.234026 32633 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.511757 32619 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.553097 32635 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.558868 31046 raft_consensus.cc:606] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:15.518275 32623 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.458354 32629 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.563211 32637 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.262179 32649 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.311407 32658 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.499782 32632 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.563586 32653 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.521076 32640 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.563651 32618 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:15.562104 30830 debug-util.cc:398] Leaking SignalData structure 0x7b0800335de0 after lost signal to thread 30925
I20260709 12:24:15.315093 32636 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.298472 32643 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.555773 32626 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.557024 32621 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.532871 32634 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.518702 32628 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.598555 32667 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:15.599066 31014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.666s (SENT)
I20260709 12:24:15.522948 32662 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.531426 32656 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.513419 32638 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:15.602150 31590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.013s	sys 0.038s
I20260709 12:24:15.546446 32657 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.611176 32615 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:15.579871 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 176785us
I20260709 12:24:15.592417 32665 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.569446 32648 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.612901 32609 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.520627 32660 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:15.628652 30830 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9a00 after lost signal to thread 31000
I20260709 12:24:15.551333 32630 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.622040 32611 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.640396 32623 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:15.616120 31590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.013s	sys 0.038s
W20260709 12:24:15.637542 30830 debug-util.cc:398] Leaking SignalData structure 0x7b0800337c40 after lost signal to thread 31001
I20260709 12:24:15.634001 32617 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.633772 32532 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.635653 32645 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.616878 32665 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.656383 32627 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.643875 32610 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.627904 31618 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:15.600232 32650 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.662353 32636 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.666817 32629 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.648705 32620 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.651882 32644 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.671850 32655 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.680616 32633 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.681705 32638 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.682726 32665 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.668026 32612 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.668556 32623 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.622287 32667 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.673381 32652 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:15.704336 31589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.024s	sys 0.038s
W20260709 12:24:15.705739 31589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.024s	sys 0.038s
I20260709 12:24:15.674511 32546 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:15.706939 30864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.431s	user 0.048s	sys 0.064s
W20260709 12:24:15.695400 30830 debug-util.cc:398] Leaking SignalData structure 0x7b08000d0ae0 after lost signal to thread 31075
I20260709 12:24:15.707621 32627 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.678994 32661 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.712062 32623 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.701936 32637 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.700552 32624 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:15.707540 30865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.000s	sys 0.085s
I20260709 12:24:15.710309 32646 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.710131 32653 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.711336 32638 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.732992 32638 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.735149 32638 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.724465 32626 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:15.710819 30830 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5c00 after lost signal to thread 31076
I20260709 12:24:15.729724 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 12:24:15.738459 31587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.027s	sys 0.084s
W20260709 12:24:15.738737 31587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.027s	sys 0.084s
I20260709 12:24:15.739563 32663 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.740417 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:15.728528 30865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.001s	sys 0.085s
W20260709 12:24:15.741549 30939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.048s	sys 0.073s
W20260709 12:24:15.741833 30939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.048s	sys 0.073s
I20260709 12:24:15.742237 32626 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.742560 32680 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.721251 32647 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.725950 32621 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.722644 32658 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.722504 32654 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.722829 32622 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.740101 32663 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.741334 32640 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.742985 32643 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.729702 32628 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.747579 32637 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.726040 32627 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.763006 32671 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:15.758791 31015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.016s
I20260709 12:24:15.742800 32646 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.758458 32638 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.742798 32626 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:15.764986 30830 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5080 after lost signal to thread 31649
W20260709 12:24:15.766832 31016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.007s	sys 0.009s
W20260709 12:24:15.766393 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 208643us
W20260709 12:24:15.768253 31016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.007s	sys 0.009s
I20260709 12:24:15.759933 32676 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.768885 32676 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.770880 32634 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:15.771425 30942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.001s	sys 0.000s
W20260709 12:24:15.771696 30942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.000s
W20260709 12:24:15.771867 31015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.011s	sys 0.016s
I20260709 12:24:15.747449 32649 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.779837 32637 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:15.780548 32664 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.142s	user 0.001s	sys 0.001s
I20260709 12:24:15.789678 32628 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.790050 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.790439 32616 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:15.767588 32654 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.796727 32677 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.772295 32621 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.775916 32663 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:15.781001 30830 debug-util.cc:398] Leaking SignalData structure 0x7b0800319800 after lost signal to thread 31650
I20260709 12:24:15.781340 32622 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.801936 32626 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.803062 32532 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.791668 32634 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.790961 32616 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.786916 32657 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.758659 32680 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.791931 32667 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.797883 32646 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.803359 32649 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.821820 32662 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.827261 32676 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.828629 32649 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.823346 32612 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.810786 32673 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.825163 32632 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.826669 32616 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.790266 32628 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:15.830868 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.016s	sys 0.075s
I20260709 12:24:15.817695 32623 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:15.801172 32638 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.836052 32680 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:15.832475 32646 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.029968 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:15.822646 32621 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.994302 32637 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.044288 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:15.994900 32627 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.802122 32671 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.996567 32616 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.996999 32655 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.994302 32550 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:15.999198 32628 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.004601 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.005743 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.006127 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.006728 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.007222 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.010332 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.010108 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:15.836993 32673 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.831377 32622 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.011686 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:15.830845 32612 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.810951 32670 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:15.826566 32615 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.818274 32677 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:15.931679 32669 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:15.816875 32661 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:15.835041 32634 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.834275 32532 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:15.805112 32654 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.018934 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.021059 32649 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:16.024755 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.017s	sys 0.075s
I20260709 12:24:16.016076 32660 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.033850 32638 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.035893 32619 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.037753 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.039151 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.044886 31623 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:24:16.061775 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.065800 31044 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:16.099131 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.099275 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.101903 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.074308 31049 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:16.453202 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.101532 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:16.457238 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 1.27462e+06us
I20260709 12:24:16.456300 30976 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:16.100301 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.471537 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.472113 31623 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:24:16.102087 32656 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.324532 32650 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:16.394395 31618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 656) took 1223 ms (client timeout 1576 ms). Trace:
W20260709 12:24:16.474375 31618 rpcz_store.cc:269] 0709 12:24:15.171056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.171319 (+   263us) service_pool.cc:224] Handling call
0709 12:24:16.394182 (+1222863us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b5400107054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:16.394303 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904361856}
I20260709 12:24:16.312904 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.333866 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.475886 30975 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:16.476140 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.476869 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.477422 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.470891 31042 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:16.478008 30968 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:16.478159 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.478824 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.478835 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.477550 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.463310 32615 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.480196 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.480494 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.480677 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.324697 32671 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.481055 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.220873 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.481948 30973 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:16.481989 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.481138 31619 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.482934 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.361752 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.483566 30975 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:16.482437 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.483513 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.482113 31043 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
W20260709 12:24:16.222980 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 46934.5us
I20260709 12:24:16.451100 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.099174 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1706) took 1364 ms. Trace:
I20260709 12:24:16.415864 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.489748 30971 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:16.481562 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.306519 32677 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.393034 32648 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.100159 32616 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.078799 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.483487 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.494118 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.502672 31050 raft_consensus.cc:1813] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Handling vote request from an unknown peer 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:16.504267 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.494283 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.488826 30896 rpcz_store.cc:276] 0709 12:24:14.712041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.712239 (+   198us) service_pool.cc:224] Handling call
0709 12:24:14.712782 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:15.614262 (+901480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:15.614295 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:15.614341 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:15.614370 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.075656 (+461286us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54002323d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:16.075706 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.076056 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055462144}
I20260709 12:24:16.496165 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.101852 32673 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.486253 32621 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.306753 32622 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.504482 31050 raft_consensus.cc:2410] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:24:16.513819 32616 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.506250 31044 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:16.514575 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.514989 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.515175 31050 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:16.502322 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.517036 32532 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.517757 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.518411 32615 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.520004 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.521450 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.097766 32655 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:16.511456 30864 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:16.521966 30975 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:16.521860 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.522773 31051 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:16.522912 31044 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:16.519971 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.523810 32655 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:16.100625 32670 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.524857 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.521803 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.525847 32670 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.523765 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.527083 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.528518 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.393955 32631 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:16.526054 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.503332 32630 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.526142 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.501609 32669 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:16.494321 32661 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:16.673154 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 161764us
I20260709 12:24:16.675844 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.574141 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.646479 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.573351 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.642401 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.629241 30867 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:16.678014 31621 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:24:16.682346 32620 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.682721 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.671211 31587 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.672348 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.510239 32612 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.670394 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.690004 31619 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:16.692721 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.680380 32634 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.573786 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.682794 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.693408 30973 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:24:16.682741 32620 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.692889 31587 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.692317 32654 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.691820 32631 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:16.704408 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 132034us
I20260709 12:24:16.701799 30864 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:16.690032 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.698220 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.691004 32677 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:16.706887 31044 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:16.707640 32621 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:16.709712 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.710464 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.697691 32622 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.694425 32532 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:16.711707 32459 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:16.697525 32660 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:16.712337 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.713562 30864 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:16.703060 32619 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:16.715689 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.712795 30867 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.703706 32673 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:16.699548 32620 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.714617 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.713398 32459 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:16.700053 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.715191 30973 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:16.700672 31618 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:24:16.709597 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.716378 31048 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:16.718181 32459 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.715988 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.721014 30971 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:16.715758 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.712209 32622 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.724560 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.725854 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.728348 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.717211 32532 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.725895 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.726387 31047 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:16.730834 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.717696 32673 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.731963 32673 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.720299 32660 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:16.734457 30900 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:16.723002 32621 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.735467 32621 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.735872 32621 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.736459 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.726301 32622 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.718133 32631 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.723282 32639 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.739188 32639 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.739570 32639 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.746904 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.747630 31051 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:16.762867 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.763595 32669 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.775490 32631 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:16.778268 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.778605 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.779569 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.779783 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.781018 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.782357 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.782529 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.783550 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.724539 32619 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:16.784255 32660 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.785030 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.788801 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.789965 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.788758 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.718612 32677 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.727478 31587 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:16.798673 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 71265.2us
W20260709 12:24:16.827850 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 135650us
I20260709 12:24:16.831457 31587 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.795120 32661 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.833643 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.834717 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.833647 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.834431 30976 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:16.836159 32550 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.837172 32550 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.837515 32550 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.840005 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.840986 32638 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.841447 32638 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.841809 32638 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.799818 32532 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.817649 32631 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:16.847823 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 134306us
I20260709 12:24:16.849701 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.850315 30976 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:16.850919 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.840907 32677 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.851051 32620 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:16.851529 31587 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.852190 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.849318 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:16.852797 31587 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.855262 32654 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.855480 32532 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:16.855825 32654 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.856258 32654 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.856253 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.860033 32459 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.860846 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.861416 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.861699 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.861999 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.843129 32639 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:16.864691 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.865113 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.862577 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.865325 32622 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.866374 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.868258 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.868405 32459 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.869055 32622 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.869670 32532 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.870124 32532 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.866439 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.872219 32459 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.872606 32459 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.872877 32459 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.873735 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.874286 30976 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:16.875051 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.853943 32619 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.849057 32631 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.879593 32459 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:16.876852 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.881486 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.881754 30892 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.883917 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.882088 30895 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.884492 32550 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.885464 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.886021 30900 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.886536 32550 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.886984 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.887785 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.884546 31615 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:24:16.899286 32620 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.899910 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.900635 30892 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.901331 32639 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.902490 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.902822 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.903091 30900 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:24:16.904915 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.907060 32654 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.895021 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.913909 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.914086 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.914414 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.914934 31016 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.915131 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.882571 32631 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.915433 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.882445 32638 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.916065 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.884557 32673 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.907686 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.916790 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.917142 30895 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:24:16.915035 31615 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:16.892184 32459 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:16.910669 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 197936us
I20260709 12:24:16.911643 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.911875 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.912230 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.912865 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.895093 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.922217 32673 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.922780 32621 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.923411 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:16.924865 32634 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.925274 32634 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:16.920706 32655 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.920847 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.928762 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.929076 32654 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.917385 30892 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.921397 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:16.932456 31615 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:16.932524 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.933228 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.933459 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.933655 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.934063 32615 raft_consensus.cc:1064] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:16.934072 30893 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.934463 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.935613 32612 raft_consensus.cc:1064] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:16.937870 32612 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.939960 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.925805 32634 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.949644 32630 raft_consensus.cc:1064] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
I20260709 12:24:16.951541 32634 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:16.910841 30864 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:16.920406 30867 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:16.925040 31014 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:16.966812 32459 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:16.967217 32459 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:16.966722 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 55958.1us
I20260709 12:24:16.967870 32670 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:16.968236 32670 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:16.968611 32670 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.928104 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.930145 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.931195 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.931883 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:16.953588 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.952200 32630 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.956439 32615 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.957536 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:16.975541 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 85568.6us
I20260709 12:24:16.959615 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.959925 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.960912 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.925307 32621 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:16.964159 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.966305 32638 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:16.926787 32655 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:16.967545 32459 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.927805 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.984787 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.971189 31014 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:16.976397 32619 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:16.986061 32619 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:16.986443 32619 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:16.972477 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.972900 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.974186 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:16.974200 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 53866.4us
I20260709 12:24:16.975225 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.958531 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.976334 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.976033 30895 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:16.977240 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.965485 32532 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:16.978117 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.978109 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:17.002362 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:17.004999 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:17.005784 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:17.000962 31588 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.007663 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:17.008039 31588 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:16.979635 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.965245 31016 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:16.979591 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:16.979199 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.983083 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:17.020236 31588 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:17.022006 31588 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.022802 31588 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.020972 30896 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:16.983489 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.983050 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.988782 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:16.994544 32692 raft_consensus.cc:993] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:16.983012 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:16.987309 32655 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.996248 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.009711 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.012313 30900 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.015610 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.017300 30901 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:17.018098 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52957.5us
I20260709 12:24:17.046432 31016 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.025367 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:16.998772 32631 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.000739 32649 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.044756 32638 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.047040 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.045645 30893 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:17.044746 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.026772 32550 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.026984 32616 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.053232 32694 raft_consensus.cc:1081] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:17.056488 32695 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.064730 31016 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:17.068251 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 85556.8us
I20260709 12:24:17.068709 30939 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.028162 32688 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.070426 30895 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:17.070815 32650 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.071480 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.049866 32649 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.068626 32638 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.068990 32550 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.074349 32532 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.029989 32673 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.082098 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.047577 32677 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:17.069360 32648 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.082722 32650 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:17.088016 32649 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.076123 32616 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.093962 32459 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.075944 32689 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.080157 32688 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.089965 32692 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.093683 30942 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.089466 32638 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.080502 32695 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.092516 32550 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.099255 32459 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.098389 32688 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.093055 32673 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.093436 32691 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.095963 32650 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.097591 32689 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.124092 32655 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.111478 32701 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.097810 32616 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.125742 32701 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.126169 32701 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.126437 32655 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.095021 32648 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.115430 32698 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.131960 32648 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.132062 32698 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.132678 32698 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.134292 32701 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.137950 32650 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.139823 32698 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.143507 32648 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.143987 32701 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.147039 32650 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.144246 32616 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.148322 32648 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.149096 32698 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.112586 32700 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.121019 32689 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.152932 32631 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.116415 32634 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.108951 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:17.107031 32695 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.116263 32673 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:17.154021 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 131276us
I20260709 12:24:17.116704 32691 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:17.162783 31588 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.164254 31588 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.102427 32677 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.149117 32616 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:17.169040 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 172840us
I20260709 12:24:17.178030 31014 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.171787 32693 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.172915 32622 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.172837 32691 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:17.198371 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 133769us
I20260709 12:24:17.188580 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.199213 31016 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.206286 31016 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.206844 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.188724 32696 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:17.210520 32615 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.211079 31016 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:17.172704 32619 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.213709 31016 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.194396 32622 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.216439 32615 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.215554 32622 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.217711 32677 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.207670 32612 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.208935 32634 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.209067 32616 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.211993 32696 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.210969 32550 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.229352 32550 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.216863 32615 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.232524 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.230597 32696 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.227084 32704 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.238937 32615 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.252590 32619 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.256248 32649 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.269659 32673 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.274324 32649 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.226819 32670 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.225189 32695 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.278131 32670 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.279857 32673 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.285866 32622 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.287189 32691 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.287611 32638 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.288544 32622 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.288658 31622 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.289217 32691 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.293790 32689 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.294891 31617 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:17.496575 32638 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.496414 32695 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.500172 32689 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.499307 32688 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.503659 32615 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.504726 32688 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.505712 32615 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.506318 32696 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.508616 32696 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:17.531386 30892 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.538779 31621 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:17.539887 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.540902 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.541785 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:17.542623 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.543455 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:17.544250 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.544277 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:17.544914 31621 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.551239 31621 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:17.553959 31621 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.570905 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.571537 31624 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:17.607640 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:17.616227 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.633193 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.634402 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.635771 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.636085 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.636507 30898 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:17.637224 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.637280 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.637936 30898 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:17.638235 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.638662 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.639207 30898 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:17.634518 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.643651 30897 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:17.644625 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.645563 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.631485 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.646163 31618 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:17.646675 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.647292 30896 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:17.643128 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 593762us
I20260709 12:24:17.667850 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.668889 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.669323 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.670230 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.671674 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.674726 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.675805 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.676813 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.676899 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.677847 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.677903 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.678999 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.639213 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.679973 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.672107 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.672942 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.673419 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.671766 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.683574 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.685972 32704 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.686364 32704 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:17.686702 32704 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.688390 31046 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.688966 31047 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.690274 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:17.690671 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.692219 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:17.692751 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:17.692942 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.691735 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.694064 31045 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:17.694204 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.694178 31046 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:17.695436 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.695616 31045 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:17.694068 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.696266 30892 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:17.697093 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.699510 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.701435 32704 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.702881 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.704605 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.704841 30867 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.705678 32704 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.706521 30895 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:17.707367 32713 consensus_queue.cc:1059] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:17.710184 32714 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:17.713083 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:17.714607 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.715444 30895 raft_consensus.cc:2393] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:17.717054 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.718461 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.718780 30867 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.717453 32716 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.721660 32714 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.725041 32718 consensus_queue.cc:1059] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:17.721411 32719 consensus_queue.cc:1059] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:17.726789 32718 consensus_queue.cc:1059] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:17.731102 30867 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.728847 32714 consensus_queue.cc:1059] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:17.730492 32721 raft_consensus.cc:3055] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:17.731086 32550 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:17.731632 30895 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:17.738732 32722 raft_consensus.cc:3055] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:17.741044 32719 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.741432 32702 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:17.741806 32702 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:17.742669 32702 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.741446 32722 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.744976 32719 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:17.745435 32719 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.745672 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.746449 32719 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.747469 32714 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.745034 32721 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.746862 30867 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.747960 32719 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.749689 32721 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.744376 32722 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.752651 32714 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.751004 32721 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.753701 32722 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.752133 30867 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:17.752008 30895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "412c07102f934870a9035bbc8463f79a"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:24:17.742687 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.760552 32718 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.760210 30895 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.761732 30895 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:17.766234 31014 leader_election.cc:336] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.666s (SENT)
I20260709 12:24:17.766708 31014 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.767939 32692 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.770021 30899 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:17.771255 30899 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:24:17.771840 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 59134.5us
W20260709 12:24:17.773450 30939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.007s	sys 0.004s
W20260709 12:24:17.773874 30939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.007s	sys 0.004s
W20260709 12:24:17.774170 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 692118us
I20260709 12:24:17.774737 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.757812 32714 raft_consensus.cc:3055] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:17.775501 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.775570 32714 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.776469 32671 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.776890 32671 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.778072 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.778823 30939 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.778824 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:17.782975 30939 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.785002 31587 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.788561 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:17.791352 32718 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.793242 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:17.776291 32708 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.793959 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:17.791935 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:17.777127 32714 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.844481 32550 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:17.845243 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 55560us
I20260709 12:24:17.845913 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:17.846544 32708 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.846956 32708 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.787091 32689 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.782588 32671 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:17.849406 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 66543.9us
I20260709 12:24:17.852456 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:17.804072 31051 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:17.807255 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 90968.2us
I20260709 12:24:17.857944 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:17.848052 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 72110.9us
W20260709 12:24:17.838124 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.792487 32709 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.856629 32717 raft_consensus.cc:3055] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.841074 32720 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:24:17.859477 30865 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.861469 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:17.792567 32673 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.864835 31587 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.868396 32725 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.868871 32725 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.869220 32725 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.872222 32638 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.873171 30865 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.862318 32717 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.874514 30865 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.874673 32717 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.874430 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.876061 32719 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.862519 32550 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:17.880700 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:17.881681 30867 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.863359 32721 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.876664 32550 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.856041 32718 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.885478 32550 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.886222 32677 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.886627 32677 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.887403 32677 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.887881 32722 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.888283 32722 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:17.888630 32722 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.889087 32691 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.875406 32713 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.889448 32691 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:17.889824 32691 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.890035 32713 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.876722 32719 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.890493 32723 consensus_queue.cc:1059] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:17.891840 32719 raft_consensus.cc:3055] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:17.892198 32719 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.893054 32719 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.896387 30799 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53570 (request call id 370) took 6720 ms. Trace:
I20260709 12:24:17.867585 32622 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.900017 32622 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.900364 32702 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.862371 32709 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.876222 32717 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.904290 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:17.904924 30901 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:17.907501 32708 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:17.909682 32708 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.910243 32708 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.910609 32708 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:17.910949 32708 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.900403 32622 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.913357 32677 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.903039 32709 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:17.918851 31016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.006s	sys 0.012s
W20260709 12:24:17.920817 31016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.006s	sys 0.013s
W20260709 12:24:17.921418 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 707730us
I20260709 12:24:17.924212 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.924533 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.925316 31619 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:17.926139 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.927323 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.928045 31620 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:17.924206 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:17.929301 30942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.008s	sys 0.010s
I20260709 12:24:17.885072 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:17.929826 30942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.008s	sys 0.010s
W20260709 12:24:17.932219 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 819575us
I20260709 12:24:17.911479 32691 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.942669 32691 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:17.933106 30942 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:17.951464 32689 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.952631 32622 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:17.955514 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 89544us
I20260709 12:24:17.958750 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.959853 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:17.960160 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:17.960840 31617 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:17.961681 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:17.962337 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:17.961766 31615 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:17.963527 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.961050 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:17.969208 32715 raft_consensus.cc:3055] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:17.963665 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 78658.6us
I20260709 12:24:17.969666 32709 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:17.970161 30942 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:17.971171 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.971699 32709 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.965018 31619 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.954929 32622 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:17.965864 31624 raft_consensus.cc:1240] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:17.966724 31622 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEARNER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:17.959868 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:17.967227 32712 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.960179 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:17.969571 32715 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:17.976464 31016 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.863071 30895 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:17.984516 31013 leader_election.cc:336] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.666s (SENT)
I20260709 12:24:17.986506 32714 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.987181 30865 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.997236 30865 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.987102 32720 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:18.004359 31014 leader_election.cc:336] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.684s (SENT)
I20260709 12:24:18.004817 31014 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.990280 32726 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.005703 32726 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:17.971498 32630 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.006060 32726 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.006184 32630 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:17.987079 32671 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:17.988302 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 105880us
I20260709 12:24:17.992194 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:17.993218 32729 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.896764 30799 rpcz_store.cc:276] 0709 12:24:11.176328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.185822 (+  9494us) service_pool.cc:224] Handling call
0709 12:24:17.896287 (+6710465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:14.576177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:14.576882 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:14.576933 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:24:14.576962 (+    29us) tablet.cc:662] Decoding operations
0709 12:24:14.577434 (+   472us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:14.577521 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:14.577548 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:14.613991 (+ 36443us) tablet.cc:701] Row locks acquired
0709 12:24:14.614036 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:24:14.614244 (+   208us) write_op.cc:270] Start()
0709 12:24:14.614414 (+   170us) write_op.cc:276] Timestamp: P: 1783599854614174 usec, L: 0
0709 12:24:14.614453 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:24:14.615477 (+  1024us) log.cc:844] Serialized 527 byte log entry
0709 12:24:16.691006 (+2075529us) op_driver.cc:464] REPLICATION: finished
0709 12:24:16.929856 (+238850us) write_op.cc:301] APPLY: starting
0709 12:24:16.929950 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:16.930055 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:16.966125 (+ 36070us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:17.050385 (+ 84260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:17.074043 (+ 23658us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:17.074105 (+    62us) write_op.cc:312] APPLY: finished
0709 12:24:17.074360 (+   255us) log.cc:844] Serialized 23 byte log entry
0709 12:24:17.074548 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.074637 (+    89us) write_op.cc:454] Released schema lock
0709 12:24:17.074691 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:17.075046 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.075081 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":237993,"apply.run_cpu_time_us":2524,"apply.run_wall_time_us":145157,"num_ops":1,"prepare.queue_time_us":949241,"prepare.run_cpu_time_us":21990,"prepare.run_wall_time_us":274630,"raft.queue_time_us":493286,"raft.run_cpu_time_us":15996,"raft.run_wall_time_us":308767,"replication_time_us":2063417,"thread_start_us":385872,"threads_started":3,"wal-append.queue_time_us":940111}]]}
I20260709 12:24:17.999217 31016 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:17.993906 32688 consensus_queue.cc:1059] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:24:18.000721 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.001209 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.010437 32720 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.007812 30865 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.006605 32630 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.990582 32695 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.008646 32694 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.989854 32696 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.014037 32729 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:18.028352 32729 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.028705 32729 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:18.029078 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.029546 32729 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.027549 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:18.018167 32655 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:24:18.021407 31049 raft_consensus.cc:3055] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.019644 32704 consensus_queue.cc:1059] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:24:18.018896 32692 consensus_queue.cc:1059] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:24:18.042358 31049 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:18.044340 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 74282.1us
I20260709 12:24:18.045876 30942 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:18.047564 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 164541us
I20260709 12:24:18.020288 32671 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.011375 32724 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.036679 32720 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:18.026895 30895 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.017774 32670 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:18.068071 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.032651 32729 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:18.069056 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.052810 31616 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.019089 32715 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.012771 31619 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:18.059217 30795 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48640 (request call id 257) took 6869 ms. Trace:
I20260709 12:24:18.087683 31051 raft_consensus.cc:1240] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.059504 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:18.071103 31013 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:18.079366 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 87207.9us
I20260709 12:24:18.090691 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.090956 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.091447 31013 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.083374 30939 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:18.052820 32671 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:24:18.087386 30795 rpcz_store.cc:276] 0709 12:24:11.189453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.206222 (+2016769us) service_pool.cc:224] Handling call
0709 12:24:18.059053 (+4852831us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":406021,"reported_tablets":1}
I20260709 12:24:18.053411 32550 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.094980 31013 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.088861 32670 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.089705 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.089594 32728 consensus_queue.cc:1059] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:18.097098 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 217b561ab05e4c71be81abf723e3c499 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:37068
I20260709 12:24:18.097851 32728 raft_consensus.cc:3055] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.093075 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.092298 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:18.065578 32709 raft_consensus.cc:3055] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.096274 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.096518 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.096843 32694 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.092698 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.082383 32737 consensus_queue.cc:1059] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:18.112344 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:18.098505 31013 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.106776 31016 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.042873 32615 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:24:18.115291 32655 raft_consensus.cc:3055] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.115669 32655 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.083218 32630 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.112372 30893 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.122345 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.114352 31013 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.114735 32738 tablet_replica.cc:333] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
W20260709 12:24:18.107676 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 61875.3us
I20260709 12:24:18.117888 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.126982 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.128073 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.129019 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.129868 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.121024 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.131338 30865 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.108940 31615 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.134323 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:18.111927 31617 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.104776 32728 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:18.132893 30894 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:18.132972 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:18.124871 30939 connection.cc:256] RPC call timeout handler was delayed by -1.0266012540000702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 12:24:18.107188 32550 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.134629 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.126076 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:18.135682 32712 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.136523 31051 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.108459 32709 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:18.115986 32689 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.140475 30898 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:18.132380 30865 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.144086 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:18.143755 31049 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.145141 32739 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:18.118238 32704 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.216610 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:18.121904 32670 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.213567 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:18.121626 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.116639 32722 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.216414 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:18.178959 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 64683.5us
I20260709 12:24:18.177929 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:18.218014 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.143784 31620 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:18.219378 30894 raft_consensus.cc:2393] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:24:18.262990 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 46669.1us
I20260709 12:24:18.263698 30867 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:18.217726 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 85413.5us
I20260709 12:24:18.113389 32725 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.265621 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.178498 32692 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:18.266551 32717 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.179219 32735 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.220053 32728 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.266984 32717 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:18.267421 32717 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.267755 32728 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.267642 32692 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.268100 32725 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.262181 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.230644 31623 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:18.271175 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.140208 32677 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:18.273540 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 95687.6us
I20260709 12:24:18.280879 30865 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.134673 32731 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.282526 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.283119 30867 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.217864 32689 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:18.212534 32695 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.285261 30867 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.219620 32720 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.281810 32692 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:18.322592 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 215876us
I20260709 12:24:18.272821 32686 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.229673 32630 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.260515 32739 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:18.284530 31049 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.281975 32731 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:18.338279 30794 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 217b561ab05e4c71be81abf723e3c499 with cas_config_opid_index 4: aborting the task: latest config opid_index 5; task opid_index 4
I20260709 12:24:18.148551 32741 consensus_queue.cc:1059] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.190s
I20260709 12:24:18.338732 32732 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.291500 30899 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:18.228375 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:18.272994 32735 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:18.354585 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 69391.6us
I20260709 12:24:18.282335 32724 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.369367 30867 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.370769 30867 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:18.221604 32709 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.299124 32677 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.284026 32716 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.222635 32708 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.299289 32725 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.302606 32689 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.372795 32686 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.226922 32726 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.395304 32671 raft_consensus.cc:3055] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.395744 32671 raft_consensus.cc:740] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:18.395912 32726 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.284957 32721 consensus_queue.cc:1059] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:24:18.396965 32721 raft_consensus.cc:3055] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.397301 32721 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:18.398079 32721 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.399248 32721 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.360746 32720 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.227744 32655 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.400655 32655 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.360143 32739 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:18.356098 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 73665.8us
I20260709 12:24:18.361946 32731 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.374274 32713 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:18.385030 32719 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.381763 32725 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:18.386582 30799 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.391461 32708 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.392071 30794 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53558 (request call id 353) took 7279 ms. Trace:
I20260709 12:24:18.373975 32712 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:24:18.364046 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.401096 32720 consensus_queue.cc:1059] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:18.403179 32736 consensus_queue.cc:1175] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e9d2b069edc4166802ee0456ebcb706" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
W20260709 12:24:18.431316 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.420145 30794 rpcz_store.cc:276] 0709 12:24:11.112645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.113059 (+   414us) service_pool.cc:224] Handling call
0709 12:24:18.391974 (+7278915us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46139,"reported_tablets":1}
I20260709 12:24:18.380889 32732 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:24:18.433887 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.436383 31051 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:18.437337 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.416416 32713 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:18.455844 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 157333us
I20260709 12:24:18.443578 32715 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.441289 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.457598 32718 raft_consensus.cc:3055] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.445133 32729 raft_consensus.cc:3055] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.463501 31617 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.438117 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.373358 32742 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:18.409991 30897 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:18.413028 32725 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.413203 32722 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.459110 32718 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:18.488739 32718 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.489553 32709 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.489864 32718 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.489558 31049 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:18.465473 30973 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.469453 32739 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:18.470264 32728 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.465401 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.491803 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.457733 32671 consensus_queue.cc:260] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.460057 32729 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:18.440590 30895 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:18.407451 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.475622 32731 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.486325 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.482250 32742 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:18.501579 32742 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.493914 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.494604 32669 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.494880 30864 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:18.495235 32696 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:18.492750 32728 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:18.496435 32671 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.497350 32729 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.498545 31617 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.441455 32713 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.440847 32717 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:18.499965 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 92582.6us
I20260709 12:24:18.510030 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.518422 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:18.501039 32745 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:18.505342 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 664) took 1277 ms. Trace:
I20260709 12:24:18.507787 32630 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.508314 32692 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:18.509029 32695 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:18.509522 32722 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:18.498872 32747 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:24:18.504966 32737 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:18.519934 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.505760 32696 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.548476 32747 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.549352 32747 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.549789 32696 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.550887 32696 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:18.551607 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.521194 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:18.529655 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.531948 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:18.535857 32725 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.537060 32740 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:24:18.558907 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.559116 32740 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.559517 32740 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.528081 32630 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:18.562541 32630 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.563766 32630 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.521169 32670 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.567648 32731 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.539664 32717 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.541043 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.512234 32728 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.529932 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.511505 32729 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.540846 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.540903 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:18.571228 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.572013 31043 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:18.572319 32728 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.544373 32722 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:18.571539 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.544451 32719 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:18.545499 31617 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:18.577188 30970 raft_consensus.cc:1240] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:18.546475 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.491993 32689 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:18.543708 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 171893us
I20260709 12:24:18.524412 31623 rpcz_store.cc:276] 0709 12:24:17.228198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.228300 (+   102us) service_pool.cc:224] Handling call
0709 12:24:17.961546 (+733246us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:18.505189 (+543643us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540065dbd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:18.505283 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619679488}
I20260709 12:24:18.550056 32615 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:18.577138 30967 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.504208 32714 raft_consensus.cc:3055] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.579584 32689 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.580360 31624 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.555414 32738 raft_consensus.cc:2243] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.555586 32739 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.556201 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.581912 32738 raft_consensus.cc:2272] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.581585 32747 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.583003 32747 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.561225 32740 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.556233 30892 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:18.570182 31049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:18.570320 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.576890 32722 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.591161 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.524204 32745 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:18.598093 32745 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.598187 31588 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.503376 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.579504 32714 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:18.577342 32719 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:18.585340 32670 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:18.586585 32738 ts_tablet_manager.cc:1916] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:18.587460 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.592662 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.592875 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.593218 32727 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.608361 30968 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 2: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:18.593571 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.593700 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.609623 30969 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:18.594045 30972 raft_consensus.cc:1240] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.594570 30974 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 2: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:18.610214 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:18.594452 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.592924 31049 raft_consensus.cc:606] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.596201 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.611925 30967 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.597306 30970 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:18.599360 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 96072.6us
I20260709 12:24:18.600066 31588 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.605031 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.612748 30939 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.613057 31013 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.603300 32688 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:18.606029 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.619225 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.620287 30970 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:18.621831 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.613503 31587 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:18.622720 31587 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:18.617223 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.623946 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.609659 32714 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.624655 32673 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:18.606926 32719 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.625139 32673 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:18.625509 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.626143 30972 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:18.626485 31623 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 LEARNER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:18.626669 32622 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:18.627148 32622 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:18.603919 32739 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.615896 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:18.616073 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:18.616176 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.610428 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.645557 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.645926 31618 raft_consensus.cc:1240] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.617229 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.617738 32727 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.629568 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.645561 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.646718 31615 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:18.646646 30969 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.651108 32725 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.631256 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.632900 30970 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:18.644711 30968 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:18.651783 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 51771.5us
I20260709 12:24:18.652667 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.653678 30970 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.655246 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.633239 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.655650 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.662106 31624 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:18.662647 31588 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.666087 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.628336 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.667783 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.685838 32692 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.692013 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.612746 32740 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.672508 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.625151 32615 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.626516 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.694902 30975 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.692655 31619 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.698160 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:18.691403 31588 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.647166 32736 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.702533 30970 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:18.691591 32748 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.686271 32669 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.685807 32731 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.707340 32737 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.667209 31047 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:18.686000 32550 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.693384 30969 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:18.692939 31072 debug-util.cc:398] Leaking SignalData structure 0x7b08001a71e0 after lost signal to thread 29735
I20260709 12:24:18.666796 32694 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.695596 31618 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.710634 32655 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.628023 32622 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.712914 31588 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.714228 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:18.700922 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.656078 32670 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.661731 32630 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.666895 32727 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.742208 31616 raft_consensus.cc:1240] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.715945 30972 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:18.716164 30975 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.755488 30975 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.722569 32704 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:18.724200 31624 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.726013 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.761037 30968 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:18.761651 30967 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:18.762301 30974 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:18.762629 31616 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.763831 32737 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:18.726478 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58786.2us
I20260709 12:24:18.714979 32532 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.626001 32673 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.764173 31623 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:18.729180 30976 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:18.730460 32758 raft_consensus.cc:993] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:18.714707 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.715019 32736 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.738788 30864 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:18.743381 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44212.2us
I20260709 12:24:18.745369 32714 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.756040 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:18.757329 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44495.4us
I20260709 12:24:18.755322 30972 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.768364 31014 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.770726 30939 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.767892 32727 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.775498 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.775460 31588 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.775658 31014 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.776667 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.770087 32742 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.777469 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:18.777721 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.777833 32759 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:18.778637 30973 raft_consensus.cc:2393] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:18.779074 32550 consensus_queue.cc:1059] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:18.779379 32671 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.780119 32550 raft_consensus.cc:3055] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.780535 32669 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:18.780751 32755 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.780093 32671 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:18.780314 32725 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.781489 32532 consensus_queue.cc:1059] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:18.782517 32532 raft_consensus.cc:3055] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.782876 32532 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:18.779089 32742 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:18.784245 32736 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.783638 32532 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.785535 32736 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:18.770442 31072 debug-util.cc:398] Leaking SignalData structure 0x7b080019ae20 after lost signal to thread 30833
I20260709 12:24:18.777149 32630 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:18.785903 32532 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.787405 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.788635 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.800421 32748 consensus_queue.cc:1059] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.786325 32731 consensus_queue.cc:1059] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:24:18.803901 31072 debug-util.cc:398] Leaking SignalData structure 0x7b0800281560 after lost signal to thread 30925
I20260709 12:24:18.788913 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.788646 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.772738 32758 raft_consensus.cc:1081] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:24:18.805151 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.801330 32750 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.789611 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.805855 30901 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:18.789819 30892 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.805760 32750 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:18.807847 32750 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.808419 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.809233 30892 raft_consensus.cc:2393] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:18.809986 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.810663 30892 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:18.790357 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.813200 30901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:24:18.790565 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.820650 32731 raft_consensus.cc:3055] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.792457 30894 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.789716 32692 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.792479 30900 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.792781 32694 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.794231 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.823035 32615 raft_consensus.cc:3055] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.823413 32615 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.795193 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:18.767769 32739 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:18.797377 31051 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.826326 31588 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.799011 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.799620 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:18.834393 32655 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.835466 31046 raft_consensus.cc:1240] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:18.835983 32725 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:18.836289 32747 consensus_queue.cc:1059] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:18.836992 32758 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:18.838191 32747 raft_consensus.cc:3055] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:18.799707 32755 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:18.838560 32747 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.839661 32755 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.840181 32747 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.840497 32755 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.841476 32747 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.840688 30895 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:18.800230 32742 consensus_queue.cc:1059] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:18.804072 32757 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:24:18.787200 32673 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.813793 30901 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.814621 30899 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:18.780516 32550 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:18.821085 32731 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:18.827895 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.825182 32728 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.831396 31619 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:18.832851 32688 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.856149 32731 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.857529 32731 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.847067 32689 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.858039 32550 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.833773 32615 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.845899 31588 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.843600 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:18.806499 32759 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.848694 30901 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.850939 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.861290 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.843365 32630 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.859293 32550 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.864506 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.866719 30939 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.864888 32727 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:18.859666 32725 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.825629 32737 consensus_queue.cc:1059] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:18.912786 31587 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:18.868314 31014 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:18.863535 32742 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:18.912257 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44843.2us
I20260709 12:24:18.863034 32689 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.893143 30901 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:18.915417 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 47192us
W20260709 12:24:18.865758 31072 debug-util.cc:398] Leaking SignalData structure 0x7b0800381860 after lost signal to thread 31000
I20260709 12:24:18.868257 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:18.862994 32695 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.862319 32759 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.883598 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:18.865278 32615 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:18.915689 31588 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:18.914508 32692 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:24:18.868587 32630 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.925931 30901 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:18.871776 32694 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:18.876230 32669 raft_consensus.cc:3055] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:18.928220 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 60045.3us
I20260709 12:24:18.867449 32671 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.949290 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:18.949800 32728 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:18.916939 32748 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:18.951663 30970 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:18.952018 30897 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:18.952592 32702 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:18.953163 32702 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:18.954113 32702 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:18.935256 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.949470 30939 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:18.923913 31072 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb000 after lost signal to thread 31001
I20260709 12:24:18.865512 32688 consensus_queue.cc:1059] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:24:18.959760 32695 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.960222 32695 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:18.960336 32761 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:24:18.961084 32695 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.948746 32689 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:18.961629 32759 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:18.962481 32695 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.962899 32759 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.914765 32655 consensus_queue.cc:1059] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:24:18.949506 32760 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:24:18.933830 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:18.986868 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58799.3us
I20260709 12:24:18.957384 32669 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:19.000550 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 66794.3us
I20260709 12:24:19.002611 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:18.932394 32739 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.957759 32694 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:18.977027 32689 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:18.927608 32747 consensus_queue.cc:1059] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:24:18.990166 32737 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.932159 32745 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:18.989701 32748 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:19.020603 32748 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.021813 32694 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.012989 32722 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.025315 32745 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:19.025331 32722 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:19.026638 32622 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:19.027015 32622 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:19.027817 32622 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.028955 32622 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.031879 31619 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:24:19.032178 32753 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.310s	user 0.004s	sys 0.000s
I20260709 12:24:19.032548 30971 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:19.020639 32689 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:19.021147 32752 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.294s	user 0.000s	sys 0.003s
I20260709 12:24:19.037016 32722 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.040036 32696 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:19.040566 32696 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:19.040853 32669 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.041344 32696 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.042016 32669 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.042568 32696 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:19.040025 32670 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.989707 32692 consensus_queue.cc:1059] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:19.008955 32714 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.025882 32725 raft_consensus.cc:3055] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:18.991281 32671 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:24:19.016881 31072 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1140 after lost signal to thread 31075
W20260709 12:24:19.074280 31072 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1160 after lost signal to thread 31076
W20260709 12:24:19.075346 31072 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1a20 after lost signal to thread 31649
W20260709 12:24:19.075601 31072 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1a40 after lost signal to thread 31650
I20260709 12:24:19.070138 32532 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:19.079083 32532 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:19.068137 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 111249us
I20260709 12:24:19.084331 32532 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:19.091581 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 178875us
W20260709 12:24:19.095494 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.110387 32747 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:19.114166 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:19.120253 31619 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:19.123852 32709 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.127264 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:19.128811 30973 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:19.071635 32725 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:19.140221 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 148382us
I20260709 12:24:19.146670 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:19.148149 30939 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:19.148929 32630 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.149550 31622 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:19.150841 31043 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:19.151886 32630 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:19.152210 30939 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:19.080284 32638 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:19.159583 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:19.160858 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:19.069978 32745 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:24:19.069070 32655 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:24:19.162691 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:19.186301 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:19.186645 30970 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:19.188426 30976 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:19.181614 32737 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.155962 31043 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:19.153112 32669 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.158562 32713 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:19.245491 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 243567us
I20260709 12:24:19.182946 32702 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.152892 32630 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:24:19.184383 32736 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:19.265525 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:19.269476 31050 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 2: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:19.208563 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:19.188022 32670 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:24:19.186722 32638 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.188868 32717 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:24:19.282785 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:19.258220 32669 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:19.184320 32750 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:19.211097 32728 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:24:19.356817 30901 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:19.278719 32736 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.277213   303 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:19.385411 32692 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:19.281119 32713 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.289755 30897 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:19.420710 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 140597us
I20260709 12:24:19.436748 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:19.437438 30899 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:19.429683 32550 consensus_meta.cc:287] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.003s
I20260709 12:24:19.370206 32715 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:24:19.449512 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 200900us
W20260709 12:24:19.452245 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 295754us
I20260709 12:24:19.450986 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:19.453704 31622 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:19.454715 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:19.455977 30939 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:19.457785 31588 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:19.461787 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:19.462543 30973 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:19.449317 30895 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:24:19.435243 32692 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.448684 32722 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.432968   303 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.463999 32712 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.488420 32712 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.463428 32737 raft_consensus.cc:697] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:19.476295 32765 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:19.481508 32714 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.577901 32757 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:24:19.591661   307 log.cc:927] Time spent T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:24:19.592494   308 log.cc:927] Time spent T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:24:19.594609 32725 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.596125 32671 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.610072 32712 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:19.612115 32727 raft_consensus.cc:3055] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:19.583524 32764 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:24:19.626900 32736 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:19.606894 32766 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 12:24:19.588842 32765 raft_consensus.cc:697] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:19.631093 31619 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.002s
I20260709 12:24:19.630074   300 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.586284 32714 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.631489 30972 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:19.641625 31622 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:19.630780 32727 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:19.487470 32722 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.606501   312 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:24:19.639537 32725 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.639644 32750 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:19.647567 32696 consensus_meta.cc:287] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 12:24:19.649057 32671 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:19.653539 32615 consensus_meta.cc:287] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.000s
W20260709 12:24:19.653644 32622 consensus_meta.cc:287] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 12:24:19.654265 32692 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:19.654626   318 consensus_queue.cc:1059] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:24:19.650094   313 consensus_queue.cc:1059] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:24:19.665470 32738 ts_tablet_manager.cc:1929] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:19.659688 32713 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:19.660401 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:19.664567 32714 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:19.664951 32759 consensus_meta.cc:287] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.702s	user 0.006s	sys 0.004s
I20260709 12:24:19.589821 32669 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.666390 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:19.679293 31624 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:19.666841 32738 log.cc:1199] T 217b561ab05e4c71be81abf723e3c499 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/217b561ab05e4c71be81abf723e3c499
I20260709 12:24:19.659200 32712 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:24:19.653637   303 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:19.668807 31622 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:19.670718   300 raft_consensus.cc:3055] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.694576   300 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:19.680744 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:19.665753   314 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.695793 30867 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:19.693603 32747 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.580s	user 0.000s	sys 0.009s
I20260709 12:24:19.695257   313 raft_consensus.cc:3055] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.695379   316 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:24:19.698791 32714 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:19.714794 31046 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:19.701788 32713 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:19.718914 32713 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:19.719365 32713 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.711376   313 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:19.725241   313 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.726552   313 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.702970 32669 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.715570   300 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.698549   314 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.723034 32756 raft_consensus.cc:3055] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:19.729009   302 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:19.721712 30895 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:19.691454 32765 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:19.757565 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 290975us
I20260709 12:24:19.719712 31587 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:19.734577 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:19.680462 32737 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.716091 32714 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.759413   311 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.759579 32714 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.760731 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:19.762162 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:19.762542 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:19.764513 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:19.765916 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:19.766551 31044 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:19.759279 31624 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:19.767577 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:19.764408 32717 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.768345 31051 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:19.768584 32717 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:19.769660   311 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:19.770217   311 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.769503 32717 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.776193   317 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.776746   317 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:19.777138   317 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.683102 32727 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.789076 31620 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.788926 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:19.752651 32756 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:19.801775   302 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.803628 32738 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37068 (request call id 91) took 1725 ms. Trace:
W20260709 12:24:19.820804 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.826226 31624 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.828761 31620 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.840561 32756 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.841638 32756 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.842017 32740 raft_consensus.cc:3055] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:19.842381 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.852311 32740 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:19.853355 32740 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.854815 32740 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.798336 32714 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:19.859431 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.861011 32714 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:19.869781 32713 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:19.873696 32713 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:19.824529 32722 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:19.822064 32738 rpcz_store.cc:276] 0709 12:24:18.088932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.093651 (+  4719us) service_pool.cc:224] Handling call
0709 12:24:18.114364 (+ 20713us) ts_tablet_manager.cc:1151] Deleting tablet 217b561ab05e4c71be81abf723e3c499
0709 12:24:18.114457 (+    93us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:19.276737 (+1162280us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:19.665321 (+388584us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:19.803528 (+138207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":406313,"tablet-delete.queue_time_us":16524,"thread_start_us":18753,"threads_started":1}
I20260709 12:24:19.878720 32638 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:19.871680   314 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:19.883968 32727 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.888545 32742 raft_consensus.cc:3055] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:19.894704 30799 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53550 (request call id 394) took 1799 ms. Trace:
I20260709 12:24:19.899117 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 217b561ab05e4c71be81abf723e3c499 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:24:19.905668 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:19.906929 31048 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.906605 30799 rpcz_store.cc:276] 0709 12:24:18.095206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.105092 (+  9886us) service_pool.cc:224] Handling call
0709 12:24:19.894610 (+1789518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:18.505052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:18.577737 (+ 72685us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:18.577772 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:18.577789 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:18.580104 (+  2315us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:18.580185 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:18.580224 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:18.580995 (+   771us) tablet.cc:701] Row locks acquired
0709 12:24:18.581014 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:18.581170 (+   156us) write_op.cc:270] Start()
0709 12:24:18.581293 (+   123us) write_op.cc:276] Timestamp: P: 1783599858581133 usec, L: 0
0709 12:24:18.584594 (+  3301us) op_driver.cc:348] REPLICATION: starting
0709 12:24:18.598764 (+ 14170us) log.cc:844] Serialized 523 byte log entry
0709 12:24:18.992278 (+393514us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b540021d9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f0330628e28 00007f0334063581 00007f0334062d58 00007f03340679f1 00007f03340679a9 00007f0334067939 00007f0334067901 00007f0334066b2d 0000000000388634 0000000000388479
0709 12:24:19.254159 (+261881us) op_driver.cc:464] REPLICATION: finished
0709 12:24:19.710197 (+456038us) write_op.cc:301] APPLY: starting
0709 12:24:19.710294 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:19.710394 (+   100us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:19.710415 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:19.710659 (+   244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:19.710813 (+   154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:19.710855 (+    42us) write_op.cc:312] APPLY: finished
0709 12:24:19.717844 (+  6989us) log.cc:844] Serialized 23 byte log entry
0709 12:24:19.718028 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.718112 (+    84us) write_op.cc:454] Released schema lock
0709 12:24:19.718150 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:19.718483 (+   333us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.718513 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":228268,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":452197,"apply.run_cpu_time_us":1572,"apply.run_wall_time_us":8274,"num_ops":1,"prepare.queue_time_us":88084,"prepare.run_cpu_time_us":59670,"prepare.run_wall_time_us":488131,"raft.queue_time_us":185924,"raft.run_cpu_time_us":162937,"raft.run_wall_time_us":381460,"replication_time_us":669388,"spinlock_wait_cycles":4193024,"thread_start_us":802620,"threads_started":4,"wal-append.queue_time_us":276193}]]}
I20260709 12:24:19.911216 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:19.911906 30973 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
W20260709 12:24:19.920648 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 457298us
I20260709 12:24:19.921545 30942 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:19.838603   302 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:19.927326 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:19.929772 30901 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:19.911098 32742 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:19.927489 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:19.936409 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:19.938275 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:19.938501 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:19.939258 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:19.971632 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 44898.3us
I20260709 12:24:19.971690 31621 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:24:19.939908 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.972424 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:19.941876 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:19.942040   325 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:19.921886 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:19.919508   314 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.917940 32745 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.974812 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:19.931388 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:19.945181 32728 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.931789 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:19.984884 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:20.001466 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 65134us
I20260709 12:24:19.930840 32713 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.932039 32630 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:19.978796 31620 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:19.973655 32731 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.980041 31618 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.973538 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:19.978124 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:19.973241 32712 consensus_queue.cc:1059] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:24:20.003427 30895 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.020923 31588 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:20.025152 32532 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.001048   312 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.003113 32669 consensus_queue.cc:1059] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:24:20.003871   316 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:20.015260 30899 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:20.000691 32729 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:20.010819 30897 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.010134 31043 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:20.027236 30968 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:20.028513 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.039757 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.042338 30968 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:20.043416 31014 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:20.043572 30968 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:20.044925 30968 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:20.046020 30968 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:20.005553 32745 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.048300 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:20.049098 30865 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:20.015323 32671 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:20.024108 31621 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.004879 32767 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.015256 32713 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.033800 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.017969 30969 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:20.014727 32722 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:20.026428 30973 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.015105   327 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:20.024501 31620 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.053915   303 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.016645   319 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:20.025633 32694 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.010157 32728 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:19.926342 32725 consensus_queue.cc:1059] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:24:20.052755 31048 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:20.068065 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:20.056102 30968 raft_consensus.cc:1240] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.050870 31049 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:20.037969 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.037770   301 raft_consensus.cc:3055] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.051263 32712 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.036028   316 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.075026 32615 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.021636 30794 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.017510   317 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.077164 32728 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.067587 32709 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:24:20.070340 32689 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.030010 32630 consensus_queue.cc:1059] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:20.068814 30864 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:20.035815   312 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.077423 30972 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:20.046960 32755 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:24:20.021852 32742 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.098661 30974 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:20.063711 32638 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:24:20.068176   327 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.062915   314 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.064234 32673 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:20.050962   302 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:24:20.112397   300 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.089855   316 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.081689 32532 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:20.099501   324 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:20.101151 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:20.097308   322 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:20.112919 32713 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.063876   311 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.065313 32722 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.106340   327 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.088456   301 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:20.070763 32694 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.095413 32728 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.080006   319 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.104429   312 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.124333 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:20.127977   323 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:20.129213 32694 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.129740 32722 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.130194   324 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:20.130280 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.134677 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.161330 30973 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:20.070941 32767 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.137197 30975 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.138747 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:20.097529 32689 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.141736 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:20.097636 32725 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:24:20.132635 32713 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:20.126809 31049 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
W20260709 12:24:20.196789 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 55157.8us
I20260709 12:24:20.199754 31014 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:20.198050 32694 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:20.136495   322 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:20.191875 32709 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.142263 32728 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.202804 32694 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:20.221400 32755 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:20.219700   322 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.243003   303 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.214216 32713 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.229189 32745 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.232736 32694 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.196846   323 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.236553 32755 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.226895 32709 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.254462   312 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.261089 32755 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:20.279842   303 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.261381   314 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.260387   317 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.272298 32689 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:20.352231   304 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.352941   304 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.355150   304 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:20.356392 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.357033 30973 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:20.379295 31014 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:20.381695 30864 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:20.317945 32717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.023s	sys 0.059s
I20260709 12:24:20.393136 32742 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.395498 31620 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.398226   301 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.401258 32745 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:20.405349 30971 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:20.411497 32747 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:20.412089 32747 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.414264 32747 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:20.414796 32747 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.415469 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.416436 30971 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:20.417585   313 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.417666 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:20.418114   313 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:20.418972   313 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.420367   313 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.426033   318 raft_consensus.cc:3055] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.426542   318 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:20.427910   318 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.429883   318 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.345726 32735 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.436107 32735 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.321651 32759 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:20.321367 32750 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.281659   303 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.320467 32715 raft_consensus.cc:3055] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:20.441591 32747 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.450237   316 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.445501 32747 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.452006 32747 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:20.390007 32717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.023s	sys 0.059s
I20260709 12:24:20.472959 32717 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:20.473701 32717 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:20.459039   331 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:24:20.474907 31618 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:20.287714   312 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.309624   302 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.347218 32756 consensus_meta.cc:287] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.505s	user 0.001s	sys 0.009s
I20260709 12:24:20.463469   323 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.391968   304 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:20.486184   302 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.489140   302 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.469013   311 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.470691 32670 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.456727 32767 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.459489 32713 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.489920 32670 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.490417   304 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.490795   304 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.452602   322 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.476824 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 543) took 1211 ms. Trace:
I20260709 12:24:20.439987 32714 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:20.479630 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:20.453799 32715 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:20.487355   312 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.475843 32747 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:20.500414 32747 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:20.479094 32740 consensus_meta.cc:287] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.000s
I20260709 12:24:20.491803 31623 rpcz_store.cc:276] 0709 12:24:19.265343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.265445 (+   102us) service_pool.cc:224] Handling call
0709 12:24:19.282093 (+ 16648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.282435 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.282466 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.741801 (+459335us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b2c000472a8. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032ef26a11 00007f032ef36372 00007f0330668a01 00007f033062d43a 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2
0709 12:24:19.742406 (+   605us) log.cc:844] Serialized 540 byte log entry
0709 12:24:19.932014 (+189608us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:19.932046 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.932106 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.475023 (+542917us) raft_consensus.cc:1685] finished
0709 12:24:20.475048 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.476718 (+  1670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14649216,"thread_start_us":189167,"threads_started":1,"wal-append.queue_time_us":492229}
I20260709 12:24:20.492625 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.501830 30971 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:20.264034   324 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.496589 32713 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.498512 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:20.499032   333 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:24:20.495149   323 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.499109 32715 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.496793 31049 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:20.492923 32670 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.504273 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:20.505738 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.548837 30971 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
W20260709 12:24:20.549329 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 45153.7us
I20260709 12:24:20.524724 31621 raft_consensus.cc:2393] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:20.480681 32717 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.502739   319 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.529340 32715 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:20.461611 32750 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.458374 32759 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.491134 32615 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.550065 31014 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:20.505566 32728 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.508462 32714 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.508698   303 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.552524 32670 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:20.560844   316 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.529765   323 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.618254   323 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.615793   336 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:20.619207   336 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.619532   336 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.567049 32740 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.609884 32714 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.610487 32709 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.527484 32713 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.628531 32713 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.614071 32670 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.629323 32670 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.612241   311 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.632211   311 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.634232   311 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.624931 32740 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.636896 32740 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.607487 32735 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.642134 32670 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.614209 32767 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.599148   327 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.646297   319 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.647672 32709 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:20.668918 31616 consensus_meta.cc:287] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.689s	user 0.004s	sys 0.005s
I20260709 12:24:20.669173   311 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.621805 32694 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.681581 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:20.683070 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:20.684100 32750 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.684603   300 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:20.692778 32759 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:20.703039 32767 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.695015 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:20.695806 32712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.013s	sys 0.011s
I20260709 12:24:20.696813   322 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:20.697237 31624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.012s	sys 0.033s
I20260709 12:24:20.697774   313 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:20.709712 31013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.053s	sys 0.126s
W20260709 12:24:20.745831 31051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.014s	sys 0.029s
I20260709 12:24:20.744803 30973 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
W20260709 12:24:20.776419 31051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.014s	sys 0.029s
W20260709 12:24:20.762516 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.772588 31624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.012s	sys 0.033s
W20260709 12:24:20.776314 31013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.054s	sys 0.127s
W20260709 12:24:20.777976 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 1.17199e+06us
I20260709 12:24:20.741782   318 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.785331 31046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.017s	sys 0.035s
W20260709 12:24:20.786342 31046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.017s	sys 0.035s
I20260709 12:24:20.777475 31014 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:20.744405 32765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.018s	sys 0.033s
W20260709 12:24:20.768584 31617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.013s	sys 0.034s
W20260709 12:24:20.798012 30941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.021s	sys 0.036s
I20260709 12:24:20.799940 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:20.801075 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:20.804558 31044 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 2: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:20.804759 30941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.022s	sys 0.036s
I20260709 12:24:20.801792 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:20.772271 32712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.013s	sys 0.012s
I20260709 12:24:20.742928 31616 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
W20260709 12:24:20.797056 32765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.019s	sys 0.034s
W20260709 12:24:20.832563 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.802620 32740 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:20.742866   319 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.743049 32747 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:20.806617 31617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.013s	sys 0.035s
I20260709 12:24:20.744151 32709 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.767815   304 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.767475   311 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.773451 32717 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:20.802933 30939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.032s	sys 0.048s
W20260709 12:24:20.835870 31588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.014s	sys 0.050s
I20260709 12:24:20.803349   322 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:20.805439 30976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.032s	sys 0.034s
W20260709 12:24:20.984865 30976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.033s	sys 0.034s
W20260709 12:24:20.841675 30865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.004s	sys 0.021s
W20260709 12:24:20.985471 30865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.005s	sys 0.021s
I20260709 12:24:20.987910 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:20.841863 30970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.000s	sys 0.026s
W20260709 12:24:20.988521 30970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.000s	sys 0.026s
W20260709 12:24:20.843214 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.008s	sys 0.032s
W20260709 12:24:20.989166 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.008s	sys 0.032s
I20260709 12:24:20.844434 31045 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 2: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:20.772594   336 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:20.845232 31622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.000s	sys 0.011s
W20260709 12:24:20.992756 31622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.000s	sys 0.012s
I20260709 12:24:20.977563 32638 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.993469 32638 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.996456 32750 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:20.996987 32750 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.998948 32750 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.999490 32709 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:20.984691   322 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:21.001544   322 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.999511 31044 raft_consensus.cc:1240] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:21.004139   319 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.004647   319 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.004876 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1382) took 1545 ms. Trace:
I20260709 12:24:21.005229 30976 rpcz_store.cc:276] 0709 12:24:19.458972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.459102 (+   130us) service_pool.cc:224] Handling call
0709 12:24:19.899147 (+440045us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b5800190598. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:19.899316 (+   169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.899713 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.899756 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.904933 (+  5177us) log.cc:844] Serialized 540 byte log entry
0709 12:24:20.985207 (+1080274us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:20.985243 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.985307 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.004520 (+ 19213us) raft_consensus.cc:1685] finished
0709 12:24:21.004571 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.004796 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70525824,"thread_start_us":1079937,"threads_started":1,"wal-append.queue_time_us":1082114}
I20260709 12:24:21.007222 32712 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.008239 32713 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.007933 32712 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.008775 32713 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.010334 32714 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.011209 32713 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.008478 30901 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:21.008939   352 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.012763 32722 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.012897   316 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.013671 32728 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:20.965739 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.013764   352 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.014235 32728 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.015862   352 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.016188 32728 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:21.017159   343 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:21.013440 32750 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.019101 32750 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:20.965096 30975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.016s	sys 0.013s
I20260709 12:24:20.830332 32615 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.023797 32615 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.007865 32715 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:20.785998   313 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.772432   300 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.030479 30971 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.031898 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:20.950848 30972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.009s	sys 0.017s
I20260709 12:24:20.833974 32742 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:20.975979 30864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.012s	sys 0.020s
W20260709 12:24:21.037660 30864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.012s	sys 0.020s
I20260709 12:24:20.946614 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:20.833693 32756 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.836580 32704 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:20.983572 30939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.032s	sys 0.048s
W20260709 12:24:20.983639 31588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.015s	sys 0.051s
I20260709 12:24:21.013567   323 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.010350 32712 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.010989 32714 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.805088   303 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.013375 32722 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:21.022812   335 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:24:21.024981 30901 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:24:21.025313 30975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.017s	sys 0.014s
I20260709 12:24:21.045213 32756 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:20.995458 32638 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:20.775674 32755 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.803463   318 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.029233 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:20.974438 32765 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.032954 30900 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:24:20.846380 32669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.005s	sys 0.020s
W20260709 12:24:21.037997 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 656323us
I20260709 12:24:21.039671 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:21.034018 30972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.009s	sys 0.018s
I20260709 12:24:21.025625 32735 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:20.961691   337 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.045704 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 996974us
W20260709 12:24:21.163439 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.109793 32767 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.043749   327 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.024912 32715 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.043536 32704 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.972908 32740 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.013443   316 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:21.048708 30794 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.027s	sys 0.040s
I20260709 12:24:21.080688 31043 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 2: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:21.034442   319 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.074899 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1804) took 1168 ms. Trace:
I20260709 12:24:21.039011 32739 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.069788 32694 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.043046 32742 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:20.830778   302 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.049235 32759 consensus_queue.cc:1059] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:24:21.139604 30893 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:24:21.133602 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 701) took 1195 ms. Trace:
I20260709 12:24:21.141937 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.050007   323 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.179504 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.156332 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.156482 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:21.157496   341 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:24:21.047140 31016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.008s	sys 0.031s
W20260709 12:24:21.167076 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.151993 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.168589 30864 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:21.142323 32669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.006s	sys 0.021s
I20260709 12:24:21.141021   303 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.169108 32638 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.173041 31048 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:21.131940   345 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.188422 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.189651 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.191210 31051 rpcz_store.cc:276] 0709 12:24:19.902371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.902500 (+   129us) service_pool.cc:224] Handling call
0709 12:24:19.902817 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.903190 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.903217 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.918643 (+ 15426us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.776812 (+858169us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.776851 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.776914 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.070132 (+293218us) raft_consensus.cc:1685] finished
0709 12:24:21.070153 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.070293 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2356,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12101,"thread_start_us":802637,"threads_started":1,"wal-append.queue_time_us":901776}
W20260709 12:24:21.182657   342 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:21.152175 30894 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.173095 32615 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.175159 32712 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.187348 30794 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.027s	sys 0.047s
I20260709 12:24:21.172598   344 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.209101 31016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.009s	sys 0.031s
I20260709 12:24:21.198608 31624 rpcz_store.cc:276] 0709 12:24:19.937890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.937998 (+   108us) service_pool.cc:224] Handling call
0709 12:24:19.938341 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.938650 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.938675 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.939341 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.112171 (+1172830us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b540065e8a0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330597090 00007f03305a46b8 00007f033062d92b 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c
0709 12:24:21.112277 (+   106us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.112331 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.112412 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.112470 (+    58us) raft_consensus.cc:1685] finished
0709 12:24:21.112484 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.133528 (+ 21044us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":159480448,"thread_start_us":838278,"threads_started":1,"wal-append.queue_time_us":757994}
I20260709 12:24:21.178321 32715 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.175268   350 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.175545   352 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.185873   327 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.182771 32767 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.172467   346 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.183779 32713 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.166612 32765 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.223997 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.277664 30893 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:21.247737 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.302743 30894 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.253316 31050 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:21.174338   337 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.305480 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:21.266676 32759 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:24:21.217377 32750 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.172791 32735 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.223860   345 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.263625 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.221484 31047 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.219992   355 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:21.222227   349 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.223003 32717 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.224679 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:21.327950 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.328889 31615 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:21.329375 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.330000 31623 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.229899 32728 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.200836 32739 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:21.330224   351 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:21.211869   302 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.332000 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:21.332594 30974 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.333086   302 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.249143   313 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.333882   313 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.334313   313 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.336194 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:21.336813 30976 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:21.207974   324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.025s	sys 0.032s
I20260709 12:24:21.259851 32669 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.261740   356 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.223649 32638 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.255216 32712 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.267027 32715 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.267187 32615 raft_consensus.cc:3055] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:21.341039   324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.025s	sys 0.032s
I20260709 12:24:21.247747 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.296566 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:21.298381 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 166088us
I20260709 12:24:21.324047   355 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.297694 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.299512 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1803) took 1397 ms. Trace:
I20260709 12:24:21.269634   327 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:21.289737 32714 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.306529 30975 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:21.307245 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:21.361562 30894 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.251289 30898 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.289513 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.266072   344 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.372925   345 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.342694 32728 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.373360 32739 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.373569   345 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.374099   345 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.374577   313 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.374886 32728 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.375139   313 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:21.375703   319 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.375626   313 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.312616 30971 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.269802   350 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.377442   360 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.313580 30896 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:21.344856 32722 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.378228   350 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.378512 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.378957 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1393) took 1267 ms. Trace:
I20260709 12:24:21.315886 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.316938 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:21.379835 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.378093 32712 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.380510 30896 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.317632 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.379565   337 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.382011 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.382555 30896 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:21.382673   303 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.351366   356 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.277096 32767 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.350984 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:21.377703   370 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.384321 31619 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:21.384462 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:21.385324 30899 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:21.348608 32669 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.386205 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.386430 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.386740 30899 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.273679   352 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.387243 32669 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.288523   322 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.387626 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:21.325208 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:21.387910 32742 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.363660   316 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.352032 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:21.388846   364 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:24:21.389284   365 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:21.389834   365 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.222657   311 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.290812 32713 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.390972   327 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.391901 30969 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.392771 32713 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.310240 32740 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.342128 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:21.315147 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 269906us
I20260709 12:24:21.312330   300 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.356441   355 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.352331 32615 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:21.403082   352 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.321462 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 703) took 1375 ms. Trace:
I20260709 12:24:21.405376   344 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.405915   304 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.379786 32638 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.384269   370 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.324904 32704 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.326148 32756 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.338624 32755 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.354698 32715 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.411020 31047 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.379374 30972 rpcz_store.cc:276] 0709 12:24:20.112015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.112150 (+   135us) service_pool.cc:224] Handling call
0709 12:24:20.112492 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.112831 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.112866 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.131366 (+ 18500us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.155994 (+1024628us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:21.156045 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.156128 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.378736 (+222608us) raft_consensus.cc:1685] finished
0709 12:24:21.378762 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.378894 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8473,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":9249,"thread_start_us":1021230,"threads_started":1,"wal-append.queue_time_us":1053950}
I20260709 12:24:21.353323 31624 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.353708 31044 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:21.412154 32747 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.412717 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.413281 31044 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.413952 31044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:21.353852 31046 rpcz_store.cc:276] 0709 12:24:19.902073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.903796 (+  1723us) service_pool.cc:224] Handling call
0709 12:24:19.904090 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.905655 (+  1565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.905686 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.917857 (+ 12171us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.411203 (+493346us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b480021d158. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0335556aa1 00007f033554db37 00007f033554d9ca 00007f033564526f 00007f0335644f37 00007f033565955c 00007f0335659508 00007f0335659488 00007f0335659443 00007f03356586ec 00007f0334582a96
0709 12:24:20.786710 (+375507us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.786749 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.786811 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.294772 (+507961us) raft_consensus.cc:1685] finished
0709 12:24:21.294794 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.299435 (+  4641us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1213,"raft.queue_time_us":1314,"raft.run_cpu_time_us":8960,"raft.run_wall_time_us":501589,"spinlock_wait_cycles":10191232,"thread_start_us":812231,"threads_started":1,"wal-append.queue_time_us":1119079}
I20260709 12:24:21.415289 31046 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.360193 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.352977 31051 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:21.416621 30968 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 1.
I20260709 12:24:21.407305   356 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.366849 32694 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:21.367667   323 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.338379   349 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.370880 32735 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.372071 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.422055 30898 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.372699 31043 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
W20260709 12:24:21.376111   353 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:24:21.377959   360 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.380611 32765 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.383340 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:21.388475 30893 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:21.425514 31044 raft_consensus.cc:606] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:21.328743 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.345660 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.395368 30967 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.438179 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.438828 30967 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:21.288602   346 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.395386 31620 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.396015 30900 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:21.440539 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.446771 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.446727 30893 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.447365 30900 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.270339 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.400779 30894 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
W20260709 12:24:21.323177 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 329612us
I20260709 12:24:21.375425 32759 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.408394 32670 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.407361 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.452280 31618 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.453159 30900 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:21.454559 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:21.367586   334 log.cc:927] Time spent T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.534s	user 0.005s	sys 0.008s
I20260709 12:24:21.422272 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.455116 30893 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.423203 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.456019 30898 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.423631 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.456813 30971 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 2: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:21.457559 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.457710 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.458244 30971 raft_consensus.cc:2393] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:21.424592 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.389209   322 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.458410 30892 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.428365 31044 raft_consensus.cc:614] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:21.425742 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:21.462028 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:21.463112 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.463997 30975 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.464897 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.465514 30975 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.428777 30896 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.410161   370 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.390973 32767 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.421561   365 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.440488 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.404814 31617 rpcz_store.cc:276] 0709 12:24:19.938404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.942385 (+  3981us) service_pool.cc:224] Handling call
0709 12:24:19.942736 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.943132 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.943168 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.943713 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.982814 (+1039101us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:21.002911 (+ 20097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.003007 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.303898 (+300891us) raft_consensus.cc:1685] finished
0709 12:24:21.303921 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.313685 (+  9764us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":1031249,"threads_started":1,"wal-append.queue_time_us":1089626}
I20260709 12:24:21.440178 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:21.471309   302 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.471820   302 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.472616   346 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.473243 32715 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.424995 32694 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.473829   302 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.441576 30974 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.425261   364 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:21.443140   345 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.443758 32765 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:21.479496 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.444772   349 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.445196 31616 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.448289 31049 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:21.486426   318 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.486297   355 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.486872 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.487344 32670 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.487648 30972 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:21.450263 30969 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.450773   313 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.430080   361 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:21.488448   336 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.488556 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:21.485504 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 451) took 1545 ms. Trace:
I20260709 12:24:21.489109   355 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.464105 32759 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.490953 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.491437 32759 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.302758 30865 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:21.487848 32670 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.489158 30969 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.496021 32694 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:21.489343 31622 rpcz_store.cc:276] 0709 12:24:19.940477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.941191 (+   714us) service_pool.cc:224] Handling call
0709 12:24:19.941441 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.217697 (+276256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.217727 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.220792 (+  3065us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.993161 (+772369us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.993204 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.406673 (+413469us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400282154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:21.406719 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.485232 (+ 78513us) raft_consensus.cc:1685] finished
0709 12:24:21.485251 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.485437 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":613,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":7899,"spinlock_wait_cycles":634485120,"thread_start_us":770153,"threads_started":1,"wal-append.queue_time_us":953211}
I20260709 12:24:21.496637 30864 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.497149 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.497777 30864 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.480152 32725 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:21.498508 32725 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:21.498868 32725 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.499856 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.500106   324 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.500520   324 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.485360 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.500949 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.501828 30864 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.502452 31013 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.499699   323 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.473161 31047 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:21.508435 30899 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:21.509001 31013 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.509574 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.509950 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.510454 30864 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.470885 31014 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:21.403100 32615 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.475438 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.477996 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:21.460429 30892 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.478426 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.478515   364 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.464571   369 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:21.479948 32765 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.447017 31042 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:21.455411 30968 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.522300 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.522603 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.522991 31620 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.523370 30968 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:21.523615 31016 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:21.419807 30973 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
W20260709 12:24:21.492482 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 189807us
I20260709 12:24:21.479003 30971 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:21.484088 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.521696 31013 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.468351 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.505223 30976 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:21.500849   324 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:21.467275 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.491657 30901 raft_consensus.cc:2368] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3.
I20260709 12:24:21.514113 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.514516 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:21.572640 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:21.572702 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.524394 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.573782 31620 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:21.519219 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.573748 30901 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:21.541344 31016 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:21.575682 30975 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:21.574956 30865 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:21.576151 31046 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.576282 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.576916 30901 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.524127 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.524411 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:21.580271 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 109461us
I20260709 12:24:21.580178 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.577759 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.581353 30899 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.501009 32694 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.574935 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:21.574450 31624 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
W20260709 12:24:21.579708 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 65272.5us
I20260709 12:24:21.580045 30864 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.577095 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.581787 30901 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
W20260709 12:24:21.722240 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 142271us
I20260709 12:24:21.578693 30968 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.671257 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.661623   301 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.572151   370 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:21.618727 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.670877   364 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.675907 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:21.685493 30896 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:21.631223   349 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.643998 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.497779 30972 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:21.583745 32694 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.664925 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.513119 31043 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.516784   352 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 12:24:21.613224 32615 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.731853   327 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.739259   349 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.743782 32694 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.520771   336 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.513005 32715 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.664002 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.753748 30893 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:21.754669 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.755735 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.756261 30893 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.757011 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.757793 30893 raft_consensus.cc:2410] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:24:21.664443 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.758559 31047 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.759493 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.517359   322 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.760143   322 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:21.653839 30867 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.772s (SENT) [suppressed 24 similar messages]
I20260709 12:24:21.517551 32759 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.760824 32715 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.516307   316 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.613926 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:21.517236   355 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:21.607270 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 85611.5us
I20260709 12:24:21.646883 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.675015 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.721069 30973 raft_consensus.cc:2393] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:21.626576   345 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:21.721251 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 96738.6us
I20260709 12:24:21.674031 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.786820 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:21.589249 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 138860us
I20260709 12:24:21.796917 31013 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.797719 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:21.799175   302 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:21.675645 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 134372us
I20260709 12:24:21.799893   304 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.800277   304 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.800652   304 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.753487   336 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.801165   336 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.802153 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:21.803185 31016 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:21.799664   302 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:21.804363 32709 consensus_queue.cc:1059] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.804762   302 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.805256 32709 raft_consensus.cc:3055] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:21.788048 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 174173us
I20260709 12:24:21.722571 31046 raft_consensus.cc:2368] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3.
I20260709 12:24:21.764693   322 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.764883 32759 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.806931 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:21.807255 32759 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.644932 32735 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.808842 32735 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.809214 32735 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.810644 30865 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:21.631593   371 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.726917 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.811928   371 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.650760   350 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.812345   371 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.812671   350 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.813098   350 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.645934   372 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.816298 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:21.582967 32713 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 12:24:21.729974 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.663311 32671 raft_consensus.cc:3055] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:21.720845   300 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.732635 30976 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:21.734404 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:21.724107 32747 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.726328   363 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:21.726154   356 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:24:21.727605   368 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:21.727756   313 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.736294 31619 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.736881 32765 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:21.737520 30939 leader_election.cc:400] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3.
I20260709 12:24:21.935410 30939 leader_election.cc:403] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:21.856251   372 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:21.739547 31049 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:21.670872 30969 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
W20260709 12:24:21.742537   374 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:24:21.732642   370 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.579202   318 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.732971 32739 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.636286 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:21.739050   344 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:21.734675 30897 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.513490   323 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.945713   323 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.748248   327 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.759847 32725 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.737190   360 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:21.764745 30895 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:21.754081   349 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.811441 32714 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.811617 30865 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:21.940160 32704 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.765448 32715 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.787563 31047 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:21.836381 30892 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 2: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:24:21.837559   379 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:24:21.805608 32709 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:21.785296   355 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.825847 32671 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:21.956079   337 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:21.838944 32747 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.846863 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:21.978693 32713 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:21.786316   316 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.816972 32712 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:21.757299   324 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.022298 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:22.023171   313 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.023808   316 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.826162 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.025382 31043 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:22.026458 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.027072 31043 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:22.016446   337 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.029035 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.950945 32739 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:21.933645 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.857486   373 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.839776 32736 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.524439   369 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.861438   365 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.858407   363 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:21.938616 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 207404us
W20260709 12:24:21.938743 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 127947us
I20260709 12:24:21.825495   345 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.868237 32740 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:21.860198   300 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:21.949584 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.821491 31046 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.942108   370 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.940349 32669 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3.
I20260709 12:24:21.942399 32765 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:21.982770 30974 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:21.955837 32767 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:21.836886   376 log.cc:927] Time spent T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:24:21.986560   355 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:21.989015   347 log.cc:927] Time spent T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.822s	user 0.003s	sys 0.000s
I20260709 12:24:21.988567 32671 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.990114 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:21.990837 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:21.973265 32714 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.991935   368 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:21.856133   346 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:22.001374 32747 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.002710   311 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:22.003509 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.004477 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.006372 31619 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
W20260709 12:24:22.006357 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 194822us
I20260709 12:24:22.008024 32704 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.010527 32735 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:22.011787 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 165022us
I20260709 12:24:22.013103 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.014403   301 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.014881 32694 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.948975   304 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.947130   318 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:21.955847   344 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.396118 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1455) took 1002 ms. Trace:
I20260709 12:24:22.394797 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.395197 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.396695 31049 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:22.397189 30968 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:22.399474 31045 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:22.397614 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:22.059253 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.398840 30971 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:22.400818 31048 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:22.399750 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.401054 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:22.038122 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.401961 30968 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:22.403046 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.403700 30968 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
W20260709 12:24:22.155055 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 338832us
I20260709 12:24:22.404709 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.396734 30898 rpcz_store.cc:276] 0709 12:24:21.393765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.459819 (+ 66054us) service_pool.cc:224] Handling call
0709 12:24:21.460115 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.460300 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.460322 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.468889 (+  8567us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.721813 (+252924us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:21.721844 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.721903 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.395888 (+673985us) raft_consensus.cc:1685] finished
0709 12:24:22.395909 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.396049 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":222669,"threads_started":1,"wal-append.queue_time_us":256180}
I20260709 12:24:22.405437 30968 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:22.026459 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.408792 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:22.154603 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 500757us
I20260709 12:24:22.410583 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.412084 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:22.412709 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:22.413357 30898 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:22.416738 30973 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:22.407915 31621 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:22.406631 32704 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.330255   323 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.406430   368 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:22.419711 32713 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.424054 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:22.422173 32712 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.425582 30901 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:22.422053   303 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:22.425616 32712 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:22.424404 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:22.427314 31616 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:22.217276 32725 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.428769 32725 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.429215 32725 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.429608 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.430584 32722 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.431069 32722 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:22.426908 32712 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.431805   365 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.433144 32722 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:22.433727   365 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:22.382807   383 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 12:24:22.435317   345 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:22.436269   345 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.436698   345 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.426898   303 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.396597   373 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.438943   373 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.439244   303 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.440677 31013 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:22.442013   322 consensus_meta.cc:287] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.007s
I20260709 12:24:22.442459   388 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.443506 32715 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.444514 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 344) took 1413 ms. Trace:
I20260709 12:24:22.412081 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:22.407262 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:22.447903 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:22.448206 31587 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:22.449098 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:22.451299 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:22.453008 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.454869 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:22.444902 30894 rpcz_store.cc:276] 0709 12:24:21.031293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.450092 (+418799us) service_pool.cc:224] Handling call
0709 12:24:21.450406 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.450799 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.450855 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.451341 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.580510 (+129169us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:21.580561 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.580624 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:22.444315 (+863691us) raft_consensus.cc:1685] finished
0709 12:24:22.444332 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.444456 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":485,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":127457,"threads_started":1,"wal-append.queue_time_us":287287}
I20260709 12:24:22.456617 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:22.457814 31587 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:22.458742 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.459970 31048 raft_consensus.cc:2410] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:24:22.385511   336 consensus_meta.cc:287] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.000s
I20260709 12:24:22.463418 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 1821) took 1036 ms. Trace:
I20260709 12:24:22.477166 31014 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:22.477869 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:22.328078 32756 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.020s	sys 0.018s
W20260709 12:24:22.221866   385 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
W20260709 12:24:22.493189 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.494589 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.495252 30971 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:22.331164   387 log.cc:927] Time spent T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
W20260709 12:24:22.330219 32615 consensus_meta.cc:287] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.002s
I20260709 12:24:22.468047 31050 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:22.470860 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:22.522181 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 51417.7us
I20260709 12:24:22.522964 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:22.479103 31048 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:22.469077 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52841.6us
W20260709 12:24:22.331745   384 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.335s	user 0.000s	sys 0.000s
I20260709 12:24:22.455884 32713 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.544440 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.023633   313 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.477389 30974 rpcz_store.cc:276] 0709 12:24:21.427102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.513867 (+ 86765us) service_pool.cc:224] Handling call
0709 12:24:22.463222 (+949355us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540008be54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:22.463362 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941879680}
I20260709 12:24:22.487053 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.487432 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.547333 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:22.399220 32714 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.424275   323 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:22.442246   360 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.429234 30972 raft_consensus.cc:1240] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:22.220947 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:22.546821 31049 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:22.322139 32670 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.507884 32669 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.129281 32731 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:22.461218 32722 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.532491 30894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f278da50d600410dbed3af60b0147046"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:24:22.483331 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:22.578787 30894 raft_consensus.cc:606] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:22.488651 32756 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.020s	sys 0.018s
I20260709 12:24:22.476234   365 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.457134   346 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.456009   322 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.485152   361 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:22.545279 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1825) took 1040 ms. Trace:
I20260709 12:24:22.558785 31046 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:22.165292 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.620610 31043 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:22.621163 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1876) took 1109 ms. Trace:
I20260709 12:24:22.486419 32671 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.562233   300 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:22.461537   394 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.563325   345 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.564599   327 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.565874   324 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:22.565623 32704 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.333387 32739 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.571667 31045 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:22.484938   390 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.508507   366 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:22.670261   366 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:22.671154   366 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.673925 31047 raft_consensus.cc:2368] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:22.218227   349 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.488876 32740 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:22.220805   350 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.578943 30967 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:22.579156 30894 raft_consensus.cc:614] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:22.447165   301 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:22.556095   371 consensus_meta.cc:287] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.002s
I20260709 12:24:22.543598   303 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:22.446995 32765 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.477386   375 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:22.542528 32728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.002s	sys 0.032s
I20260709 12:24:22.543228 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:22.585121 30864 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:22.577768 32669 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.588581 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:22.590852   369 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.171803 32709 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.594878 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1805) took 2685 ms. Trace:
I20260709 12:24:22.598270   373 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.559011   360 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.604140   318 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.605331   344 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.736559 32669 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.566915 32615 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:22.583325 32731 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.608501 32735 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:22.608669   316 consensus_meta.cc:287] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.584s	user 0.004s	sys 0.004s
I20260709 12:24:22.768510   316 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.614578 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1868) took 1105 ms. Trace:
I20260709 12:24:22.619941 32725 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.489929   336 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.610484 31050 rpcz_store.cc:276] 0709 12:24:21.505282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.544155 (+1038873us) service_pool.cc:224] Handling call
0709 12:24:22.545217 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:22.625598 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 148505us
I20260709 12:24:22.456748 32767 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.621507 31043 rpcz_store.cc:276] 0709 12:24:21.511458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.027675 (+516217us) service_pool.cc:224] Handling call
0709 12:24:22.621098 (+593423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.584332   365 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.636330 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 464) took 1106 ms. Trace:
W20260709 12:24:22.650074 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.653537 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.654844 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1830) took 1148 ms. Trace:
I20260709 12:24:22.609397   388 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.566712 32713 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.668627 32704 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:22.669404 32739 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:22.658780   390 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.159829   372 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:22.678958 30941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.018s	sys 0.019s
I20260709 12:24:22.644341   394 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:22.704243 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 240098us
I20260709 12:24:22.645334   361 raft_consensus.cc:697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:22.595245   363 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.650779 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:22.648160   397 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.584983 32722 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.656733 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:22.658912   327 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:22.731776 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 146679us
I20260709 12:24:22.733340 31048 raft_consensus.cc:2368] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:22.647903   300 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:24:22.606019   337 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.736564   389 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.763553 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:22.787628 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:22.789341   373 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.684238   392 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:22.767596 32615 raft_consensus.cc:697] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:22.769434 31046 rpcz_store.cc:276] 0709 12:24:21.509576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.806680 (+297104us) service_pool.cc:224] Handling call
0709 12:24:22.614519 (+807839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:22.776903 30970 rpcz_store.cc:276] 0709 12:24:19.909779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.910002 (+   223us) service_pool.cc:224] Handling call
0709 12:24:19.925975 (+ 15973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.927192 (+  1217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.927222 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.973363 (+ 46141us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.988889 (+1015526us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.988930 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.989005 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.988448 (+999443us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:22.568263 (+579815us) raft_consensus.cc:1685] finished
0709 12:24:22.568282 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:22.594783 (+ 26501us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30427,"raft.queue_time_us":1595,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":39350,"spinlock_wait_cycles":8964992,"thread_start_us":981184,"threads_started":1,"wal-append.queue_time_us":1099715}
I20260709 12:24:22.916123 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:23.203142 30941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.018s	sys 0.029s
W20260709 12:24:22.736338 32728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.002s	sys 0.035s
W20260709 12:24:23.173892 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.079988 31588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.042s
I20260709 12:24:23.203459 31050 raft_consensus.cc:2393] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:22.793891 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:22.934768 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:23.066515 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.024s	sys 0.025s
I20260709 12:24:23.048080 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:23.046269 30939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.030s
I20260709 12:24:22.729949 32715 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:23.208845 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.024s	sys 0.029s
W20260709 12:24:22.732220 32759 consensus_meta.cc:287] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.924s	user 0.018s	sys 0.005s
I20260709 12:24:22.732892   303 raft_consensus.cc:697] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:22.939692   336 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.775926   355 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.922538 32735 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.950433 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:22.771958   360 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:23.059283 30973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.041s
I20260709 12:24:22.892763 32694 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:23.122610 30971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.005s
I20260709 12:24:22.829774 31049 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:23.208809 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:24:23.207973 31588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.012s	sys 0.042s
I20260709 12:24:22.941538 32731 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:23.122984   368 consensus_meta.cc:287] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.699s	user 0.004s	sys 0.005s
W20260709 12:24:23.195204 30942 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.006s
I20260709 12:24:23.209515 31622 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:22.997990   396 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:24:23.209185 30939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.021s	sys 0.030s
I20260709 12:24:23.210011 31623 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:22.703373 32742 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.006s	sys 0.018s
I20260709 12:24:23.194953 31045 rpcz_store.cc:276] 0709 12:24:21.506533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.448844 (+942311us) service_pool.cc:224] Handling call
0709 12:24:22.654783 (+205939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.207027 30864 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:22.889901 32712 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.214627 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1827) took 1708 ms. Trace:
W20260709 12:24:23.209466 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 679434us
I20260709 12:24:22.733620   375 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.711071   371 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:23.544431 30973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.011s	sys 0.052s
I20260709 12:24:22.875016 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1823) took 1350 ms. Trace:
W20260709 12:24:23.544744 30971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.012s	sys 0.024s
I20260709 12:24:23.545090 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:23.544073 30942 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.018s	sys 0.009s
I20260709 12:24:23.545459 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:23.558357 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 363) took 1150 ms. Trace:
I20260709 12:24:23.164309   346 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:23.545753 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:22.923194 32670 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:23.216935 30896 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
W20260709 12:24:23.189863 32714 consensus_meta.cc:287] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.001s
W20260709 12:24:23.174511 32756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.002s	sys 0.006s
I20260709 12:24:22.964344   324 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:23.748098 31049 rpcz_store.cc:276] 0709 12:24:22.408062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.639331 (+231269us) service_pool.cc:224] Handling call
0709 12:24:22.649281 (+  9950us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:22.653410 (+  4129us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508e9c 00007f032d508a5b 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:23.558292 (+904882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19454080}
I20260709 12:24:23.448180   350 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:23.068783 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:23.855014   350 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.855654   350 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:23.856200   350 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.213057 31619 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:23.857246 31049 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.205736 32736 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.858163 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 367) took 1449 ms. Trace:
W20260709 12:24:23.161340 32747 consensus_meta.cc:287] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.699s	user 0.007s	sys 0.000s
I20260709 12:24:23.858575 31049 rpcz_store.cc:276] 0709 12:24:22.409002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.777962 (+1368960us) service_pool.cc:224] Handling call
0709 12:24:23.856706 (+ 78744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.857811 (+  1105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.858040 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.281833 32767 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:23.780731   355 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:23.860632 32767 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:23.753525 32756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.008s	sys 0.018s
I20260709 12:24:23.861464 32767 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.819511   410 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:22.939590   304 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:22.999688   322 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:23.864156   410 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.202915   327 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.865568   327 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.865689   371 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:23.561021 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 1.03806e+06us
I20260709 12:24:23.212859   389 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:23.783449   370 consensus_meta.cc:287] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.318s	user 0.010s	sys 0.007s
I20260709 12:24:23.868094   389 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.868273 30939 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:23.868487   370 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:23.870131 31044 raft_consensus.cc:2393] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:23.598654 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.871240   370 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:23.785014   375 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:23.213250   397 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:23.871784 31044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1873) took 2360 ms (client timeout 2655 ms). Trace:
I20260709 12:24:23.568449 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:23.198690 30969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.003s	sys 0.002s
I20260709 12:24:23.872498 32731 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:23.444952 32671 consensus_meta.cc:287] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.000s
I20260709 12:24:23.192299 32709 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.465045 30799 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.760205 32714 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:23.205456 32713 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:23.734714 31016 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.018s
W20260709 12:24:23.876998 31016 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.003s	sys 0.018s
W20260709 12:24:23.544260 32742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.576s	user 0.011s	sys 0.041s
I20260709 12:24:23.852525 31042 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:23.266999 32759 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.998955 32765 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:23.072669   301 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:23.216465   303 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.858485 32736 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:23.846679 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 294) took 1809 ms. Trace:
I20260709 12:24:23.872339   397 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.877640 32714 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:23.281558   316 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:23.760957   346 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:23.859360 32747 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.882819   346 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:23.286201   413 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:24:23.744050 31623 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:22.822584   365 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.000362   349 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:23.048084   356 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:23.873028 30969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.005s	sys 0.008s
I20260709 12:24:23.760161 32670 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.889667   356 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.890237 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 293) took 1853 ms. Trace:
I20260709 12:24:23.212592   390 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.558337   361 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:23.877585 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 683881us
I20260709 12:24:23.223420   392 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.421675   405 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.896890   405 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.150529   416 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.751786 30901 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:23.355670   408 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:23.747668 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 1.07403e+06us
I20260709 12:24:23.898582   416 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.900352 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 475) took 1486 ms. Trace:
I20260709 12:24:23.898550 31043 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:23.902083 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.748119 30898 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:23.903509 31621 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.160243   398 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.733747 31046 rpcz_store.cc:276] 0709 12:24:21.505805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.213740 (+1707935us) service_pool.cc:224] Handling call
0709 12:24:23.214175 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.214346 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.214371 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:23.214408 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:23.214438 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.214485 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.214576 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281344}
I20260709 12:24:23.904965 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1833) took 2170 ms. Trace:
I20260709 12:24:23.880323 30976 rpcz_store.cc:276] 0709 12:24:22.037326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.037793 (+   467us) service_pool.cc:224] Handling call
0709 12:24:22.155941 (+118148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.287628 (+131687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.287664 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.318026 (+ 30362us) log.cc:844] Serialized 26 byte log entry
0709 12:24:22.677340 (+359314us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:22.677378 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.677440 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.845940 (+1168500us) raft_consensus.cc:1685] finished
0709 12:24:23.846016 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.846373 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":279655,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":358780,"threads_started":1,"wal-append.queue_time_us":454332}
I20260709 12:24:23.767910   324 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.857343 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 478) took 1246 ms. Trace:
I20260709 12:24:23.847841 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:23.905910 31619 rpcz_store.cc:276] 0709 12:24:22.611146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.622001 (+ 10855us) service_pool.cc:224] Handling call
0709 12:24:23.857142 (+1235141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:23.214030   394 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.883121 31051 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:23.217186 32739 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:23.465866 32669 consensus_meta.cc:287] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.701s	user 0.005s	sys 0.001s
I20260709 12:24:23.786751 32712 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:23.463110 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:23.884745 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 482) took 1090 ms. Trace:
I20260709 12:24:23.873111 32731 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.909405 31623 rpcz_store.cc:276] 0709 12:24:22.793746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.793845 (+    99us) service_pool.cc:224] Handling call
0709 12:24:23.884479 (+1090634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18304}
I20260709 12:24:23.888068 30897 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:23.853008 31013 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:23.787693 32722 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:23.502321   415 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 12:24:23.911248 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 58633.2us
I20260709 12:24:23.911789 32756 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:23.217097 32735 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.912281 32756 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.912751 32756 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.913247 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:23.904583   398 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:23.744388 31014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.000s	sys 0.010s
I20260709 12:24:23.905867   408 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:23.914765 31014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.000s	sys 0.011s
I20260709 12:24:23.752280 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:23.908206 31051 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1866) took 2430 ms (client timeout 2165 ms). Trace:
I20260709 12:24:23.844983 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:23.903668 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1836) took 1467 ms. Trace:
I20260709 12:24:23.916538   346 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.914165 30970 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:23.910168 32731 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.250415   336 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.916903 31042 rpcz_store.cc:276] 0709 12:24:22.436657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.612309 (+175652us) service_pool.cc:224] Handling call
0709 12:24:23.903425 (+1291116us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54002f9ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:23.903609 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190705536}
I20260709 12:24:23.215168   406 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:23.980087   406 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:22.941569 32740 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:22.819168 31617 rpcz_store.cc:276] 0709 12:24:21.516320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.571847 (+ 55527us) service_pool.cc:224] Handling call
0709 12:24:22.134476 (+562629us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:22.622942 (+488466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18537856}
I20260709 12:24:23.567900 32615 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:23.833875 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 626722us
I20260709 12:24:23.462653 30794 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53570 (request call id 371) took 4443 ms. Trace:
I20260709 12:24:23.883010   410 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:23.566474   368 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:23.461292   412 log.cc:927] Time spent T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
I20260709 12:24:23.345089   318 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.099145   318 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:23.568092 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.101701 30895 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:23.839491 30896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1779) took 2357 ms (client timeout 2655 ms). Trace:
W20260709 12:24:23.850977 30867 connection.cc:256] RPC call timeout handler was delayed by -1.3984403939998629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 12:24:24.102733 30896 rpcz_store.cc:269] 0709 12:24:21.481711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.734193 (+252482us) service_pool.cc:224] Handling call
0709 12:24:23.839072 (+2104879us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003ec6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:23.839308 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3195398528}
W20260709 12:24:23.872329 31044 rpcz_store.cc:269] 0709 12:24:21.510802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.026156 (+515354us) service_pool.cc:224] Handling call
0709 12:24:23.871461 (+1845305us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400163354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:23.871647 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3358871680}
W20260709 12:24:23.916209 31051 rpcz_store.cc:269] 0709 12:24:21.478101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.478210 (+   109us) service_pool.cc:224] Handling call
0709 12:24:23.907905 (+2429695us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b54002d1254. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:23.908090 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5447108864}
I20260709 12:24:23.871161 30939 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:23.962109 31622 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:23.912293 31013 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:24.104535 30867 connection.cc:256] RPC call timeout handler was delayed by -1.3705403939998178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:24:23.216104   311 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.533s
I20260709 12:24:23.905489 31043 rpcz_store.cc:276] 0709 12:24:21.734769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.502753 (+1767984us) service_pool.cc:224] Handling call
0709 12:24:23.558189 (+ 55436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.901264 (+343075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.904573 (+  3309us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b540013f954. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:23.904858 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781235072}
I20260709 12:24:23.974335 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:23.747032 31047 rpcz_store.cc:276] 0709 12:24:21.504779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.990564 (+485785us) service_pool.cc:224] Handling call
0709 12:24:22.782529 (+791965us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540015a4d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:22.854960 (+ 72431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546152832}
I20260709 12:24:24.016803 32739 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.018639 32670 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.018817 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:23.970636 32759 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:23.909157 32669 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.102875   350 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.155745 32669 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.061620 32742 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:23.984489   356 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.156688   368 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.063848 30794 rpcz_store.cc:276] 0709 12:24:19.019649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.026786 (+  7137us) service_pool.cc:224] Handling call
0709 12:24:19.075640 (+ 48854us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b54001d0510. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d5090b2 00007f0336482759 00007f033641aa76 00007f03363ebd58 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc
0709 12:24:23.462572 (+4386932us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:21.195832 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:21.196401 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:21.196432 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:24:21.196450 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:21.263227 (+ 66777us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:21.265260 (+  2033us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:21.269230 (+  3970us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:21.288282 (+ 19052us) tablet.cc:701] Row locks acquired
0709 12:24:21.290428 (+  2146us) write_op.cc:260] PREPARE: finished
0709 12:24:21.299911 (+  9483us) write_op.cc:270] Start()
0709 12:24:21.305869 (+  5958us) write_op.cc:276] Timestamp: P: 1783599861297483 usec, L: 0
0709 12:24:21.309557 (+  3688us) op_driver.cc:348] REPLICATION: starting
0709 12:24:21.366297 (+ 56740us) log.cc:844] Serialized 527 byte log entry
0709 12:24:22.381811 (+1015514us) op_driver.cc:464] REPLICATION: finished
0709 12:24:22.677788 (+295977us) write_op.cc:301] APPLY: starting
0709 12:24:22.687170 (+  9382us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:22.730301 (+ 43131us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:22.827147 (+ 96846us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:23.066875 (+239728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:23.124488 (+ 57613us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:23.155149 (+ 30661us) write_op.cc:312] APPLY: finished
0709 12:24:23.183687 (+ 28538us) log.cc:844] Serialized 23 byte log entry
0709 12:24:23.183897 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.183974 (+    77us) write_op.cc:454] Released schema lock
0709 12:24:23.184016 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:23.292411 (+108395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.323496 (+ 31085us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53190,"reported_tablets":6,"spinlock_wait_cycles":35247488,"child_traces":[["op",{"apply.queue_time_us":266376,"apply.run_cpu_time_us":2834,"apply.run_wall_time_us":541075,"num_ops":1,"prepare.queue_time_us":1084084,"prepare.run_cpu_time_us":12180,"prepare.run_wall_time_us":251782,"raft.queue_time_us":388336,"raft.run_cpu_time_us":17134,"raft.run_wall_time_us":194405,"replication_time_us":1072098,"thread_start_us":1642160,"threads_started":4,"wal-append.queue_time_us":101660}]]}
I20260709 12:24:24.156960   350 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.104087 32747 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:24.157591 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 286599us
W20260709 12:24:24.079773   425 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:24:24.080215   336 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.159263 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1832) took 2434 ms. Trace:
W20260709 12:24:24.159893 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 247791us
I20260709 12:24:24.020011   349 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.161489   349 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.087859 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1834) took 2222 ms. Trace:
I20260709 12:24:24.088886   365 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.019706   406 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.164129   419 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:24.164636   419 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.165093   419 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.163870 31045 rpcz_store.cc:276] 0709 12:24:21.837941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.543943 (+1706002us) service_pool.cc:224] Handling call
0709 12:24:23.544279 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.544632 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.544658 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:23.568052 (+ 23394us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.023476 (+455424us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:24.023588 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.023691 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:24.024620 (+   929us) raft_consensus.cc:1685] finished
0709 12:24:24.024634 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.060497 (+ 35863us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":887,"raft.run_cpu_time_us":7996,"raft.run_wall_time_us":187374,"thread_start_us":254229,"threads_started":1,"wal-append.queue_time_us":214984}
W20260709 12:24:24.104869 30867 connection.cc:256] RPC call timeout handler was delayed by -1.2922403940001459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:24:24.167629 30867 connection.cc:256] RPC call timeout handler was delayed by -1.2916974429995207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:24:24.168818 30867 connection.cc:256] RPC call timeout handler was delayed by -1.1644403939999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 12:24:24.169121 30867 connection.cc:256] RPC call timeout handler was delayed by -1.059140393999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 12:24:24.077848   397 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:23.877540 30799 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 3 to 4, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.900950 31618 rpcz_store.cc:276] 0709 12:24:22.413616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.443020 (+ 29404us) service_pool.cc:224] Handling call
0709 12:24:22.443372 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.542742 (+ 99370us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:22.929339 (+386597us) log.cc:844] Serialized 14 byte log entry
0709 12:24:23.560554 (+631215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:23.659894 (+ 99340us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:23.668768 (+  8874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.790563 (+121795us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18003d3180. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d50e2a6 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1
0709 12:24:23.803657 (+ 13094us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b18003d3180. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:24:23.873847 (+ 70190us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18003d3180. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d50e2a6 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419
0709 12:24:23.875693 (+  1846us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b5400282154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:23.899880 (+ 24187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.900123 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118812,"prepare.queue_time_us":594927,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":8807,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":61766,"spinlock_wait_cycles":129873536,"thread_start_us":588746,"threads_started":2,"wal-append.queue_time_us":587830}
I20260709 12:24:24.172022 30799 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:24.109895 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.114740 31621 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:23.890618 30969 rpcz_store.cc:276] 0709 12:24:22.036968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.058968 (+ 22000us) service_pool.cc:224] Handling call
0709 12:24:22.207541 (+148573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.552941 (+345400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.552989 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.553640 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 12:24:23.889618 (+1335978us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:23.889717 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.889845 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.889921 (+    76us) raft_consensus.cc:1685] finished
0709 12:24:23.889942 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.890173 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79663,"raft.queue_time_us":228199,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":1535886,"threads_started":2,"wal-append.queue_time_us":651476}
I20260709 12:24:24.116017 32736 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:24.117502 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 485) took 1070 ms. Trace:
I20260709 12:24:24.120163 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.121079 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.123603 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.124750 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.125365   403 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:24.119333 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.128667   327 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.138882   392 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.103714   416 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.139976 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 305) took 1736 ms. Trace:
I20260709 12:24:24.146754   394 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.147790 30976 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:24.152133   316 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:24.153317 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 944404us
I20260709 12:24:24.078608 30864 leader_election.cc:400] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.023361   410 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:24.172646   397 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.164686   406 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.116971   318 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.174279 31622 rpcz_store.cc:276] 0709 12:24:23.047521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.047788 (+   267us) service_pool.cc:224] Handling call
0709 12:24:24.108030 (+1060242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:24.181871 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.173565 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.129885 32767 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:24.182842 30967 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:24.278069 30893 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:24.173612 30799 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 3 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.280159 31620 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:24.270093 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 480) took 1477 ms. Trace:
I20260709 12:24:24.190454 31624 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:24.339577 30864 leader_election.cc:403] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:24.339473 31621 rpcz_store.cc:276] 0709 12:24:22.793197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.793872 (+   675us) service_pool.cc:224] Handling call
0709 12:24:22.950309 (+156437us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508eee 000000000036eb39 00007f033557c1e0 00007f03356450c4 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:24.269880 (+1319571us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54006752d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:24.270022 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885310848}
I20260709 12:24:24.269532 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.268653 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.277285 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:24.353034 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 274640us
I20260709 12:24:24.282021 31016 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:24.358763 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1831) took 2835 ms. Trace:
I20260709 12:24:24.282152 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.360623 30892 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.282593 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.362437 30898 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.364113 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.364768   398 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.364872 31624 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:24.337060   406 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.365937 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:24.280282   313 consensus_meta.cc:287] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 1.703s	user 0.016s	sys 0.004s
I20260709 12:24:24.289031   324 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.367691 31621 raft_consensus.cc:2393] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:24.276755 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.367661 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:24.156752 32742 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.271682 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.372758   349 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.377305 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:24.378809 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.380393   368 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.382026 30898 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.384229 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 308) took 1985 ms. Trace:
I20260709 12:24:24.390090 30973 rpcz_store.cc:276] 0709 12:24:22.400090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.528991 (+128901us) service_pool.cc:224] Handling call
0709 12:24:22.529342 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.745218 (+1215876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.745246 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:23.745676 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.127895 (+382219us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:24.127956 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.128065 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:24.383890 (+255825us) raft_consensus.cc:1685] finished
0709 12:24:24.383914 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.384064 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139449,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":1434063,"threads_started":2,"wal-append.queue_time_us":423893}
I20260709 12:24:24.391237 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.392115 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.392822 30967 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
W20260709 12:24:24.393005   390 consensus_meta.cc:287] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.003s
I20260709 12:24:24.388296   408 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.393437   390 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.395134 30898 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:24.389483 30892 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:24.368444   406 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.396255 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.396898 30975 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.398054 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.398634 31624 raft_consensus.cc:2368] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.398797 30968 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:24.399104 30970 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.186816 31616 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:24.370786   316 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.399880 32735 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.400147 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:24.400892 31616 raft_consensus.cc:2368] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.401551 32742 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.401718 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.371068 30799 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:24:24.402949   389 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.005s
I20260709 12:24:24.368408   403 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.403695 30799 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 3 to 4, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.405325   403 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.405355 30799 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.401700   316 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.407524 31618 raft_consensus.cc:2410] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:24.403124 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.403223   406 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.408126   405 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.408476 32731 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.409409   372 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.390132 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.410718   410 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.411091 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:24.412267 31620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 481) took 1618 ms (client timeout 1659 ms). Trace:
I20260709 12:24:24.276486   363 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.364699   365 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.422966 30894 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:24.417759 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 135818us
I20260709 12:24:24.423197 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.366968   327 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.373075 30897 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:24.269888 32756 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.427735 30901 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.395551   390 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:24.427191 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.461445 30973 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.461238   372 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.459916   363 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.464061   363 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.461170 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.465225 31623 raft_consensus.cc:2368] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.407455 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.428568 30900 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.463892   366 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.190824 30971 rpcz_store.cc:276] 0709 12:24:22.394213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.520184 (+125971us) service_pool.cc:224] Handling call
0709 12:24:22.520544 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.520852 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.520880 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.567299 (+ 46419us) log.cc:844] Serialized 26 byte log entry
0709 12:24:23.459583 (+892284us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:23.747224 (+287641us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:23.747253 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.747299 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:24.127397 (+380098us) raft_consensus.cc:1685] finished
0709 12:24:24.127435 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.130523 (+  3088us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126213,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":23143,"spinlock_wait_cycles":30056320,"thread_start_us":1155137,"threads_started":1,"wal-append.queue_time_us":619319}
I20260709 12:24:24.447654 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.446287 30799 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:24:24.449602 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 73003.7us
I20260709 12:24:24.159691 31048 rpcz_store.cc:276] 0709 12:24:21.724935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.331229 (+1606294us) service_pool.cc:224] Handling call
0709 12:24:23.331577 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.865888 (+534311us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:23.969823 (+103935us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.094914 (+125091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:24.094971 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:24.095034 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.158835 (+ 63801us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54000f46d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:24.158905 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.159077 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":95920,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":35624,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":36998,"spinlock_wait_cycles":1227533056,"thread_start_us":138369,"threads_started":2,"wal-append.queue_time_us":118236}
W20260709 12:24:24.447278 31620 rpcz_store.cc:269] 0709 12:24:22.793488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.793624 (+   136us) service_pool.cc:224] Handling call
0709 12:24:24.412043 (+1618419us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540071cad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:24.412199 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398328192}
I20260709 12:24:24.457648 31622 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:24.457837 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.459437   410 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.459627   336 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:24.460847 32731 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.445081 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.470827 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:24.359297 31050 rpcz_store.cc:276] 0709 12:24:21.513733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.213755 (+1700022us) service_pool.cc:224] Handling call
0709 12:24:23.214037 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:23.896724 (+682687us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:24.074893 (+178169us) log.cc:844] Serialized 14 byte log entry
0709 12:24:24.280421 (+205528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:24.280468 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:24.280575 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.281616 (+  1041us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54001595d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:24.291772 (+ 10156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:24.349498 (+ 57726us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104771,"prepare.queue_time_us":65440,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":103884,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":51033,"spinlock_wait_cycles":1561457536,"thread_start_us":280278,"threads_started":2}
I20260709 12:24:24.482432 31623 raft_consensus.cc:2393] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:24.415640   313 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.474200 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:24.464113 31615 raft_consensus.cc:2410] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:24.423210   389 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.479784 31621 raft_consensus.cc:2368] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.469502   372 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:24.488055 30799 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:24.483778 30864 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:24.483826 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.493014 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.488775 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.494035 30893 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:24.488171 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.476858 31616 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:24.497076 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.495755 30899 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.502018   363 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:24.501819 30799 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:24.502628   363 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:24.503367 30799 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:24.503628   363 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.504415 31624 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.505496 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:24.506497 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.507145 31624 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:24.503913 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.510792 30897 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:24.511737 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.470996 32747 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:24.513331 32747 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.512462 30897 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.513891 30976 raft_consensus.cc:2410] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:24.517558 32731 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.518270 32731 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.520153 32731 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.520624   313 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.521159 32731 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.521840 32731 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.522324 30897 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:24.523921 32731 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.525563 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.525017 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.526208 31623 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:24.527565 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.501924 31622 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:24.530498 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:24.531163   432 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 12:24:24.532450   406 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.456095   419 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.531599 30901 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:24.533675 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.534612 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.535156   419 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.485610   366 raft_consensus.cc:697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:24.535594 30901 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:24.495465 31016 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:24.492329 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:24.541319 30898 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:24.542862 30971 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:24.547587 30896 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.496191 31619 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.548640 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.550487 30900 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:24.549256 30893 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:24.551291 30939 connection.cc:256] RPC call timeout handler was delayed by -1.5095716840000932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 12:24:24.551906 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3172137280002971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:24:24.552273 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2911137280002549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 12:24:24.552549 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2341716840001027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:24:24.552824 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2209137280001414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 12:24:24.535916 30892 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
W20260709 12:24:24.555179 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 69711.7us
I20260709 12:24:24.554481 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:24.553085 30939 connection.cc:256] RPC call timeout handler was delayed by -1.0910716840003261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:24:24.556017 30939 connection.cc:256] RPC call timeout handler was delayed by -1.0487716840002577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260709 12:24:24.557040 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.540587   313 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.540498 32747 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.558751 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.586886 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.586630 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.585629 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.592396 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.593869 30976 raft_consensus.cc:2368] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.597698 31620 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:24.598022 30971 raft_consensus.cc:2393] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:24.598122 31016 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:24.556386   406 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.557827 32731 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.602639 30900 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.601261 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.604449 30897 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:24.605492 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.557641   394 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:24.601447 30899 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:24.609077 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.614001 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.614492 30976 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:24.618288 31016 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:24.599006 30972 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:24.620309 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.619391 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:24.626585 30865 leader_election.cc:336] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.570s (SENT)
W20260709 12:24:24.627048   360 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
I20260709 12:24:24.626875 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.627490   360 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.628111 30967 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:24.627923 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.629747   360 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.630858 32747 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.631273 32747 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:24.631632 32747 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.636013 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.626885 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:24.639863 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 153445us
I20260709 12:24:24.621760   419 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:24.662503 30968 raft_consensus.cc:2368] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3.
I20260709 12:24:24.662891   419 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:24.612871 32735 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:24.664089 30894 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:24.584365 30970 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:24.606192 30897 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:24.608134   406 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.677111 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.681447 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.681556 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.612988   313 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.689370 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.689766 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.690550 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.690966 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:24.693725 32756 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:24.636368 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.690091 30968 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:24.667660   350 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.712972 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.674180 32735 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:24.721925 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 50854.1us
I20260709 12:24:24.722638 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.721240 31624 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.724314 30967 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:24.668578 32731 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:24.730579 30971 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:24.732179 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.735946 30900 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.736806 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.738978 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.739559 31621 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:24.735922 30968 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:24.740999 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.689399 32722 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:24:24.740893 31620 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:24.759245 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.766568 30864 leader_election.cc:400] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.766937 30864 leader_election.cc:403] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:24.744522 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.768988 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.769726 30969 raft_consensus.cc:2368] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.770449 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.771040 30894 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:24.774144 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.774796 30967 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.735491   389 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.779749 30896 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:24.780481 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.743793 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.782779 30974 raft_consensus.cc:2410] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:24.752202 32765 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.756155 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.743393 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.788012 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.790280 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:24.790603   442 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:24:24.791299   406 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.718684   366 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.753067 32735 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.795557 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:24.796314 30971 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.797212 30968 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:24.798163 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 55518.5us
I20260709 12:24:24.793375 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:24.802354 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.751818 32736 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:24:24.752600   419 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.804184 31050 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:24.926918 30865 leader_election.cc:336] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.874s (SENT)
I20260709 12:24:24.997383 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:24.904034 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.963130 31588 connection.cc:256] RPC call timeout handler was delayed by -1.6055403039999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:24:24.842077 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:24.869237 31622 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:24:24.882769 30967 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:24:24.915566 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 68780.8us
W20260709 12:24:24.950935 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 99594.2us
W20260709 12:24:25.004770 31588 connection.cc:256] RPC call timeout handler was delayed by -1.4021403040001132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:24:25.012075 31588 connection.cc:256] RPC call timeout handler was delayed by -1.2230403039998237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:24:25.012336 31588 connection.cc:256] RPC call timeout handler was delayed by -1.1915403040002275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 12:24:25.012627 31588 connection.cc:256] RPC call timeout handler was delayed by -1.151040304000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:24:25.012840 31588 connection.cc:256] RPC call timeout handler was delayed by -1.060140304000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 12:24:25.013047 31588 connection.cc:256] RPC call timeout handler was delayed by -1.0556403040000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 12:24:24.977289 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:25.014323 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 94500us
I20260709 12:24:25.014012 31624 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:25.016979 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.019061 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.021158 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.021732 30974 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:25.022571 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.023244 30974 raft_consensus.cc:2393] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:24.924845 31619 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:25.024905 30968 raft_consensus.cc:2410] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:24.864548 30972 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:25.013520 31622 pending_rounds.cc:85] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 4
W20260709 12:24:24.868592   448 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:24:24.961969   446 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:24:24.915618 30897 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:24.804188   363 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:24.868315   313 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:24.863312 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.036839 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:24.969723 32756 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.023989 32747 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.031359 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:24.804092 31616 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.052992 30971 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:25.034724 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.053290 31588 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:25.054075 30973 raft_consensus.cc:2393] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:24.868912 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.035905 30896 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:24.816617   390 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.826417 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:24.801930 32765 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:24.942308   303 consensus_queue.cc:1059] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.198s
I20260709 12:24:25.040462 32731 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:25.042328 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.043069 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.044097 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.044135 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.048169 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.030062 31622 pending_rounds.cc:107] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:24.942090 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.057046 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.058115 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.058528   360 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:25.058876 31615 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:25.059276 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.055146 31013 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:25.082721 30967 raft_consensus.cc:2376] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4. Re-sending same reply.
I20260709 12:24:25.064005 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:25.084301 31051 raft_consensus.cc:2368] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.065969 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.084918 30971 raft_consensus.cc:2376] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6. Re-sending same reply.
I20260709 12:24:25.068971 32747 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:25.070243 31616 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:25.070873 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.088943 30973 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:25.072086 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.055565 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.080024 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.078362 31622 raft_consensus.cc:2889] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:25.079214   303 raft_consensus.cc:3055] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:25.052310 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.066991 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.091300   303 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:25.091320 31621 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:25.092810 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.092409   303 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:25.093510 31621 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:25.086651 31620 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.093590   303 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.090624   361 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:25.094272   361 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.094622   361 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.095901 30968 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:25.096747 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.097138 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.097347 30968 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:25.090986 30975 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:25.089970 30974 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.091699 30976 raft_consensus.cc:2376] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2. Re-sending same reply.
I20260709 12:24:25.097905 31050 raft_consensus.cc:2368] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.090847 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.079584 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.192420 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.234818 30894 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:25.437414 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.434544 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:25.445075 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 425216us
I20260709 12:24:25.091696 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.451524 30898 raft_consensus.cc:2376] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3. Re-sending same reply.
I20260709 12:24:25.186470 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:25.233990 30865 leader_election.cc:336] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.991s (SENT)
I20260709 12:24:25.444775 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.460042 30968 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:25.300601 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:25.149951 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.333213 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:25.461935 30900 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.299885 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.450322 30967 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:25.450915 31049 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
W20260709 12:24:25.460433 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 226479us
I20260709 12:24:25.460462 30896 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.464968 30973 raft_consensus.cc:2376] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3. Re-sending same reply.
I20260709 12:24:25.185817 31042 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:25.148870 31619 raft_consensus.cc:2393] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:25.467948 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.467654 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.469511 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.469785 30968 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.465976 31046 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:25.118791   350 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.470911 30970 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:25.444880   360 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:25.132113 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.207003 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.087855 31047 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:25.469458 31051 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:25.473472 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.478953 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.203332 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:25.318300 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:25.472098 31013 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:25.205238 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.086956 30969 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:25.493251 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.475013 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.495958 31588 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:25.496349 30967 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.496963 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.091320 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.500684 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.495906 31047 raft_consensus.cc:2410] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:25.502384 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.503132 31047 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:25.503938   363 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.504480   363 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:25.083461 32756 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.505568 31048 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:25.506659   363 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:25.476521 30976 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:25.507709 30967 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:25.508577 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.509271 30867 leader_election.cc:400] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.509604 30867 leader_election.cc:403] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.509627 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.510506   363 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
W20260709 12:24:25.513507 30942 connection.cc:256] RPC call timeout handler was delayed by -1.0690622790002635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28290000000000004s for a response
I20260709 12:24:25.204830 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.479683 31621 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:25.478358 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.480662 30973 raft_consensus.cc:2368] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6.
I20260709 12:24:25.482198 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:25.516587 31049 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:25.483004   450 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 12:24:25.491555   361 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.521353   361 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:25.492127 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.492444 31043 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:25.493666   458 consensus_queue.cc:1059] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:25.494058 30974 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:25.478524 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:25.492125 30864 leader_election.cc:400] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.523272 30864 leader_election.cc:403] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.498471 30892 raft_consensus.cc:2376] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4. Re-sending same reply.
I20260709 12:24:25.499521 31616 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:25.185289   410 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:25.508637 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.148691 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.522174 30900 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:25.087990   390 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.523524 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.495107 31051 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:25.524715 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 52672.1us
I20260709 12:24:25.510444 30976 raft_consensus.cc:2368] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.478623 31617 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:25.557754 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
W20260709 12:24:25.554077 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 62091.3us
I20260709 12:24:25.559145 31013 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:25.481863 30972 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
W20260709 12:24:25.531976 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:25.649252 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 90143.1us
I20260709 12:24:25.525218 31049 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:25.590371 30896 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:25.650141 31013 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:25.643749 30967 raft_consensus.cc:2368] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.559940 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.653453 31045 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.617487 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.654152 30971 raft_consensus.cc:2376] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4. Re-sending same reply.
I20260709 12:24:25.654458 30973 raft_consensus.cc:2368] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.655644 31013 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:25.507706 32756 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:25.522224   361 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:25.649505 30865 leader_election.cc:336] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.807s (SENT)
I20260709 12:24:25.557492 30897 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:25.559615   363 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.578810 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.601812   360 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:25.657193   453 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:25.580185 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.666038 30974 raft_consensus.cc:2410] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:25.666281 30976 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.536221   303 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:25.667694 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.523908   350 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:25.670475 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.670526 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.671126 30967 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:25.671507 30971 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:25.669615 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:25.670553 31013 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:25.591532 31618 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:24:25.657493 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:25.652804   459 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.676657 30968 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:25.665653 32747 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.665567   458 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:25.680370 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 166237us
I20260709 12:24:25.680655 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.675278 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:25.683166 30864 leader_election.cc:400] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.659622   361 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:25.666600 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.683012 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.681504 30974 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.671784   303 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.683480 30864 leader_election.cc:403] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.714967 30968 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:25.714741 30967 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:25.692646 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.694339 32735 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:25.724016 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:25.694051 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:25.727013 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 231159us
W20260709 12:24:25.724777 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 78925.3us
I20260709 12:24:25.725749 30971 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:25.679474   459 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:25.736207 31588 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:25.681833   410 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:25.682467 32747 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:25.725083   361 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.694944 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.724671   303 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:25.743402   454 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:24:25.744169   363 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:25.745213 30973 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:25.745836 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.769721 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.726631   419 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:24:25.737147 31616 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:25.733963   458 raft_consensus.cc:697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:25.737550   459 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.783768 30971 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.784220 30967 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:25.783424 30939 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:25.739411   316 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:25.781898 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.792060 30975 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:25.785614 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:25.792965 30973 raft_consensus.cc:2368] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3.
I20260709 12:24:25.778386 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.739959 32747 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.790704 31588 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:25.801225 30967 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.781087   465 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:25.800705 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 119007us
I20260709 12:24:25.804546 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:25.794045 30969 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:25.812412 30976 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:25.803922   465 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.804404   390 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:25.830084 30865 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.588s (SENT)
I20260709 12:24:25.824548 32735 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:25.824714 30971 raft_consensus.cc:2410] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:25.837435   458 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:25.840303   463 log.cc:927] Time spent T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:24:25.841741 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.841827 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.842625 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:25.842993 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:25.843292 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.874342 31623 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:25.844071 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.844837 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.874449 31588 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:25.845549 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.803285   316 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:25.824321 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44667.3us
I20260709 12:24:25.819819 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:25.872025 31620 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:25.824350   469 raft_consensus.cc:2764] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:25.812637 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.876019   461 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:25.877107 32736 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:25.848155   465 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.880957 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.848790 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:25.892130 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.886889 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.812873 30897 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:25.825018   363 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.892168 30896 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:25.889389 30899 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:25.893754 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 67114.3us
I20260709 12:24:25.896355 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.897444 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.897989 30894 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:25.898908 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.826347   473 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:24:25.900923 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:25.901724 30892 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:25.892241 32736 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:25.904999 30897 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:25.882289 31615 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:25.889259   461 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.906299 30897 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.907531 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:25.908080 30896 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.886394 31617 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:25.904652 32736 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:25.880330   350 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:25.899605 30894 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:25.913725 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 83660.6us
W20260709 12:24:25.923313 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 48964.7us
W20260709 12:24:25.924305 30865 leader_election.cc:336] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.639s (SENT)
I20260709 12:24:25.913000 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:25.917135 30896 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
W20260709 12:24:25.917068 31587 connection.cc:256] RPC call timeout handler was delayed by -3.663345400000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 12:24:25.918272 30939 leader_election.cc:400] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3.
W20260709 12:24:25.926308 31587 connection.cc:256] RPC call timeout handler was delayed by -2.6065425920000962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 12:24:25.889873 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:25.927902 31587 connection.cc:256] RPC call timeout handler was delayed by -2.6065425920000962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 12:24:25.927410 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:25.928220 31587 connection.cc:256] RPC call timeout handler was delayed by -2.6038425920000918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:24:25.913673   363 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:25.929813 32736 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.927429   459 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.929778   363 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.934024   459 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:25.935806   350 consensus_queue.cc:1059] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:25.906344   461 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:25.929273 31587 connection.cc:256] RPC call timeout handler was delayed by -2.2213425919999281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 12:24:25.928968 30893 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:25.942725 30898 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:25.951036 31587 connection.cc:256] RPC call timeout handler was delayed by -2.1898425920003319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 12:24:25.951383 31587 connection.cc:256] RPC call timeout handler was delayed by -2.1493425920002664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 12:24:25.890200   480 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:25.894258 30972 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
W20260709 12:24:25.951654 31587 connection.cc:256] RPC call timeout handler was delayed by -2.1493425920002664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:24:25.953564 31587 connection.cc:256] RPC call timeout handler was delayed by -2.0584425920001195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 12:24:25.954016 31587 connection.cc:256] RPC call timeout handler was delayed by -1.9549425919999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2323s for a response
W20260709 12:24:25.954365 31587 connection.cc:256] RPC call timeout handler was delayed by -1.7659425920001013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2533s for a response
W20260709 12:24:25.954712 31587 connection.cc:256] RPC call timeout handler was delayed by -1.6687425919999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2641s for a response
I20260709 12:24:25.924307   473 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:25.955233 31587 connection.cc:256] RPC call timeout handler was delayed by -1.6687425919999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2641s for a response
W20260709 12:24:25.965809 31587 connection.cc:256] RPC call timeout handler was delayed by -1.4302425920000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2906s for a response
I20260709 12:24:25.958004   465 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.960043 32735 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.941422   303 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:25.963302   316 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:25.940135   363 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:25.982843 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:25.983325   363 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:25.972247   316 raft_consensus.cc:3055] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:25.983930 30892 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:25.945940 31616 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.975198   480 consensus_queue.cc:1059] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:25.976255 32765 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:25.980633   303 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:25.981456 31588 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:25.983485 30970 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:26.003471 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1440) took 1229 ms. Trace:
W20260709 12:24:25.973935 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 136952us
I20260709 12:24:25.974007   361 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:26.004019 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 107561us
I20260709 12:24:25.983870   316 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:26.003965 30970 rpcz_store.cc:276] 0709 12:24:24.773806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.474652 (+700846us) service_pool.cc:224] Handling call
0709 12:24:25.804485 (+329833us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800190598. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508eee 000000000036eb39 00007f033557c1e0 00007f03356450c4 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:25.982753 (+178268us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800190598. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508f8c 00007f032d508ef6 000000000036eb39 00007f033557c1e0 00007f03356450c4 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:26.003413 (+ 20660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10561664}
I20260709 12:24:26.009863 31044 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:26.017155 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 104273us
I20260709 12:24:26.017834 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.018638 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.019464 30971 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:26.024147 31587 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.024628 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.027839 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.026019 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.034551 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.044304 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.045147 30970 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:26.009459 32747 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.000344   461 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.033931 31618 raft_consensus.cc:2393] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:26.028597   390 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.054776 31048 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:26.033607   480 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.058827   390 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.062355   390 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.046864 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:26.069453   461 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:26.069675   465 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:26.070175   461 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.070536   461 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.070840   461 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.071082   390 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.072013 31624 raft_consensus.cc:2393] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:26.073935   390 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:26.058601 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:26.151084 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 91404.1us
I20260709 12:24:26.075933 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.153298 31042 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:26.152673 30969 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.154760   489 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.154644 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.155419 30972 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:26.095880 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 61428.1us
I20260709 12:24:26.156445   489 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.078691   361 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:26.061594   316 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.157176 31014 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.157840   316 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.158541   361 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.159775   390 raft_consensus.cc:3055] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:26.160120   390 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:26.158041 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:26.158329   459 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:26.164112 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 135786us
I20260709 12:24:26.152377 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:26.077128 30867 leader_election.cc:336] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.535s (SENT)
I20260709 12:24:26.167778 31588 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:26.168758 30867 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:26.210273 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 57980.9us
W20260709 12:24:26.212963 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.220959 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52392.6us
I20260709 12:24:26.221786 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.222849 31016 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:26.227478 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 69508.7us
I20260709 12:24:26.231230 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:26.230240 30942 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:26.169572 32747 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:26.233983 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 74321.2us
I20260709 12:24:26.232491   465 raft_consensus.cc:2764] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:24:26.240790 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.237351 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 160253us
I20260709 12:24:26.239886 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:26.236619 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:26.226442   361 raft_consensus.cc:2764] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:26.226661   469 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.226505   459 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.233744   473 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.251597 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.252801 30894 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:26.251978 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 84288.6us
I20260709 12:24:26.253135 31014 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.225919   410 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:26.236855   477 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.257143   363 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.258958   363 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.257557 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.259979 31616 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:26.260390 30898 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.269369 30969 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:26.270560   410 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.273813 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.258026 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.274609   465 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:26.263192   477 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.275180   477 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.251016   487 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.276065   487 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.276433 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.277184   465 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.277546   465 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.277884   465 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.278264   487 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:26.264878 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:26.280833 31014 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.265595   492 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.265349   461 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.251777   493 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.273943 30898 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:26.262560   363 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.281224 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.253070   469 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:26.297173 30865 leader_election.cc:336] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.674s (SENT)
W20260709 12:24:26.301445 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 66260us
I20260709 12:24:26.254240   491 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.302211 31013 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:26.307535 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 75469.2us
I20260709 12:24:26.284854   492 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:26.308588 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.299656   494 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.299849   360 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.291257   493 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.308833 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.305428 31014 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.233767   390 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:26.310499 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 79346.7us
I20260709 12:24:26.320860 30939 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:26.321667   360 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:26.322117   360 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.313686   419 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:26.307189 30864 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:26.313491 31016 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.304356   469 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.305028   361 raft_consensus.cc:2764] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:24:26.328321 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 92944.2us
I20260709 12:24:26.310745   492 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.317536 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.333951 31042 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:26.334550   361 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.314304   489 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:26.336054   458 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.337913   477 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.327415   493 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.340015 30864 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:26.341187   487 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:26.341549   487 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.341876   487 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:26.343669 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.345506 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 47068.2us
I20260709 12:24:26.346251   477 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.346197 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:26.309496   324 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:24:26.355083 31014 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.329471   473 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.356164 32736 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.355578   419 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.357101 32736 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:26.357175   419 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.357546 32736 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.357618   419 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.326764 32735 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:26.360919   458 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:26.318359   490 consensus_queue.cc:1059] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:26.367013   490 raft_consensus.cc:3055] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:26.367374   490 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:26.367695 30795 catalog_manager.cc:5697] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 2 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:24:26.368260   490 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.369145   476 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:26.369774   497 log.cc:927] Time spent T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:24:26.369973   489 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:26.370779 30799 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48640 (request call id 258) took 4919 ms. Trace:
I20260709 12:24:26.370924 32765 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:26.370925   489 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.372215   500 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.371915   458 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.372151   316 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:26.373188   316 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:26.369235 30795 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 3 to 4, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:24:26.363181 31013 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:26.364084 31016 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.361829   473 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.371130   461 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:26.372678   500 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.399515 31046 raft_consensus.cc:1240] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:26.396441 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 75661.4us
I20260709 12:24:26.371162 30799 rpcz_store.cc:276] 0709 12:24:21.451674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.451848 (+   174us) service_pool.cc:224] Handling call
0709 12:24:26.370669 (+4918821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:24.676028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:24.753945 (+ 77917us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:24.753995 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:24:24.754015 (+    20us) tablet.cc:662] Decoding operations
0709 12:24:24.870303 (+116288us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:24.870396 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:24.870425 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:24:24.871579 (+  1154us) tablet.cc:701] Row locks acquired
0709 12:24:24.871637 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:24:24.925316 (+ 53679us) write_op.cc:270] Start()
0709 12:24:24.961787 (+ 36471us) write_op.cc:276] Timestamp: P: 1783599864895699 usec, L: 0
0709 12:24:24.961816 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:24:24.962569 (+   753us) log.cc:844] Serialized 4388 byte log entry
0709 12:24:25.742628 (+780059us) op_driver.cc:464] REPLICATION: finished
0709 12:24:25.902458 (+159830us) write_op.cc:301] APPLY: starting
0709 12:24:25.902556 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:25.902794 (+   238us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:25.903075 (+   281us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:25.904509 (+  1434us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:25.904904 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:24:25.904948 (+    44us) write_op.cc:312] APPLY: finished
0709 12:24:25.905310 (+   362us) log.cc:844] Serialized 83 byte log entry
0709 12:24:25.927662 (+ 22352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:25.952972 (+ 25310us) write_op.cc:454] Released schema lock
0709 12:24:25.959891 (+  6919us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:25.960354 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:25.960385 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":271225,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":137331,"apply.run_cpu_time_us":5431,"apply.run_wall_time_us":57867,"num_ops":11,"prepare.queue_time_us":148529,"prepare.run_cpu_time_us":117555,"prepare.run_wall_time_us":507810,"raft.queue_time_us":219862,"raft.run_cpu_time_us":31656,"raft.run_wall_time_us":64662,"replication_time_us":780655,"thread_start_us":531925,"threads_started":4,"wal-append.queue_time_us":557292}]]}
I20260709 12:24:26.371342 32765 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:26.397217 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 91140.3us
I20260709 12:24:26.375097   477 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:26.374001   316 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.391986 32735 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.394706   473 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:26.443548 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 75154.5us
W20260709 12:24:26.439417 30867 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.729s (SENT)
I20260709 12:24:26.439937 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:26.446547 31046 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.448554   490 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.402736   410 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.439864   366 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:24:26.450619   469 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.400954   500 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:26.459079   502 log.cc:927] Time spent T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:26.460465   504 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:26.461261 32765 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:26.462648   506 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:24:26.463315 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.463861   499 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.464325 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.464641 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.464901 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.547122 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.465849 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.466099 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.467085 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.468163 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.468333 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.468585 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.458081   419 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.458192   360 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.508875 32735 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:26.476056 30865 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.795s (SENT)
I20260709 12:24:26.477682 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.440251 31016 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.478713   493 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.479108 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.480178 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.481911   492 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.482550 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:26.509895 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 70039.9us
I20260709 12:24:26.510949 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:26.512359 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 181620us
I20260709 12:24:26.525447 31014 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:26.518131 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 78745.8us
I20260709 12:24:26.549467 31622 raft_consensus.cc:2410] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:24:26.549576 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 239927us
I20260709 12:24:26.469439   316 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:26.563611 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.596913 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 120882us
I20260709 12:24:26.512791   410 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:26.613106 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 87733.2us
I20260709 12:24:26.614427 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:26.602270 31050 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:26.607494 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.524935   503 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.549189   499 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:26.618606 31046 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:26.619208 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 179037us
I20260709 12:24:26.547047 32736 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.624886 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.620577 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.629328 31587 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.630538 31016 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.631908 31623 raft_consensus.cc:2368] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:26.622768 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.632985 31621 raft_consensus.cc:2368] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5.
I20260709 12:24:26.547122 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.633502 31615 raft_consensus.cc:2368] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:26.628751 32765 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.649421 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.629510   474 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.648880 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.649838 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.630805 31042 raft_consensus.cc:1240] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.651806 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.652915 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.628741   503 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:26.654348 30971 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:26.655911 30974 raft_consensus.cc:2376] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4. Re-sending same reply.
I20260709 12:24:26.655603 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.634512   458 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.662621 31046 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.660099 31620 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:26.637629   460 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.634039   459 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.658512 31622 raft_consensus.cc:2368] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:26.629046   499 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.616812   491 consensus_queue.cc:1059] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:26.658004 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.665282 31050 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.659668 31587 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.671758 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.675376 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.551563   504 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.634436   471 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:24:26.647867 32747 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:24:26.660341 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.677394 31620 raft_consensus.cc:2393] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:26.678974 31621 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 1.
I20260709 12:24:26.668828 32735 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.699075   487 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.656725   474 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:26.656553   510 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.658679   503 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.681406 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:26.682094 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.685529 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:26.687604 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.691452 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.691949 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.692268 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.693370   459 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.645740   366 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:24:26.658865   469 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.697688   410 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.663671   458 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:26.718873   360 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.718983   458 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.719403 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.720268 30967 raft_consensus.cc:2393] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:26.720338   492 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.712615 30969 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:26.708215   491 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:26.722043   491 raft_consensus.cc:697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:26.722342   504 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:26.722924   491 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.715014   489 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:24:26.707901   509 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.710635   474 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.720304   459 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.726994   458 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.728375   493 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.728691   459 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:26.729521 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.711071 31044 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:26.730160 30970 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:26.718945 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.731240 30971 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.714356 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.677695 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:26.731837 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 63837.5us
I20260709 12:24:26.732766   509 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.733417 30939 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:26.734277 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.734555   390 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.734879   509 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.735144   477 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.735536   477 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:26.736002   477 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.737373 30968 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:26.714797 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.738607 30976 raft_consensus.cc:2393] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:26.718971 31047 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:26.729657   419 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.731953 31616 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.740072   469 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:26.735440   499 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:26.701785 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 82117.6us
I20260709 12:24:26.743109 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.744619 31622 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:26.746593   465 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.747320 32736 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:26.747794 31624 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:26.748435   487 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:26.749022 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 124180us
I20260709 12:24:26.749584 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:26.750211 31047 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.701222 30974 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.757117 31050 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:26.716357 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.764516 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.765300 31623 raft_consensus.cc:2368] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:26.765630 31620 raft_consensus.cc:2368] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:26.766741 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.767283 30976 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.772606 30971 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
W20260709 12:24:26.775676 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 116071us
I20260709 12:24:26.776187 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.776757 30971 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.781071 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:26.775537 31588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.891s (SENT) [suppressed 84 similar messages]
I20260709 12:24:26.747781   458 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:26.781291 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 47107.6us
I20260709 12:24:26.716257 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.744580   499 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.715826 31619 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:26.786471 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.801092 30976 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:26.793305 30971 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:26.794425 30968 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:26.782707 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:26.803011 31044 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.807440 30971 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:26.806599 30867 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.810132 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:26.811441   390 consensus_queue.cc:1059] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.812462   390 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.812903   390 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.815009   361 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:26.815433   361 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:26.822265   361 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.823424   361 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.824215   480 raft_consensus.cc:3055] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:26.824626   480 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:26.825457   480 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.826611   480 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:26.827068   508 log.cc:927] Time spent T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:24:26.786335 32765 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:26.828752 32765 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:26.829080 32765 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:26.829855 32765 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.830896 32765 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.782240   509 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.832283   499 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.805967   504 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.832994   504 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:26.833359   504 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.833985 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:26.834733 31618 raft_consensus.cc:2368] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:26.832034   509 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.835948   465 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:26.836660 30974 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.832731 31615 raft_consensus.cc:2368] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
W20260709 12:24:26.819411   511 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
W20260709 12:24:26.841861 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 59242us
I20260709 12:24:26.842571 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:26.850119 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 43583.5us
I20260709 12:24:26.850862 30867 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:26.856140 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.837796 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.858706 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:26.861138   509 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.862782 31623 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:26.864035 31624 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:26.864979 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.866506   504 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.832690   499 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:26.868099   499 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:26.869045 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.869882 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.870512 31621 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.860976   390 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:26.873478 31016 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.874698   458 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.800426   474 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.875231   460 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.876228 31615 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:26.877262 31047 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:26.875346 32736 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:26.878482 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.875064   458 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.880040   458 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.881661   474 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.881949 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.882695 31620 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:26.875144 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.883504 31616 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:26.885951   477 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.886641 31621 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:26.887918   520 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.888389   520 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:26.888763   520 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.892536 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.893342 30900 raft_consensus.cc:2393] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:26.894014 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.894739 30896 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.875056 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:26.899624   471 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.900120 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:26.900708 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.901525 31044 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:26.901877 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.902554 30901 raft_consensus.cc:2368] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4.
I20260709 12:24:26.902786 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.903360 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:26.904188 30895 raft_consensus.cc:2393] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:26.905112   509 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.905479 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:26.905616   509 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:26.906339 31044 raft_consensus.cc:2410] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:26.906623   509 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.869824   500 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.909866   500 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.910823   499 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.913564   473 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.914634 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.916029 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:26.916314 31623 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:26.905050 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:26.920449   514 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:26.921221   514 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:26.922062 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 71263.9us
W20260709 12:24:26.922566 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 63403.5us
I20260709 12:24:26.875074 30974 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:26.924759 30864 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:26.925848   487 consensus_queue.cc:1059] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:26.926113   477 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.926644   513 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.927184   513 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:26.927030   471 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.901458 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.929121 30897 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.932391 32736 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:26.932781   487 raft_consensus.cc:3055] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:26.933454   487 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:26.934413   487 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.934739 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:26.935308 30968 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.935509   487 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.936167 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:26.936780 30971 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:26.941896 30968 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:26.880129   503 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.961797 30867 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:26.966768 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.975288 30901 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.967777 30898 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:26.968202 31016 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:26.968429 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:26.969709   499 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:26.972160 31617 raft_consensus.cc:2410] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:26.932296   513 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:26.983115 30896 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
W20260709 12:24:27.002826 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 213900us
I20260709 12:24:27.013929 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:27.014914 31621 raft_consensus.cc:2368] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3.
I20260709 12:24:26.942507 30897 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:26.967221   458 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:26.999857 32736 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.000363   514 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.064886 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:27.029656 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.085446 31615 raft_consensus.cc:2393] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:27.086534 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:27.087836 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.088569 31621 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:27.117470 31618 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:27.118220   520 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:27.061194 30901 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:27.004061   471 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
W20260709 12:24:27.172837 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.190589 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.195139 31624 raft_consensus.cc:2376] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4. Re-sending same reply.
W20260709 12:24:27.176692 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.198184 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:27.199062 31044 raft_consensus.cc:2410] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:27.190477 31014 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.201172 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:27.201676 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.202004 31046 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:27.201879   517 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.201311 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:27.202975 31042 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
W20260709 12:24:27.203305 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 211433us
I20260709 12:24:27.092604 30895 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:27.204213 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:27.205274 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:27.207379 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 263700us
I20260709 12:24:27.205977 31623 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 1.
I20260709 12:24:27.209455 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:27.209861 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.210144 31050 raft_consensus.cc:2368] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4.
I20260709 12:24:27.211578 30867 leader_election.cc:400] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5.
I20260709 12:24:27.211949 30867 leader_election.cc:403] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.209232 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:27.211129 31623 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:27.124570   473 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:27.214185 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.215200 31623 raft_consensus.cc:2393] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:27.216090 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:27.210110   465 consensus_queue.cc:1059] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:27.121969   458 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:27.215554 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.210733 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.148207 32736 raft_consensus.cc:697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:27.224591   480 raft_consensus.cc:2764] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:27.227411   503 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:27.225838 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.224947   390 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.225862   487 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5.
I20260709 12:24:27.230351 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.232102 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.233175 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.229296 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.231593 30867 leader_election.cc:400] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.236754 30867 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:27.237375 31615 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:27.239928   465 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.240094   504 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:27.240592   465 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.240701   504 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.241590 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.242722 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.243538 31618 raft_consensus.cc:2393] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:27.245091 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.248167 32765 consensus_queue.cc:1059] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:27.248512 32736 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.249387   480 raft_consensus.cc:3055] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:27.249735   480 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:27.250525   480 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.247480 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:27.222229 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.253756 31623 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:27.220912 31014 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.223984 31588 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.255378 30867 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.173790 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:27.252477 31618 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.255481 31588 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.255612 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.264519 31588 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.267798 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:27.275283 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 54454.3us
I20260709 12:24:27.299054 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.299525 31588 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.302230 31588 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.299393 30867 leader_election.cc:400] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.304513 30867 leader_election.cc:403] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.264212 31047 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.262271   363 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.263260   487 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.268978   361 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.315886 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:27.263509   473 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:27.310375 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3646447030000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 12:24:27.292968   461 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.314937 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:27.306249   504 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.315272 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:27.303581   514 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:27.316597 31014 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.271299   410 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.292361   517 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:27.262549 32765 consensus_queue.cc:1059] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:27.314711   520 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:27.328696 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:27.337920 31050 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:27.309258   510 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:27.324558 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3421447030000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 12:24:27.348270 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2566447029998926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 12:24:27.348587 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1009447030000956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:24:27.348855 30939 connection.cc:256] RPC call timeout handler was delayed by -1.0235447029999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
I20260709 12:24:27.316578 30895 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:27.350584 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.328464   514 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.337450 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:27.337450 32747 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.369594 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.347986   473 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.325201   487 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.349797   410 raft_consensus.cc:697] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:27.352499   517 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:27.382932 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.405645   520 raft_consensus.cc:2764] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 12:24:27.406476   526 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:24:27.408524   522 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:24:27.405555 30939 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.368794   514 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.372124   510 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:27.372258   499 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.421451 31624 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:24:27.427881 31624 pending_rounds.cc:85] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 4
I20260709 12:24:27.428159 31624 pending_rounds.cc:107] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:27.428386 31624 raft_consensus.cc:2889] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:27.429009 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.374612   465 raft_consensus.cc:3055] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:27.432375 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 219512us
I20260709 12:24:27.434747 31624 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:27.449581 31624 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:27.431459   473 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.432430   465 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:27.432215   503 raft_consensus.cc:2764] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:27.437299   509 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.431677   499 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:27.451846 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 152877us
I20260709 12:24:27.429713   361 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:27.487787 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.492580 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 193296us
I20260709 12:24:27.492318 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.433826   458 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:27.438963 32736 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:24:27.497567 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.498720 30867 leader_election.cc:400] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.499902 30867 leader_election.cc:403] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.455785 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:27.487170   491 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.487370   499 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.505915 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.506764 30968 raft_consensus.cc:2376] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3. Re-sending same reply.
W20260709 12:24:27.493950 30865 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.569s (SENT)
I20260709 12:24:27.507534 30976 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:27.457484   494 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:24:27.508117 30865 leader_election.cc:336] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.916s (SENT)
I20260709 12:24:27.513484 30865 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.496862   509 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:27.508489 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 79562.5us
I20260709 12:24:27.521238 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.509145 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.522209 30968 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:27.523653 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.509415 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.509770 30867 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.524405 30968 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:27.524672 30976 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:27.526048 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.526639 30970 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.526919 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.530046 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.530776 30968 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.507853   503 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.532620 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:27.536655 30973 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:27.536918   541 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:27.537614 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.501149   491 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.540307 30970 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:27.523906   509 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.541152 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.542809 30976 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:27.540705 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.543668 30974 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.545569 30968 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:27.545682 30865 leader_election.cc:336] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.952s (SENT)
I20260709 12:24:27.548309 30865 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.500068   517 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.538451   390 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:27.529587   533 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.549115 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:27.495980   410 consensus_queue.cc:237] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:27.554193   527 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:24:27.554806 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:27.555765   528 log.cc:927] Time spent T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:27.538389   465 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.547498   532 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.557482   520 raft_consensus.cc:2764] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:27.557793   491 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:27.558357   316 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.544505   509 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.551963   361 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.553063 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:27.553169 30970 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:27.582204 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.586089   533 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.586843   533 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:27.587208 31618 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:27.546675 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.544338   503 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:27.587836   316 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:27.595712   529 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:24:27.596999   530 log.cc:927] Time spent T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 12:24:27.593812 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 45551.8us
I20260709 12:24:27.604326 31588 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:27.604630 30968 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:24:27.608088 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 72086.9us
I20260709 12:24:27.522914   510 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.622630 30970 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.621448   491 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:27.626526   514 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.616096 30969 raft_consensus.cc:2393] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:27.629940   503 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:27.679067 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 425081us
W20260709 12:24:27.678979 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 129906us
I20260709 12:24:27.673170 30795 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53558 (request call id 354) took 4469 ms. Trace:
I20260709 12:24:27.681579 30976 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:27.681954 30867 leader_election.cc:400] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.682277 30867 leader_election.cc:403] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.682451   499 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.682833   513 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.683257 30867 leader_election.cc:400] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.683560 30867 leader_election.cc:403] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.683688 30973 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:27.679229 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 50851.7us
I20260709 12:24:27.689172 30974 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:27.592832   487 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:27.688405 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.712581 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:27.712800 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:27.713305 30974 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:27.714599 30867 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:27.715623 30968 raft_consensus.cc:1240] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.713304 30976 raft_consensus.cc:2376] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4. Re-sending same reply.
I20260709 12:24:27.717541 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:27.637404   491 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:27.719588 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:27.720069 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:27.720204 30974 raft_consensus.cc:2376] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5. Re-sending same reply.
I20260709 12:24:27.721244 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:27.723299 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:27.724812 30968 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:27.729009 30867 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.710603   504 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:27.678332 31047 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:27.743840 30867 leader_election.cc:400] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.744441 30976 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:27.711567   513 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.714033   480 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.765651 30867 leader_election.cc:400] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.766043 30867 leader_election.cc:403] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:27.767424 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 44216.3us
I20260709 12:24:27.767679 31588 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:27.768293 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.769788   550 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:27.725901   541 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.681186 30795 rpcz_store.cc:276] 0709 12:24:23.204209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.204560 (+   351us) service_pool.cc:224] Handling call
0709 12:24:27.673082 (+4468522us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:26.666125 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:26.692385 (+ 26260us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:26.692420 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:26.692437 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:26.692808 (+   371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:26.692860 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:26.692887 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:26.693164 (+   277us) tablet.cc:701] Row locks acquired
0709 12:24:26.693180 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:24:26.693307 (+   127us) write_op.cc:270] Start()
0709 12:24:26.693417 (+   110us) write_op.cc:276] Timestamp: P: 1783599866693269 usec, L: 0
0709 12:24:26.693437 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:24:26.694040 (+   603us) log.cc:844] Serialized 911 byte log entry
0709 12:24:27.153972 (+459932us) op_driver.cc:464] REPLICATION: finished
0709 12:24:27.382482 (+228510us) write_op.cc:301] APPLY: starting
0709 12:24:27.411298 (+ 28816us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:27.416143 (+  4845us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:27.416277 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:27.416637 (+   360us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:27.416809 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:27.416850 (+    41us) write_op.cc:312] APPLY: finished
0709 12:24:27.417043 (+   193us) log.cc:844] Serialized 29 byte log entry
0709 12:24:27.417218 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:27.417302 (+    84us) write_op.cc:454] Released schema lock
0709 12:24:27.417339 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:27.417666 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:27.417701 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":502608,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":215623,"apply.run_cpu_time_us":1825,"apply.run_wall_time_us":45568,"num_ops":2,"prepare.queue_time_us":242073,"prepare.run_cpu_time_us":2605,"prepare.run_wall_time_us":45069,"replication_time_us":460364,"thread_start_us":304006,"threads_started":2}]]}
I20260709 12:24:27.711627   361 consensus_queue.cc:1059] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:27.771184 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:27.771816 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.756240 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:27.710024   363 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:27.711905 32765 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:27.748574 30942 leader_election.cc:400] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3.
I20260709 12:24:27.735823   461 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:27.798688 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 50248.5us
W20260709 12:24:27.797400 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 118622us
I20260709 12:24:27.824884 30865 leader_election.cc:400] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 2 election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3.
W20260709 12:24:27.821799 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 56269.8us
I20260709 12:24:27.770761   316 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.756001   487 raft_consensus.cc:2764] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:27.824741 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:27.830188 30942 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:27.861367   504 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.861917 32765 raft_consensus.cc:3055] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:27.862972   461 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.797189   533 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:27.868722 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.797403   532 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:27.720248   491 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:27.903317 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.820114   554 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.886354 31622 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:27.915333 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.916203 31622 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:27.911298 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 81208.4us
W20260709 12:24:27.910733 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 150623us
I20260709 12:24:27.866518   541 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.917716 30942 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:27.869853   520 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:27.919550 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.871999 32765 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:27.914580   548 log.cc:927] Time spent T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:24:27.928515 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 160315us
I20260709 12:24:27.929829 30939 leader_election.cc:400] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4.
I20260709 12:24:27.930202 30939 leader_election.cc:403] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:27.919369   554 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:27.923086 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:27.909284   509 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.949604 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:27.950538 31623 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.941974   541 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.916922   532 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.939502   363 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.943234   554 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:27.946628   499 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:27.961027 30967 raft_consensus.cc:1240] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:27.956657   541 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:28.010244   543 log.cc:927] Time spent T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.226s	user 0.000s	sys 0.006s
I20260709 12:24:28.012203 30971 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.014727   465 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.016343   561 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.016949   561 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:28.018716   516 raft_consensus.cc:3055] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:28.019177   516 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:28.000074   513 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.020839   546 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:24:28.021030   513 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.023671   513 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:28.020100   516 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:27.969321   363 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:27.996783   541 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.041808 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:28.041826 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 112107us
I20260709 12:24:28.042757 30900 raft_consensus.cc:2393] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:28.021166   545 consensus_queue.cc:1059] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:24:28.046705 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.044080 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.045404 30939 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.045656 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.053277 30894 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.970826 32765 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.026414   556 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.054811 30939 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.056618 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:28.001585   557 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4.
I20260709 12:24:28.070308 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.072587 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.041002 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:28.072721 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:28.087540 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 48832.9us
I20260709 12:24:28.098383 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.099534 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.095634 30894 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:28.096217   516 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.096671 30898 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:28.073410 30893 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:28.101203 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.109086 30971 raft_consensus.cc:2368] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6.
I20260709 12:24:28.105965 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.070665   520 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.109826 30975 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:28.101971 30901 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:28.096980 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.099753   560 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:28.105360   540 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:24:28.072813   499 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:28.118352 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.068063   503 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:24:28.102236 32765 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:28.141295 30865 leader_election.cc:336] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.734s (SENT)
I20260709 12:24:28.115216 30897 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.112349 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.115599   557 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.125651 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:28.149672 31014 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.150697 30901 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:28.120301   499 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.122511   517 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:28.152401 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 211456us
I20260709 12:24:28.114317 32736 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:24:28.162776 30901 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:28.124351   520 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:28.163480 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.164317 30971 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:28.125370   567 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.126078   509 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:28.139987   316 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:28.170722 30865 leader_election.cc:336] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.116s (SENT)
I20260709 12:24:28.152109 30895 raft_consensus.cc:2393] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:28.304733 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.305313 30895 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.308115 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:28.310025 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:28.310781 31049 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:28.311950 31048 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:28.313099   547 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.313705   547 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.319993 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:28.320876 31047 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:28.235925   576 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:28.322105   576 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.322448   576 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.322914 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.323948   532 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:28.324689   562 log.cc:927] Time spent T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
I20260709 12:24:28.326225   561 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:28.174466   517 consensus_queue.cc:1059] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:24:28.327778   517 raft_consensus.cc:3055] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:28.328120   517 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:28.328526 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:28.328878   517 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.330102   517 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.330613 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.331383 30973 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:28.341212 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.341832 30976 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.309559 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:28.356695 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.160393 30892 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:28.233888 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:28.288280 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:28.246359   569 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:24:28.235966 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.370172 30971 raft_consensus.cc:2368] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:28.246950 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.206876 31616 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
W20260709 12:24:28.247527   552 log.cc:927] Time spent T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:24:28.259660 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.374147 30900 raft_consensus.cc:2368] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5.
I20260709 12:24:28.374941 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.375515 30900 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:28.245038 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.207981 30942 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:28.202207   573 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:28.204269   520 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.157505   499 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:28.244701   571 log.cc:927] Time spent T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:24:28.212280 31623 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:28.361382   480 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.161417   553 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:24:28.160864   390 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:28.261212 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:28.372437   567 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.242358   513 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.255000 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:28.256117 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 525) took 1047 ms. Trace:
I20260709 12:24:28.200867 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:28.160059   361 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.196996 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.418696 31042 raft_consensus.cc:2393] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:28.195786   565 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.300609 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.071164   556 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:28.419466 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:28.420166 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 249469us
I20260709 12:24:28.420827 30969 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.421295   556 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:28.302099 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:28.157594   557 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:28.422621 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 120662us
I20260709 12:24:28.422802 31046 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.423328 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:28.422622 30865 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.424284   557 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:28.424654 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:28.424916 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.425954 30939 leader_election.cc:400] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4.
I20260709 12:24:28.363301 30899 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:28.388010   390 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.426677 30939 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:28.365499 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 131683us
I20260709 12:24:28.366854 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:28.371191 30975 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:28.377660 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.377822 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:28.378611 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.379124 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.250147 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.432116 30896 raft_consensus.cc:2393] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:24:28.383157 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 175249us
I20260709 12:24:28.377128   503 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:28.244728 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.377329   573 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:28.406257 30976 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:28.421830   561 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:28.427690   509 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.433681 31622 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:28.433279 30973 raft_consensus.cc:2376] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3. Re-sending same reply.
I20260709 12:24:28.380148   560 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:28.435258 30971 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:28.421936 30969 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.415889 31615 rpcz_store.cc:276] 0709 12:24:27.208817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.303352 (+ 94535us) service_pool.cc:224] Handling call
0709 12:24:27.329449 (+ 26097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:27.369411 (+ 39962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.370549 (+  1138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:27.433267 (+ 62718us) log.cc:844] Serialized 26 byte log entry
0709 12:24:27.570834 (+137567us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:27.580543 (+  9709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.591228 (+ 10685us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:28.255511 (+664283us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b54006755a0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305a2dbe 00007f03305ad930 00007f03305ad8d8 00007f03305ad858 00007f03305ad813 00007f03305aca9c 00007f03364982f6 00007f0336492aa8 00007f03305e97cb 00007f03305ec2c0
0709 12:24:28.255762 (+   251us) raft_consensus.cc:1685] finished
0709 12:24:28.255777 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.256000 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19582,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":10018,"spinlock_wait_cycles":37529984,"thread_start_us":58566,"threads_started":1,"wal-append.queue_time_us":104047}
I20260709 12:24:28.457827   586 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.458665   586 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:28.459018   586 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.427891   316 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.425034   532 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.426687 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.468261 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.461642 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.474587 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.475751 30942 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.384518   480 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.477101 30900 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:28.445307   567 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:28.435232   503 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:28.485730 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 59114.7us
I20260709 12:24:28.486168 30900 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:28.486716 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:28.477170 30893 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:28.449565   557 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:28.459353   586 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.432909   361 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.489382 30896 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:28.489696 30900 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:28.490401 31587 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.490875   587 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.496237   580 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:28.463702 30895 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:28.430516   513 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.508319 30900 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:28.473704   547 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:28.549430 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.481602   509 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.551990 30893 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:28.470156 32736 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:28.488781   503 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:28.554517 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 68093us
I20260709 12:24:28.567446 30939 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.555428 30892 raft_consensus.cc:2393] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:28.511775   532 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.575510 31620 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.578673 30939 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.579775 30864 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:28.580663 30896 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:28.573697 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 83386us
W20260709 12:24:28.568388   465 consensus_meta.cc:287] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.003s
I20260709 12:24:28.585075 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.586439 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.586982   587 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:28.588441 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 112776us
I20260709 12:24:28.589212 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.565968   509 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.553247   556 consensus_queue.cc:1059] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:24:28.594821   510 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.576078 30969 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:28.600914 30865 leader_election.cc:336] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.794s (SENT)
I20260709 12:24:28.593556   590 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.559692   460 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:24:28.669009   587 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.669744   587 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.588066   547 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.499984   560 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.664893 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:28.676848 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 75965.7us
W20260709 12:24:28.677595 30865 leader_election.cc:336] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.152s (SENT)
I20260709 12:24:28.677991 30865 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.672860   567 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:28.584242   533 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.592584   516 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:28.585834   532 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:28.672051 32765 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.001s
W20260709 12:24:28.687752 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 110977us
W20260709 12:24:28.697836 30865 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.196s (SENT)
I20260709 12:24:28.698163 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:28.705202 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 111786us
I20260709 12:24:28.675823   510 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.698307 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.699126 31624 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:28.708714 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:28.680263   474 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.718914 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:28.677100   555 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:24:28.680065   563 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:28.721531 32765 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.696758 30895 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:28.723738   532 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:28.744385   361 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:28.745007   361 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:28.562485   573 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:28.746930   573 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.749671   576 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:28.707545   561 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:28.753492   554 consensus_meta.cc:287] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.778s	user 0.011s	sys 0.002s
I20260709 12:24:28.753921   554 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:28.754714 30799 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 4 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:28.755865 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:28.728246   474 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.758409 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:28.759281 31617 raft_consensus.cc:2410] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:28.759497 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:28.737749 32765 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:28.760898 31624 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:28.760666 32765 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.761871 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 537) took 1035 ms. Trace:
I20260709 12:24:28.762229 31620 rpcz_store.cc:276] 0709 12:24:27.726542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.726693 (+   151us) service_pool.cc:224] Handling call
0709 12:24:27.756931 (+ 30238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.584374 (+827443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.761670 (+177296us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b540054ef54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:28.761820 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882143488}
W20260709 12:24:28.763533   579 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.347s	user 0.006s	sys 0.000s
W20260709 12:24:28.740146   584 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:24:28.763805 30898 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:28.740969   591 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:24:28.696027   533 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:28.759537   541 consensus_meta.cc:287] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.001s
W20260709 12:24:28.768139 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 181766us
I20260709 12:24:28.739339 31587 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:28.766404 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.732121   555 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:28.786612 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.735163   390 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.770735 30799 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 2, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 2 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:28.767328 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 100389us
I20260709 12:24:28.719683   582 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:28.683506   516 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.730770   316 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:28.823803 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 44481us
W20260709 12:24:28.790189 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 50920.1us
W20260709 12:24:28.822696 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 233555us
I20260709 12:24:28.832665 30799 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:28.840404 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:28.840445 31587 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:28.758751   474 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:28.841596 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:28.843009 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:28.837946 31013 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:28.771641   545 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.843634 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:28.845818 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.846616 31046 raft_consensus.cc:3055] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:28.769956   480 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:28.725111   510 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.852029 30898 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:28.849578 31046 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:28.780380   555 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:28.844580 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:28.853821 31622 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:28.856777 30939 leader_election.cc:400] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5.
I20260709 12:24:28.857712 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.857105 30939 leader_election.cc:403] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:28.859655 30942 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:28.860467   520 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.852981   554 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:28.844403 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.868764   590 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5.
I20260709 12:24:28.869046   597 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.765483   533 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:28.869648   597 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.870244 30974 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:28.868799   596 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:28.871591   596 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:28.746876   499 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.839568   513 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:28.843649 30892 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.858454 31046 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.873370 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:28.850648 32736 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.853477   561 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.881102 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.883388 31046 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.860723   547 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.858377 30893 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:28.895895 30967 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:28.869390 30895 raft_consensus.cc:2410] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:28.855571   576 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:28.769451   541 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.853592 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:28.861967   480 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:28.862284   582 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.884785 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.862599   520 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:28.911316 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.900584 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.912345 30968 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.901254 30973 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:28.823025   563 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:24:28.899986   517 consensus_meta.cc:287] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.001s
I20260709 12:24:28.910513 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:28.921761 30893 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:28.906687 30974 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:28.878397 32765 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:24:28.924032 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:28.925164 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.925272   601 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.925166   593 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:28.925840 31623 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:28.926203 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:28.926656   608 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:28.927178   600 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:24:28.927374 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.923503   595 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:24:28.907570 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.929512 30969 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:28.929895 30968 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:28.910009   480 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:28.928833 30973 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:28.923502 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:28.879905   545 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:28.930436   480 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.955876   607 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.907922   554 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:28.928542   390 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:28.928543   593 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:28.896739 32736 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:29.000001 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 213472us
I20260709 12:24:28.956728   563 consensus_queue.cc:1243] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 9f38f761eded4f28b9d802f6570ee71e log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:24:28.986174   580 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:24:28.872522   596 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:28.988737   593 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.957804 32765 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:24:28.917757   555 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:29.018676 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 132087us
I20260709 12:24:29.014763   545 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:29.016911   390 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:29.003813 30865 leader_election.cc:336] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.183s (SENT)
I20260709 12:24:29.033469 30865 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:29.018417 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 153404us
I20260709 12:24:29.045724 30970 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:24:28.972841   607 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:29.048791   561 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:29.048892 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 45145.3us
I20260709 12:24:29.024204   516 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:29.061004 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:29.033044   316 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.033933   390 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:29.067440 30865 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:29.046111   554 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:29.058578   586 consensus_meta.cc:287] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.505s	user 0.003s	sys 0.007s
I20260709 12:24:29.078267 30865 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:29.081270 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:29.017879   520 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.068092   555 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.080839 30865 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:29.067535   499 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:29.059523 32765 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:24:29.068677   510 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:29.079595   550 raft_consensus.cc:3055] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:29.090065 30901 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:24:29.059906   473 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:24:29.079735   563 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:29.094827 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:29.092629 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:29.035354   545 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.083098   532 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:29.076839   516 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:24:29.068691   513 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:24:29.089506   541 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:29.076061   561 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:24:29.230404 30970 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
W20260709 12:24:29.196614 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 104281us
I20260709 12:24:29.078380   316 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:29.310102 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 472200us
I20260709 12:24:29.355764 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:29.091706   565 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.364565 31013 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:29.364372 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:29.081413   586 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.083369   554 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.092020   550 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:29.404953 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:29.410035 31044 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:29.409848 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:29.410570 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:29.416575 31049 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:29.413199 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:29.104979   597 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:29.287632   533 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:29.086444   567 consensus_queue.cc:1059] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.239s
I20260709 12:24:29.095532   595 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.285s
I20260709 12:24:29.095049   600 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:29.421370 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 57102.8us
W20260709 12:24:29.421212 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56756.1us
I20260709 12:24:29.325246   473 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.446806 30970 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:29.420077   582 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.477522 30970 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:29.450590   604 log.cc:927] Time spent T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.462s	user 0.001s	sys 0.003s
I20260709 12:24:29.441742   460 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:29.405304 32736 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:29.223420   390 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.488708 31042 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:29.489003   517 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:29.444058   615 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:29.490335   532 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:29.492892   316 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:29.495970   612 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.528519   612 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.530592   612 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:29.531421   611 log.cc:927] Time spent T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 12:24:29.420315   619 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 12:24:29.487913   471 raft_consensus.cc:3055] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:29.378832   513 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:29.483980   573 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.000s
I20260709 12:24:29.458083   533 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:29.526230 30892 consensus_meta.cc:287] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.000s
W20260709 12:24:29.528053   610 log.cc:927] Time spent T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
W20260709 12:24:29.502414 31587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.024s	sys 0.087s
I20260709 12:24:29.375686   480 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.473317   473 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.407783   565 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.515511   614 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:29.561751 31587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.024s	sys 0.087s
I20260709 12:24:29.539454   471 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:29.562562 30974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.020s	sys 0.018s
W20260709 12:24:29.549721   474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.025s	sys 0.025s
I20260709 12:24:29.571427   606 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:29.572669   473 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:29.573429 31051 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:29.539937   615 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:29.562747 30971 raft_consensus.cc:2410] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:29.545908   513 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:29.577351 30974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.020s	sys 0.018s
I20260709 12:24:29.560041   533 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:29.563140   390 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.498063   582 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:29.560817 30892 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
W20260709 12:24:29.578998   474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.026s	sys 0.026s
I20260709 12:24:29.475772   600 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.574699   607 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:29.584120 32765 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:29.619597 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 162854us
I20260709 12:24:29.582674   623 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.613402   473 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:29.610452   516 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.578586   614 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.536450   550 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.616057   606 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.021278 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.044374 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.055647 31050 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:29.616736   597 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.020974 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 374248us
I20260709 12:24:29.757164 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.063681 31049 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:29.636997   573 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.055847 30894 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:29.639333   510 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:29.807540 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:29.779114   613 log.cc:927] Time spent T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:24:30.073112 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 390) took 1963 ms. Trace:
W20260709 12:24:29.758172   621 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:24:29.900815   561 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.715981   532 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:29.663885   560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.012s
I20260709 12:24:30.073637 30894 rpcz_store.cc:276] 0709 12:24:28.102455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.107219 (+  4764us) service_pool.cc:224] Handling call
0709 12:24:30.044158 (+1936939us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b5800002798. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:30.065361 (+ 21203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16757632}
W20260709 12:24:30.067137 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 259687us
I20260709 12:24:29.839411 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:29.901003   586 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.090478 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:30.070976   363 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:29.645565   556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.000s	sys 0.014s
I20260709 12:24:29.638121   565 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:29.758003   612 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:29.784971   617 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:24:29.865127   605 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.755895   625 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:29.843786   582 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:29.864961   545 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:29.778985 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.070451   316 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:30.063032   516 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.091315 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1822) took 1033 ms. Trace:
I20260709 12:24:30.079941   628 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.780480   513 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:30.084692   560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.011s	sys 0.036s
I20260709 12:24:29.645692 32765 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.051151   541 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.072539   597 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.120086 30894 rpcz_store.cc:276] 0709 12:24:29.058098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.090216 (+1032118us) service_pool.cc:224] Handling call
0709 12:24:30.091254 (+  1038us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:30.096120   556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.017s	sys 0.031s
I20260709 12:24:30.064960   473 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:30.127578 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56584.7us
I20260709 12:24:30.128496   606 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.093072   554 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.077471   573 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.075181   510 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.085938   550 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:30.259974   541 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:30.194291   624 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:24:30.199159 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 348) took 1144 ms. Trace:
I20260709 12:24:30.272060 30970 rpcz_store.cc:276] 0709 12:24:29.054393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.479297 (+424904us) service_pool.cc:224] Handling call
0709 12:24:29.479566 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.638412 (+158846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.638445 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.652148 (+ 13703us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.068411 (+416263us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.068448 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.068516 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.198916 (+130400us) raft_consensus.cc:1685] finished
0709 12:24:30.198936 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.199089 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22586,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":10987,"thread_start_us":356653,"threads_started":2,"wal-append.queue_time_us":481694}
I20260709 12:24:30.273896 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:30.274479 30970 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:30.200587   614 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:30.202225   628 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:30.276186 30897 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:30.276648 30897 pending_rounds.cc:85] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 1
I20260709 12:24:30.276854   514 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.277619   628 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:29.946687   615 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:30.095752 30892 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.084425   561 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.222721   625 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:29.676941   471 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.062830   623 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.287056   625 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.287930   623 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:30.288590   600 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.117319   589 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.252754 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 160377us
W20260709 12:24:30.253024   503 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 1.673s	user 0.009s	sys 0.004s
W20260709 12:24:30.223389   593 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 1.201s	user 0.006s	sys 0.005s
I20260709 12:24:30.259163 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.293977 30894 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:30.117731   565 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 12:24:30.091881   532 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.224977   560 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.100894   612 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.120591   619 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 12:24:30.294868 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.295506 30894 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
W20260709 12:24:30.277805   549 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 2.505s	user 0.010s	sys 0.019s
I20260709 12:24:30.252203   632 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.289963 30864 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:30.289278   589 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.131969   605 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:30.303891   390 consensus_meta.cc:287] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.002s
I20260709 12:24:30.310963   573 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.290223   480 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.311496   605 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.311683   514 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:30.306483   628 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:24:30.313026   589 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.295707   503 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.301704   532 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:30.259690   555 consensus_meta.cc:287] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.173s	user 0.009s	sys 0.002s
I20260709 12:24:30.314051 30975 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:30.300139   560 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:30.296615   593 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.315927 31048 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:30.311461 30864 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:30.276885 30897 pending_rounds.cc:107] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:30.337824 30864 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:30.347905 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 50527.8us
I20260709 12:24:30.285355   561 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.353113 30892 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
W20260709 12:24:30.353591 30892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1821) took 1333 ms (client timeout 1605 ms). Trace:
I20260709 12:24:30.300868   516 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.290365   607 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:24:30.354229 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.347949 30897 raft_consensus.cc:2889] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:30.356238 30865 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.629s (SENT)
I20260709 12:24:30.304791 32765 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.356851   593 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.302573   612 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.336680   560 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.343791   639 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.357883 30892 rpcz_store.cc:269] 0709 12:24:29.020133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.728847 (+708714us) service_pool.cc:224] Handling call
0709 12:24:30.353526 (+624679us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.303041   473 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:30.307783   533 consensus_meta.cc:287] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.002s
I20260709 12:24:30.294190   513 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:30.301888   597 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.376600 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.315562   503 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.369532   619 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:24:30.377948   510 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.378603 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1816) took 2112 ms. Trace:
I20260709 12:24:30.378993   363 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:30.379352 31616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 769) took 1876 ms (client timeout 2150 ms). Trace:
I20260709 12:24:30.350497   316 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:30.388547 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.389020 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:30.384690   600 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.350461   514 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:24:30.400484 30898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1819) took 1615 ms (client timeout 2098 ms). Trace:
I20260709 12:24:30.390375   605 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:30.382344   639 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.393678 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:30.393891 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.411119 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.382608   560 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.411448 31042 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
I20260709 12:24:30.411892   605 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.412073   560 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.413441 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1881) took 1001 ms. Trace:
I20260709 12:24:30.387028   504 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:30.396898 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.312422   632 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:30.385602   516 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.400915 30898 rpcz_store.cc:269] 0709 12:24:28.785272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.785445 (+   173us) service_pool.cc:224] Handling call
0709 12:24:30.400312 (+1614867us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b54003eadd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:30.400425 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5853568}
I20260709 12:24:30.370517 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 543) took 1996 ms. Trace:
I20260709 12:24:30.392477   390 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.416308 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.389593 32765 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.413789 31051 rpcz_store.cc:276] 0709 12:24:29.411790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.412924 (+  1134us) service_pool.cc:224] Handling call
0709 12:24:30.413294 (+1000370us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000f46d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:30.413391 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358592384}
I20260709 12:24:30.390707   589 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.394639   510 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:30.387769   533 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:30.459596 30898 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
W20260709 12:24:30.629968 31622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 772) took 1788 ms (client timeout 2229 ms). Trace:
I20260709 12:24:30.392840 30897 rpcz_store.cc:276] 0709 12:24:28.265880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.091074 (+1825194us) service_pool.cc:224] Handling call
0709 12:24:30.255007 (+163933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.378292 (+123285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.378539 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.694773 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1818) took 1912 ms. Trace:
I20260709 12:24:30.515679 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:30.417423 30892 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:30.526906 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:30.750142 30968 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:30.751431 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.695271 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1525) took 2212 ms. Trace:
W20260709 12:24:30.627947 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 63849.7us
I20260709 12:24:30.522312   593 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.722409   514 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.692929 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 351) took 1360 ms. Trace:
I20260709 12:24:30.649976   605 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.639079   597 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:30.742245 30971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 1896) took 1803 ms (client timeout 1629 ms). Trace:
W20260709 12:24:30.626605   494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.046s	user 0.017s	sys 0.009s
I20260709 12:24:30.677664   465 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.517270   632 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.643906 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.769640   465 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.401918   316 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.770609   316 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.771795   465 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:30.773646 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1875) took 1527 ms. Trace:
I20260709 12:24:30.774036 31047 rpcz_store.cc:276] 0709 12:24:29.246134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.325112 (+ 78978us) service_pool.cc:224] Handling call
0709 12:24:30.772901 (+1447789us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:30.773116 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.773308 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.773336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.773382 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:30.773414 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.773469 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.773590 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15023360}
I20260709 12:24:30.776748 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:30.777439 30972 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:30.778256   316 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.753520 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.778776 30865 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:30.748891 30901 rpcz_store.cc:276] 0709 12:24:28.782247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.782368 (+   121us) service_pool.cc:224] Handling call
0709 12:24:28.788805 (+  6437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.092281 (+303476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.694499 (+1602218us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54003ed0d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:30.694690 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692238720}
I20260709 12:24:30.779847 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.752944 32765 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.780292   632 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:30.780519 30901 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:30.780753   632 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:30.781168   632 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.620299   612 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.761206 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.413911   600 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.801590 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:30.752821   589 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.414280   541 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:30.764030 30971 rpcz_store.cc:269] 0709 12:24:28.919009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.920154 (+  1145us) service_pool.cc:224] Handling call
0709 12:24:30.702163 (+1782009us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400021f54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:30.722314 (+ 20151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461960448}
I20260709 12:24:30.457127   390 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.766897 31051 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:30.819260 30898 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:30.418622   504 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.694190   560 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.514808 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:30.736336 31622 rpcz_store.cc:269] 0709 12:24:28.841206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.841330 (+   124us) service_pool.cc:224] Handling call
0709 12:24:30.629769 (+1788439us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5400107054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:30.629902 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26594176}
I20260709 12:24:30.751348 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:30.753139   510 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.782145 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1823) took 1719 ms. Trace:
W20260709 12:24:30.769076   494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.190s	user 0.018s	sys 0.009s
I20260709 12:24:30.839612 30893 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:30.825693   503 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.778435 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:30.803325 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 277954us
I20260709 12:24:30.780566 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:30.764166   596 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:30.848239   596 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:30.396358 31616 rpcz_store.cc:269] 0709 12:24:28.503365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.715890 (+212525us) service_pool.cc:224] Handling call
0709 12:24:30.379153 (+1663263us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b5400282154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:30.379293 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201481600}
I20260709 12:24:30.851038   316 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.851405   596 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.852952 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:30.825508   499 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.763816 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 237001us
I20260709 12:24:30.758710 30970 rpcz_store.cc:276] 0709 12:24:29.332662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.275194 (+942532us) service_pool.cc:224] Handling call
0709 12:24:30.275487 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.290988 (+ 15501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.291022 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.294703 (+  3681us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.392441 (+ 97738us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.392480 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.392542 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.692662 (+300120us) raft_consensus.cc:1685] finished
0709 12:24:30.692686 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.692858 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15168,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":2664,"thread_start_us":30215,"threads_started":1,"wal-append.queue_time_us":157071}
I20260709 12:24:30.856456 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:30.857203 30970 raft_consensus.cc:2393] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:30.766965   555 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.829172 31044 raft_consensus.cc:1240] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:30.829166 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:30.831384 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:30.751907 30896 rpcz_store.cc:276] 0709 12:24:28.482815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.502677 (+ 19862us) service_pool.cc:224] Handling call
0709 12:24:28.580328 (+ 77651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:28.581132 (+   804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.695062 (+2113930us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b54003ec6d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:30.695196 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41124096}
I20260709 12:24:30.802433   605 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:30.831975 31623 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:30.832701 30899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 384) took 2788 ms (client timeout 3291 ms). Trace:
I20260709 12:24:30.457063   516 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.818197   554 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.834195 30901 rpcz_store.cc:276] 0709 12:24:29.062897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.781368 (+1718471us) service_pool.cc:224] Handling call
0709 12:24:30.781695 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.781863 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.781887 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.781929 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.781961 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.782010 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.782096 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:30.836709 30900 raft_consensus.cc:3055] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:30.838076   589 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.803181   612 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.768999   597 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.826910   541 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:30.826283 32765 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:30.764241   514 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.856691 31013 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:30.765524   593 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.860002 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:30.861238 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:30.836781   533 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:30.862736 30899 rpcz_store.cc:269] 0709 12:24:28.044754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.044852 (+    98us) service_pool.cc:224] Handling call
0709 12:24:30.832537 (+2787685us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003ee4d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:30.832645 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525553536}
I20260709 12:24:30.864853 30900 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:30.839234 30895 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.872449 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:30.915043 31014 leader_election.cc:336] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.639s (SENT)
I20260709 12:24:31.146816 31014 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:30.858266 30972 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
W20260709 12:24:30.866036   609 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 1.880s	user 0.000s	sys 0.018s
I20260709 12:24:31.121496 31051 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.024472   473 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.043380 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 162169us
W20260709 12:24:31.123692 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 267050us
I20260709 12:24:31.139428   560 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:31.145088 30864 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:31.136920 30900 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:31.037904   513 consensus_meta.cc:287] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.648s	user 0.003s	sys 0.006s
I20260709 12:24:30.863616   499 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:30.983311   554 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.214548 31051 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:30.983170   316 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.121645 30970 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:31.174471 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 259480us
I20260709 12:24:30.858987   503 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.192250 31013 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:30.983843   596 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.202051 30900 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.262096 31050 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:31.146155   474 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.199921   560 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.156128 30901 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:31.193979   458 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:31.224035 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.271044 31587 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:30.873036   605 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:31.226926 31048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1876) took 1910 ms (client timeout 2150 ms). Trace:
W20260709 12:24:31.272835 31048 rpcz_store.cc:269] 0709 12:24:29.316069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.356856 (+ 40787us) service_pool.cc:224] Handling call
0709 12:24:31.224570 (+1867714us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54002a5654. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:31.226744 (+  2174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067255552}
I20260709 12:24:31.169370 30968 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:31.233177 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1496) took 2348 ms. Trace:
I20260709 12:24:31.274351 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1503) took 1814 ms. Trace:
W20260709 12:24:31.264189 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 72033.4us
I20260709 12:24:31.274869 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.275293 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:31.265044 30972 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:31.274088 30974 rpcz_store.cc:276] 0709 12:24:28.885217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.964739 (+ 79522us) service_pool.cc:224] Handling call
0709 12:24:28.965100 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.015681 (+ 50581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.015711 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.018210 (+  2499us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.611110 (+592900us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:29.611155 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.232726 (+1621571us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b540040fbd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:31.232775 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.232821 (+    46us) raft_consensus.cc:1685] finished
0709 12:24:31.232834 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.233091 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5094,"raft.queue_time_us":11333,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2484,"spinlock_wait_cycles":80470144,"thread_start_us":575568,"threads_started":1,"wal-append.queue_time_us":630144}
I20260709 12:24:31.279704 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1504) took 1634 ms. Trace:
I20260709 12:24:31.280122 30972 rpcz_store.cc:276] 0709 12:24:29.644882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.202707 (+1557825us) service_pool.cc:224] Handling call
0709 12:24:31.212115 (+  9408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.279422 (+ 67307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.279628 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.280661   620 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.281129   620 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.281522   620 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:31.287765 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.290702 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:31.274889 30968 rpcz_store.cc:276] 0709 12:24:29.459777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.168842 (+1709065us) service_pool.cc:224] Handling call
0709 12:24:31.169192 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.274103 (+104911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.274298 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.198324   473 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.310705 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.311477 30901 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:31.151676   541 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.296448 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:31.300050 30974 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:31.353058 30900 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:31.364362   514 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.364207   597 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.268980   596 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.359956   513 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.365856   612 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.273350   642 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.361537   605 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.363157   499 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.358641   560 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:30.417575 31618 rpcz_store.cc:276] 0709 12:24:28.372708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.488143 (+115435us) service_pool.cc:224] Handling call
0709 12:24:29.575513 (+1087370us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:29.584050 (+  8537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.624698 (+ 40648us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:30.096687 (+471989us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.335909 (+239222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.335995 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:30.348414 (+ 12419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.353530 (+  5116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.369354 (+ 15824us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":551807,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1413,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":91201920,"thread_start_us":499362,"threads_started":2,"wal-append.queue_time_us":252121}
I20260709 12:24:31.351667 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.281565 30972 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:31.374818 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1505) took 1729 ms. Trace:
I20260709 12:24:31.268821   474 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.375053 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 393) took 2525 ms. Trace:
I20260709 12:24:31.376849 30970 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:31.403954 30968 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:31.404151 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.382694   656 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.403298 30974 rpcz_store.cc:276] 0709 12:24:29.645514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.279995 (+1634481us) service_pool.cc:224] Handling call
0709 12:24:31.280295 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.374573 (+ 94278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.374751 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.404882 30970 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:31.382853 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 86497.4us
I20260709 12:24:31.374091 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1495) took 2489 ms. Trace:
I20260709 12:24:31.386634 32765 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.386947   600 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.379690   465 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.389106   513 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:31.389509   536 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:24:31.260411   316 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:31.408228 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 263230us
I20260709 12:24:31.408598 30865 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:31.389489   642 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:31.409508 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 175560us
I20260709 12:24:31.391950   622 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.389312   514 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.410871 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:31.405812 30967 rpcz_store.cc:276] 0709 12:24:28.884938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.932490 (+ 47552us) service_pool.cc:224] Handling call
0709 12:24:28.932782 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:28.949004 (+ 16222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.949032 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:28.949442 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.399908 (+1450466us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b48002001d8. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0335556aa1 00007f033554db37 00007f033554d9ca 00007f033564526f 00007f0335644f37 00007f033565955c 00007f0335659508 00007f0335659488 00007f0335659443 00007f03356586ec 00007f0334582a96
0709 12:24:30.639511 (+239603us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b18003ea520. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:24:30.826428 (+186917us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.826473 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.826541 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.373886 (+547345us) raft_consensus.cc:1685] finished
0709 12:24:31.373904 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.374034 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34848,"raft.queue_time_us":16058,"raft.run_cpu_time_us":23039,"raft.run_wall_time_us":1442488,"spinlock_wait_cycles":29154944,"thread_start_us":186715,"threads_started":1,"wal-append.queue_time_us":2267006}
I20260709 12:24:31.408097 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.403530 30900 rpcz_store.cc:276] 0709 12:24:28.849789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.849991 (+   202us) service_pool.cc:224] Handling call
0709 12:24:28.850310 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.836617 (+1986307us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400289220. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305a4dc0 00007f033062f1c0 00007f0330630231 00007f033062cd8f 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c
0709 12:24:31.374805 (+538188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.374997 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367601920}
I20260709 12:24:31.395607   612 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.440034 30970 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 1.
I20260709 12:24:31.440342 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:31.440912 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:31.441497 30970 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.408941 32765 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.430018 30864 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:31.397609   605 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.435482 30865 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:31.436275 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:31.412927   390 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.418376 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:31.407032   474 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.414636   465 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.455915 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:31.458104 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:31.460826 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.462136 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.462707 30900 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:31.427321   600 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.435684 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1898) took 1380 ms. Trace:
I20260709 12:24:31.426869   513 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.435520   642 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.461035 30901 raft_consensus.cc:2376] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5. Re-sending same reply.
I20260709 12:24:31.466347 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:31.476375 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:31.487603 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.487941 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:31.488706 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:31.502065 31049 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
W20260709 12:24:31.489179   654 log.cc:927] Time spent T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:24:31.489737   653 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:24:31.466348   605 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.514431 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.514657 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1886) took 1111 ms. Trace:
I20260709 12:24:31.486415   461 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.515292   605 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.515576   461 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.464473 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.515995   461 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.516208 30967 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:31.491907 30972 rpcz_store.cc:276] 0709 12:24:30.055348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.280957 (+1225609us) service_pool.cc:224] Handling call
0709 12:24:31.281392 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.406963 (+125571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.430233 (+ 23270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.517098 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.517752 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1508) took 1419 ms. Trace:
I20260709 12:24:31.488739   659 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.518565 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1509) took 1257 ms. Trace:
I20260709 12:24:31.518924 30967 rpcz_store.cc:276] 0709 12:24:30.261032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.517878 (+1256846us) service_pool.cc:224] Handling call
0709 12:24:31.518141 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.518295 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.518317 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.518355 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.518384 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.518433 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.518519 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.459762 30970 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:31.491473   593 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.502395 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.434501   622 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.523006 30973 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:31.406805   560 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:24:31.505110 30900 raft_consensus.cc:2376] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3. Re-sending same reply.
I20260709 12:24:31.532403 30970 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:24:31.532835 30970 pending_rounds.cc:85] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 1
I20260709 12:24:31.533044 30970 pending_rounds.cc:107] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:24:31.533267 30970 raft_consensus.cc:2889] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:31.505388 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.505638 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.506629 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:31.456485 32765 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.507884 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.508708 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.509318 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.413101   656 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.493041 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.554464 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.502379   491 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.515049 31045 rpcz_store.cc:276] 0709 12:24:30.403677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.411246 (+  7569us) service_pool.cc:224] Handling call
0709 12:24:30.411577 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.735614 (+324037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.735651 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.744302 (+  8651us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.832098 (+ 87796us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:30.832134 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.832208 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.514452 (+682244us) raft_consensus.cc:1685] finished
0709 12:24:31.514470 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.514603 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6607,"raft.queue_time_us":328616,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":151,"thread_start_us":87436,"threads_started":1,"wal-append.queue_time_us":414422}
I20260709 12:24:31.487272   503 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.495949   390 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.467761   465 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:31.540751 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 86586.3us
I20260709 12:24:31.541169 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:31.541702   499 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:31.544533   636 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 1.499s	user 0.000s	sys 0.015s
I20260709 12:24:31.545745 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.520345 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.502549   597 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.453295   612 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.454264   514 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.518110 30972 rpcz_store.cc:276] 0709 12:24:30.098871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.516994 (+1418123us) service_pool.cc:224] Handling call
0709 12:24:31.517283 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.517446 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.517473 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.517516 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.517559 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.517613 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.517707 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.538524   622 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.620287 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.523675 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:31.515130 30969 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:31.536032   661 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.625404 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.627056 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:31.554436   536 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.502579   600 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.640305 31051 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:31.637008 31044 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:31.633283   597 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.641564 32735 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:24:31.641523   671 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:31.642143 31043 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:31.642549   555 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:31.657394 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 396) took 2805 ms. Trace:
I20260709 12:24:31.659227 30894 rpcz_store.cc:276] 0709 12:24:28.852258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.317291 (+1465033us) service_pool.cc:224] Handling call
0709 12:24:30.317568 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.317846 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.317873 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.348028 (+ 30155us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.781674 (+433646us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b18000c05e0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:24:30.863670 (+ 81996us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.863714 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.863803 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.649052 (+785249us) raft_consensus.cc:1685] finished
0709 12:24:31.649076 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.657329 (+  8253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":3479,"spinlock_wait_cycles":9028352,"thread_start_us":81804,"threads_started":1,"wal-append.queue_time_us":908323}
I20260709 12:24:31.661149 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.661780 30894 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:31.545270   663 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.651538 30900 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:31.653465   597 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.627449   605 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:31.626030   458 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:31.620639   491 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.518949   659 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.621543   390 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:31.633168   516 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:31.622347 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 81260.8us
W20260709 12:24:31.663475 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 228050us
I20260709 12:24:31.632319   554 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.629465   499 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:31.632320   565 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.632575   669 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:31.642213   656 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.667022 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.667713 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 350) took 2351 ms. Trace:
I20260709 12:24:31.643797   473 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:31.662596 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 161549us
I20260709 12:24:31.650224   541 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.671424 31047 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:31.675268   458 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.727581 30969 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:31.728017   672 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:31.728530   672 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:31.730108 30895 consensus_meta.cc:287] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.538s	user 0.004s	sys 0.004s
I20260709 12:24:31.730472   672 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:31.731024   672 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:31.732209   677 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:31.733843   600 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.671885   596 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:31.728308   458 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.736465 31617 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:31.737232   499 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.738286 32765 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.738934 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:31.669994 31618 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:31.739550 31624 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:31.691326 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:31.665661   663 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.709787   605 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:31.741003   663 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.741501   605 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.664312   536 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.742854   536 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.724677 31587 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:31.745169 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:31.747196 31587 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:31.740512 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:31.668305   597 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.552659   660 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.710595   390 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.737563 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:31.730443 30895 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:31.760522 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1531) took 1389 ms. Trace:
I20260709 12:24:31.653407 30972 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:31.740381 32765 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:31.723953 30901 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:31.747958 31624 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:31.723429 30976 rpcz_store.cc:276] 0709 12:24:29.316029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.620040 (+304011us) service_pool.cc:224] Handling call
0709 12:24:29.620371 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.637093 (+ 16722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.637118 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.640540 (+  3422us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.045195 (+404655us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.045234 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.045304 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.543932 (+1498628us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:31.655510 (+111578us) raft_consensus.cc:1685] finished
0709 12:24:31.655533 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.667639 (+ 12106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8982400,"thread_start_us":262906,"threads_started":1,"wal-append.queue_time_us":325693}
I20260709 12:24:31.740590 31620 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:31.754417 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 63185.3us
I20260709 12:24:31.757992 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.765542 30894 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:31.766476 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.716014   516 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.760869 30895 rpcz_store.cc:276] 0709 12:24:30.371336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.514494 (+143158us) service_pool.cc:224] Handling call
0709 12:24:31.760454 (+1245960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:31.775040 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.784590 30976 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:31.772018 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:31.776605 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:31.786381 30894 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:31.667802   661 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.782280 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.731417   672 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.801954 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1535) took 1429 ms. Trace:
I20260709 12:24:31.804368 30899 rpcz_store.cc:276] 0709 12:24:30.372439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.157992 (+785553us) service_pool.cc:224] Handling call
0709 12:24:31.158318 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.414633 (+256315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.414661 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.415112 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.544253 (+129141us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:31.668605 (+124352us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.801573 (+132968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.801660 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.801710 (+    50us) raft_consensus.cc:1685] finished
0709 12:24:31.801722 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.801881 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8230,"prepare.queue_time_us":182321,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":197229,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":23338,"thread_start_us":570327,"threads_started":4,"wal-append.queue_time_us":107246}
I20260709 12:24:31.756283   660 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.762914   533 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.754513   316 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:31.724867   565 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:31.848819 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 182024us
I20260709 12:24:31.771355 31617 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:31.761286   597 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.772027   673 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.787457 32765 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:31.859211 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 147707us
I20260709 12:24:31.850039   669 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:31.770578   461 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.780723   620 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:31.938573 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.929425 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1532) took 1557 ms. Trace:
I20260709 12:24:31.928155 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 397) took 1543 ms. Trace:
I20260709 12:24:31.785352   516 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:31.814563   473 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:24:31.822950   590 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.823227   658 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:24:31.816452   660 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:31.943229 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.020704 31050 rpcz_store.cc:276] 0709 12:24:30.384915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.399191 (+ 14276us) service_pool.cc:224] Handling call
0709 12:24:31.224678 (+825487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.262524 (+ 37846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.927936 (+665412us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54002a5650. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:31.928093 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897623808}
I20260709 12:24:32.023869 30865 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:31.932312 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.026005 30899 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
W20260709 12:24:31.868105 30939 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.777s (SENT) [suppressed 29 similar messages]
W20260709 12:24:32.028203 31016 connection.cc:256] RPC call timeout handler was delayed by -1.2331544620005843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
I20260709 12:24:31.862532 30894 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:32.020243 30898 rpcz_store.cc:276] 0709 12:24:30.371619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.753249 (+381630us) service_pool.cc:224] Handling call
0709 12:24:31.929255 (+1176006us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b540014afd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:31.929376 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91624320}
I20260709 12:24:32.029714 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.030295 30898 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:31.928282   667 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 12:24:32.028916 31016 connection.cc:256] RPC call timeout handler was delayed by -1.0350756190005086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
I20260709 12:24:32.036449 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.037616 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:32.027498 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 159428us
I20260709 12:24:31.923991   565 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:31.985199   666 log.cc:927] Time spent T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 12:24:32.016912 31617 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:31.856796 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:31.858821 32765 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.862017   316 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.068722 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1513) took 1205 ms. Trace:
I20260709 12:24:31.892839   458 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.892730   541 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:31.892510   596 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.108512 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.077243 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.120955 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.114913 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:32.114642 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:31.823767   533 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:31.984251   680 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.120121 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.126181 31622 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.122061 30899 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:32.033545   683 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.123257 30894 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:32.124172 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.130287 30974 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:32.127054 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.131958 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.133002 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.108547   656 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.128418 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.033799   612 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.031177   517 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.134932 30898 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:32.135412   517 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.134931 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.137462 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.137859   517 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.138576 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.039976   555 consensus_queue.cc:1059] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:24:32.143088   517 raft_consensus.cc:3055] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:32.143505   517 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:32.144345   517 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.145529 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.031306 32735 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.146512 30969 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:32.146641 32735 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.148147   659 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.107239 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.133903 31622 raft_consensus.cc:2410] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:32.150224 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1494) took 3265 ms. Trace:
I20260709 12:24:32.134449 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.151347 30974 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:32.150888 30973 rpcz_store.cc:276] 0709 12:24:28.884697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.931219 (+ 46522us) service_pool.cc:224] Handling call
0709 12:24:28.931761 (+   542us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:28.948272 (+ 16511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.948298 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:28.951401 (+  3103us) log.cc:844] Serialized 566 byte log entry
0709 12:24:31.233739 (+2282338us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b1800444e80. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:24:31.522884 (+289145us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.821696 (+298812us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.821954 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.822027 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.149942 (+327915us) raft_consensus.cc:1685] finished
0709 12:24:32.150034 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.150169 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15967,"raft.queue_time_us":18282,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":39109,"spinlock_wait_cycles":12713344,"thread_start_us":271817,"threads_started":1,"wal-append.queue_time_us":2713777}
I20260709 12:24:32.038643   361 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.117835 32765 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.156939 30894 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:32.073998   672 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.147536 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:32.149127 32735 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.159220 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.161068 30894 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:32.161758 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.161938 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.162424 30899 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:32.162739 30894 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:32.164528 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.032058   590 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.165098 31622 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:32.129782   683 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.173899 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.122831   316 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.176061   316 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.177110 30898 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:32.177937   600 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:32.153591   361 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:32.178735 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 64793.1us
I20260709 12:24:32.179171 31622 raft_consensus.cc:2410] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:32.180943 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.106340   465 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.129123   596 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.126191   541 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.188402 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:32.188292   516 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.154685   458 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.179661   683 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:32.182480 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 146306us
I20260709 12:24:32.198869   639 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.199424   689 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:32.203655 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.203922   597 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.205255 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:32.207386   363 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.208305   620 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.180593   361 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:32.211159   513 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.002s
I20260709 12:24:32.213172   465 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.214102 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:32.215377   622 consensus_meta.cc:287] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.000s
I20260709 12:24:32.152141   680 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.181736   600 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:32.218389 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:32.293285 31046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1880) took 2920 ms (client timeout 2749 ms). Trace:
I20260709 12:24:32.182992   658 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.236019 30976 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:32.184206   461 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.255812 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1534) took 1883 ms. Trace:
I20260709 12:24:32.262086 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.271359 30974 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:32.279590 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.288973 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 160654us
W20260709 12:24:32.293721 31046 rpcz_store.cc:269] 0709 12:24:29.372826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.375210 (+  2384us) service_pool.cc:224] Handling call
0709 12:24:32.218255 (+2843045us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:32.293211 (+ 74956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67502336}
I20260709 12:24:32.296671 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:32.302003 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.302631 30973 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:32.303510 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.304142 30973 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:32.307602 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.273433   363 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.166045   669 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.298292 30896 rpcz_store.cc:276] 0709 12:24:30.372176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.024080 (+651904us) service_pool.cc:224] Handling call
0709 12:24:31.157902 (+133822us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.158259 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.158286 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.190465 (+ 32179us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.523667 (+333202us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.669164 (+145497us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.926156 (+256992us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b180008f200. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f0330625060 00007f0330637716 00007f0330648287 00007f0330648208
0709 12:24:32.028489 (+102333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.028559 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.219905 (+191346us) raft_consensus.cc:1685] finished
0709 12:24:32.255562 (+ 35657us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.255751 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202719,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":151321,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":84035,"spinlock_wait_cycles":33263360,"thread_start_us":494647,"threads_started":3,"wal-append.queue_time_us":464300}
I20260709 12:24:32.274516   661 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.280794   581 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:32.331089 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.305023 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.332074 30896 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:32.335928 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:32.336563 30896 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:32.338271 31014 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:32.338685 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:32.310155   316 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.337358 31013 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:32.339269 30896 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.255630   663 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.346966 30972 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:32.349572   510 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.281418   513 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:32.339443   390 consensus_meta.cc:287] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.002s
I20260709 12:24:32.333225   619 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:32.298580   694 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:24:32.293303   622 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:32.366397 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 149715us
I20260709 12:24:32.368181 31588 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:32.368995   516 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:32.369426   516 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:32.369848   516 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.372280 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1540) took 1998 ms. Trace:
I20260709 12:24:32.274197   689 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.373867 31588 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:32.372714 30900 rpcz_store.cc:276] 0709 12:24:30.373616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.200652 (+1827036us) service_pool.cc:224] Handling call
0709 12:24:32.200922 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.201118 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:32.201440 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.371899 (+170459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.371950 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:32.372004 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.372078 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.372226 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":83,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":104,"spinlock_wait_cycles":4864,"thread_start_us":169813,"threads_started":1,"wal-append.queue_time_us":170123}
I20260709 12:24:32.355787   316 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.366920   390 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:32.364017   642 consensus_meta.cc:287] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.843s	user 0.005s	sys 0.004s
I20260709 12:24:32.364575   601 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.378645   680 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.380178 30895 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:32.380208 31588 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:32.433837 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 53706.8us
W20260709 12:24:32.434283   674 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.400s	user 0.003s	sys 0.000s
I20260709 12:24:32.435425 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1897) took 2918 ms. Trace:
I20260709 12:24:32.309484   658 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.382309   639 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:32.336524   581 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.382740   458 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.382791   316 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.362624   700 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:32.384671   390 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.384157   642 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:32.422801 31587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.027s	sys 0.090s
W20260709 12:24:32.462632 31587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.027s	sys 0.090s
W20260709 12:24:32.462960 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 715773us
I20260709 12:24:32.424860   554 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:32.425267   622 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.424885   516 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.383886 31624 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:32.435084 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:32.393743 31622 raft_consensus.cc:2393] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:32.435844 30971 rpcz_store.cc:276] 0709 12:24:29.516806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.174070 (+1657264us) service_pool.cc:224] Handling call
0709 12:24:31.192505 (+ 18435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.515591 (+323086us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b1800110f20. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f03301d54bc 00007f032d52348b 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f0330625060 00007f0330625bfb 00007f033063064b
0709 12:24:31.515710 (+   119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.515757 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.516231 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.760563 (+244332us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:31.760612 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.760681 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.433963 (+673282us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b24002b2f68. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d3c69c4 00007f032d3c4acb 00007f032d57fdc9 00007f032d57fa55 00007f032d57f09d 00007f03301b110e 00007f03301c888c 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221
0709 12:24:32.435224 (+  1261us) raft_consensus.cc:1685] finished
0709 12:24:32.435244 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.435370 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202939,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4235,"spinlock_wait_cycles":22033536,"thread_start_us":442901,"threads_started":2,"wal-append.queue_time_us":343262}
W20260709 12:24:32.366559   474 consensus_meta.cc:287] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.005s
I20260709 12:24:32.479908   474 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.276772   660 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.482194   660 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.387502 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.483029 31620 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.483800 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.484809 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.485301 31620 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:32.487884 30899 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:32.440107 30896 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:32.441021 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 163886us
I20260709 12:24:32.367835   619 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:32.374172   563 raft_consensus.cc:3055] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:32.389213   510 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:32.490371   619 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.443486 31615 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:32.448660   663 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.448968   513 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.435647   687 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:24:32.492816   687 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.493317   687 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.450516   596 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.451290   504 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.453809   361 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.496982   361 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.456617   316 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:32.497763   316 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.456333 32765 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.500336   474 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.501449 32765 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.458385   581 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.501819   619 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.502635   581 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:32.503703 31617 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.458586   533 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.459456 30864 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:32.438925   601 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.504552   601 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.505581   687 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.506187   533 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:32.506662   533 raft_consensus.cc:697] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:32.440693   632 consensus_meta.cc:287] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 1.659s	user 0.006s	sys 0.011s
I20260709 12:24:32.507469   533 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.507982   632 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:32.504621 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 45246.9us
I20260709 12:24:32.440443   465 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.510057   465 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.510399   465 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.490463   563 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:32.512511   563 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.513599   563 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:32.478796 31048 raft_consensus.cc:2393] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:32.373700   541 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.503865   619 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.513796 30892 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:32.360526   600 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:32.525482 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 46153.3us
I20260709 12:24:32.527977 31587 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:32.526117   363 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.530714   363 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.532914 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1541) took 2159 ms. Trace:
I20260709 12:24:32.533361 30900 rpcz_store.cc:276] 0709 12:24:30.373834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.384931 (+2011097us) service_pool.cc:224] Handling call
0709 12:24:32.385293 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:32.385717 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.385745 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:32.386268 (+   523us) log.cc:844] Serialized 52 byte log entry
0709 12:24:32.469246 (+ 82978us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:32.469289 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.469363 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.532707 (+ 63344us) raft_consensus.cc:1685] finished
0709 12:24:32.532725 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.532858 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8881,"raft.queue_time_us":89,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":44901,"threads_started":1,"wal-append.queue_time_us":45268}
I20260709 12:24:32.528719   597 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:24:32.535271   465 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.524291   554 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.541754   465 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.546932   554 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.524048   642 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.547843   517 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.551013 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.551692 30969 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:32.552927   516 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.555872 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 546) took 2164 ms. Trace:
I20260709 12:24:32.522387   601 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.556245 31621 rpcz_store.cc:276] 0709 12:24:30.391640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.391779 (+   139us) service_pool.cc:224] Handling call
0709 12:24:30.396653 (+  4874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.847005 (+450352us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:30.862250 (+ 15245us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.373107 (+510857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.373197 (+    90us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.373237 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.554575 (+1181338us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b18003d3d20. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d50e2a6 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419
0709 12:24:32.555591 (+  1016us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54004d0154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:32.555638 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.555790 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74269,"prepare.queue_time_us":17805,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":74539,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12878,"spinlock_wait_cycles":1050968320,"thread_start_us":436063,"threads_started":1,"wal-append.queue_time_us":570331,"wal-append.run_cpu_time_us":1213,"wal-append.run_wall_time_us":1057546}
I20260709 12:24:32.558773   601 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.559384   554 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:32.560842 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 126552us
W20260709 12:24:32.568797 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 133753us
I20260709 12:24:32.577530 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.604972 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:32.606489 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 78598.5us
W20260709 12:24:32.613607 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 52024us
I20260709 12:24:32.614373 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.615300 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:32.616971 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:32.617578 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.617981 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.618832 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.620364 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.621537 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.618554 30974 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:32.626359 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.627396 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:32.627897 30973 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.616590 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:32.629729 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.630839 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:32.640933 31620 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.641722 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.643539 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:32.644414 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 154467us
I20260709 12:24:32.621954   622 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.674903 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:32.688364 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:32.688709 31016 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:32.689079 31620 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.684782 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1888) took 4432 ms. Trace:
I20260709 12:24:32.628641   596 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:24:32.689527 30975 rpcz_store.cc:276] 0709 12:24:28.248682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.435643 (+186961us) service_pool.cc:224] Handling call
0709 12:24:28.461087 (+ 25444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.314557 (+1853470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.680750 (+2366193us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b540016bcd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:32.680921 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4261013248}
I20260709 12:24:32.630849   619 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:24:32.535521   390 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:24:32.687319 30971 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.629424   687 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.604359   554 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.692063 31044 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:32.692808 30973 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:32.642758 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.701494   687 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.698707 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.706254   687 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.695366 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.642081   465 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:32.676770   504 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:24:32.694365   361 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:32.706192 30969 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:32.726246   642 consensus_queue.cc:1059] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:32.726565 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:32.699608 30900 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:32.707144 31621 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.728441 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.708328 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.693614   590 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.690267   622 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.733057   622 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.704988 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:32.736227   658 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.736850 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.737453 30973 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
W20260709 12:24:32.738092   655 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 1.322s	user 0.006s	sys 0.007s
I20260709 12:24:32.739109 30969 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.703583   683 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:32.740001 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.740731 31619 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.741117 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 617) took 1272 ms. Trace:
I20260709 12:24:32.741524   683 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.741417 31619 rpcz_store.cc:276] 0709 12:24:31.469077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.486239 (+ 17162us) service_pool.cc:224] Handling call
0709 12:24:32.739888 (+1253649us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508eee 000000000036eb39 00007f033557c1e0 00007f03356450c4 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:32.741060 (+  1172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33192704}
I20260709 12:24:32.742347 30894 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:32.708264 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.698838   705 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.732458 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.729310   361 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.729055 32735 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:32.742655 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:32.743315 31621 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.743642 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1832) took 1391 ms. Trace:
I20260709 12:24:32.749656 30894 rpcz_store.cc:276] 0709 12:24:31.352089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.180701 (+828612us) service_pool.cc:224] Handling call
0709 12:24:32.743450 (+562749us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54003eb2d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:32.743589 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288638208}
I20260709 12:24:32.744761   361 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.752038 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1837) took 1313 ms. Trace:
I20260709 12:24:32.742877   705 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.744689 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:32.742861 30975 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:32.757099   705 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.756150 30901 rpcz_store.cc:276] 0709 12:24:31.438501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.505336 (+ 66835us) service_pool.cc:224] Handling call
0709 12:24:32.751898 (+1246562us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54003eadd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:32.751988 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433395584}
I20260709 12:24:32.777438 30971 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:32.796743 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.746680   673 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.748106 32735 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:32.805462 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:32.807905 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.808573 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.810465 31049 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:32.810042 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 115009us
I20260709 12:24:32.811456 30971 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.811666 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:32.812376 31049 raft_consensus.cc:2368] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:32.811004 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:32.816148 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:32.797024   707 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.799849   620 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.823007 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:32.821815 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:32.822420 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:32.825429 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.804487   673 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.826854 31044 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:32.811301 32735 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:32.827085 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:32.848147 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.849458 31050 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:32.849993 30971 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:32.852535 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:32.853325 31050 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.820688   682 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:32.855500   682 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:32.856788   711 log.cc:927] Time spent T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.131s	user 0.003s	sys 0.000s
I20260709 12:24:32.822616   699 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.824797 32765 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:32.864980 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.825933   620 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.878715 30896 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:32.880191 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1547) took 2489 ms. Trace:
I20260709 12:24:32.880571 30896 rpcz_store.cc:276] 0709 12:24:30.391149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.878191 (+2487042us) service_pool.cc:224] Handling call
0709 12:24:32.878521 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.879904 (+  1383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.880121 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.838761   390 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:32.842235 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.882519 30896 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:32.883112 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1548) took 2480 ms. Trace:
I20260709 12:24:32.842870   517 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:32.830145 30969 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:32.886392 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:32.887054 31044 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.883428 30896 rpcz_store.cc:276] 0709 12:24:30.402863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.881544 (+2478681us) service_pool.cc:224] Handling call
0709 12:24:32.882325 (+   781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.882891 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.883065 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.882028   390 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.888875 30896 raft_consensus.cc:1240] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:32.889467 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1549) took 2479 ms. Trace:
I20260709 12:24:32.889770 30896 rpcz_store.cc:276] 0709 12:24:30.409795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.888382 (+2478587us) service_pool.cc:224] Handling call
0709 12:24:32.888678 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.889230 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.889407 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:32.892006 31016 connection.cc:256] RPC call timeout handler was delayed by -1.0251153830004114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3291s for a response
I20260709 12:24:32.883304   620 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:32.894109 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 67073.1us
I20260709 12:24:32.901451   361 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.880671   699 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:32.837776   707 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.890837   390 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.909639 31587 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:32.923411 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.926116 31587 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:32.927824 31621 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 2: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.927604 31587 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:32.923400 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.929751 31046 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:32.930464 30896 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:32.930681 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.931041 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1824) took 1701 ms. Trace:
I20260709 12:24:32.931699 31046 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:32.885941   517 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.933386 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:32.931389 30896 rpcz_store.cc:276] 0709 12:24:31.229262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.929838 (+1700576us) service_pool.cc:224] Handling call
0709 12:24:32.930153 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.930818 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.930991 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.933121 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:32.935840   516 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.937284   516 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:32.937721   516 raft_consensus.cc:697] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:32.938650   516 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.941777 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.942400 31045 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:32.923645 32765 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:32.908988   699 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.946659 31587 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:32.933703 31619 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:32.953697   714 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.954277 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.956423   517 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.957093   707 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:32.927103   554 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:32.959018 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:32.928635   689 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:32.114679 30967 rpcz_store.cc:276] 0709 12:24:30.863147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.522289 (+659142us) service_pool.cc:224] Handling call
0709 12:24:31.522554 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.523193 (+   639us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:31.841196 (+318003us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.068331 (+227135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.068387 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:32.068436 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.068507 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.068648 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":497722,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":1683,"raft.queue_time_us":8827,"spinlock_wait_cycles":85669760,"thread_start_us":498765,"threads_started":2}
I20260709 12:24:32.989850 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.990455 30967 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:32.961287   622 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:32.964943 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.965771 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:32.967094 31044 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:32.968122 31050 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
W20260709 12:24:32.957871   678 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.849s	user 0.000s	sys 0.002s
I20260709 12:24:32.973408 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:32.975459 30896 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:32.977617 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.932276   672 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:33.002209   698 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.007562 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1825) took 1778 ms. Trace:
I20260709 12:24:33.007908 30896 rpcz_store.cc:276] 0709 12:24:31.229534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.972064 (+1742530us) service_pool.cc:224] Handling call
0709 12:24:32.973494 (+  1430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.003441 (+ 29947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.007507 (+  4066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.000120   554 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.008602 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 555) took 1272 ms. Trace:
I20260709 12:24:33.008795   554 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.004033 30942 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:33.005256 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:33.005736 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.010674 31587 leader_election.cc:400] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:32.983261 32765 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:33.010973 31587 leader_election.cc:403] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:33.010973 31050 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.011452 30942 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:33.018237 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.019234   596 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.019807 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.020027   596 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.007061 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.012406 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.022508 31044 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.009068 31618 rpcz_store.cc:276] 0709 12:24:31.736614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.740282 (+  3668us) service_pool.cc:224] Handling call
0709 12:24:32.958866 (+1218584us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:33.008521 (+ 49655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33020800}
I20260709 12:24:33.022967 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:33.013643   554 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.028581 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:33.032866   541 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:33.033274   541 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:33.015877 32765 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.034008 32765 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.034379 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:33.034965 31618 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.036485 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 397) took 3458 ms. Trace:
W20260709 12:24:33.020190   719 log.cc:927] Time spent T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:24:33.005923   672 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.066447 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1828) took 1836 ms. Trace:
I20260709 12:24:33.067181 30896 rpcz_store.cc:276] 0709 12:24:31.230234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.023496 (+1793262us) service_pool.cc:224] Handling call
0709 12:24:33.065872 (+ 42376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.066122 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.066150 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.066187 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:33.066221 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.066276 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.066390 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.004932   390 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.079468 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.080709 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:32.981642   714 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.089275 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.026943   689 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.022866   461 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:33.095111 30973 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.080399   672 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.099498 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.108327 30896 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:33.111227 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 82692us
I20260709 12:24:33.034039   541 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.120330 31587 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:33.125664 31050 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:33.121058   723 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:33.133751   723 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.134135   723 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.136058   714 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:33.136186   541 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.140308   622 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.141029   622 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:33.141490   622 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:33.142315   622 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.107096   683 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.145838   683 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.053822 30897 rpcz_store.cc:276] 0709 12:24:29.577988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.802053 (+1224065us) service_pool.cc:224] Handling call
0709 12:24:30.860166 (+ 58113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.412182 (+552016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.414318 (+  2136us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.500790 (+ 86472us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.813371 (+312581us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.815126 (+  1755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.840811 (+ 25685us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.957594 (+1116783us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b2400135e78. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d3c69c4 00007f032d3c4acb 00007f032d57fdc9 00007f032d57fa55 00007f032d57f09d 00007f03301b110e 00007f03301c888c 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221
0709 12:24:33.021267 (+ 63673us) raft_consensus.cc:1685] finished
0709 12:24:33.021288 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.026844 (+  5556us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120826,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":24738,"spinlock_wait_cycles":34302336,"thread_start_us":385456,"threads_started":2,"wal-append.queue_time_us":307257}
I20260709 12:24:33.100835   471 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.109045   461 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:33.147466 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.150789 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:33.151333   514 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.158368 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.159533 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.122241 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1845) took 1409 ms. Trace:
I20260709 12:24:33.183310 30896 rpcz_store.cc:276] 0709 12:24:31.712770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.096716 (+1383946us) service_pool.cc:224] Handling call
0709 12:24:33.108008 (+ 11292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.121970 (+ 13962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.122182 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.150851   461 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:33.185775 30942 leader_election.cc:336] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.658s (SENT)
I20260709 12:24:33.186381 30939 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.151515 30897 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:33.188063 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.186918 30942 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:33.194211 30942 leader_election.cc:336] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.667s (SENT)
I20260709 12:24:33.139614   687 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.194655 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:33.198774 31044 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:33.200203 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.202374 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.158034   514 consensus_queue.cc:1059] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:24:33.201903 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 81662us
I20260709 12:24:33.205090 31587 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:33.205247 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:33.206001 30896 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.190032   683 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.192062   554 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:33.188023 32765 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.195689   663 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.197125   390 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.220170 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 549) took 1502 ms. Trace:
I20260709 12:24:33.220695 31615 rpcz_store.cc:276] 0709 12:24:31.717389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.719940 (+  2551us) service_pool.cc:224] Handling call
0709 12:24:31.764548 (+ 44608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.491231 (+726683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.219836 (+728605us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54005e33d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:33.220092 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524218752}
I20260709 12:24:33.204042   596 raft_consensus.cc:2764] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:33.201335   734 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:33.227295 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.232981 31044 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:33.201752   726 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:33.213177   554 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:33.242018 30939 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.220599   736 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:33.244127 31623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 548) took 2845 ms (client timeout 2124 ms). Trace:
W20260709 12:24:33.249245 31623 rpcz_store.cc:269] 0709 12:24:30.393196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.393366 (+   170us) service_pool.cc:224] Handling call
0709 12:24:33.238742 (+2845376us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b540071cad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.238857 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972324992}
I20260709 12:24:33.250391 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.251504 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:33.255055 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.236340   663 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.235596 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:33.256776 31016 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:33.244638   724 log.cc:927] Time spent T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:24:33.263438 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 69251.7us
W20260709 12:24:33.264608 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.245376   554 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.236739   726 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:33.265192 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.246404   734 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:33.255642 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.267036 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.222324 32735 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.232475   673 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.297005 30893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 395) took 4442 ms. Trace:
W20260709 12:24:33.262533   728 log.cc:927] Time spent T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:24:33.293234 31044 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:33.267563   596 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:33.301020 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.301259 30942 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:33.297425 30893 rpcz_store.cc:276] 0709 12:24:28.851656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.938408 (+ 86752us) service_pool.cc:224] Handling call
0709 12:24:30.832677 (+1894269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.840047 (+  7370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.294068 (+2454021us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54003ee4d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.294179 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4341521792}
I20260709 12:24:33.266645   460 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.248840   714 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:33.267191 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.302172 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:33.305109   673 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.306813   683 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:33.325506   683 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:33.308036 30895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 406) took 1630 ms (client timeout 1794 ms). Trace:
W20260709 12:24:33.327301 30895 rpcz_store.cc:269] 0709 12:24:31.677915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.781973 (+104058us) service_pool.cc:224] Handling call
0709 12:24:33.307856 (+1525883us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b5400195354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.307978 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347307776}
I20260709 12:24:33.328368 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:32.536221   565 consensus_queue.cc:1175] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f868402d5ae640e7b362b9fddacbaf44" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:33.309921 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.310492   596 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:33.334996 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 90826.7us
I20260709 12:24:33.311014 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:33.312812 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.336432 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.273970   663 raft_consensus.cc:2764] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:33.318205 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.269834 30897 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:33.339928 31046 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:33.340319 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.340816 30897 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:33.341284 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 411) took 1623 ms. Trace:
I20260709 12:24:33.271945   726 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.341501 30897 rpcz_store.cc:276] 0709 12:24:31.717714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.340200 (+1622486us) service_pool.cc:224] Handling call
0709 12:24:33.340489 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.341102 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.341241 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.338863 30895 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:24:33.324582   733 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:24:33.324786 30942 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:33.320358   741 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:24:33.263561   699 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.311434 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1537) took 2938 ms. Trace:
I20260709 12:24:33.351943 30899 rpcz_store.cc:276] 0709 12:24:30.372934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.179972 (+1807038us) service_pool.cc:224] Handling call
0709 12:24:32.191865 (+ 11893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.488267 (+296402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.311171 (+822904us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003edad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:33.311369 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680403328}
I20260709 12:24:33.353291   699 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.353622 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1551) took 1611 ms. Trace:
I20260709 12:24:33.339845   663 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.354125   656 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:33.354563   656 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.353962 30899 rpcz_store.cc:276] 0709 12:24:31.742103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.352832 (+1610729us) service_pool.cc:224] Handling call
0709 12:24:33.353170 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.353329 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.353353 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.353390 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:33.353419 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.353472 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.353568 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.336898 30893 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.337383 31016 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:33.342749 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1846) took 1625 ms. Trace:
I20260709 12:24:33.357206 30895 rpcz_store.cc:276] 0709 12:24:31.717714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.338497 (+1620783us) service_pool.cc:224] Handling call
0709 12:24:33.338719 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.342514 (+  3795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.342698 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.359180   555 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.360845   689 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:33.363090   461 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.366706   619 raft_consensus.cc:3055] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:33.367147   619 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:33.368153 32765 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:33.328202   680 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:33.336534 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.340773 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.321467 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.367444   698 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.373311 31620 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.344667 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.350849   672 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.323634 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1507) took 3264 ms. Trace:
I20260709 12:24:33.337680   596 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.370841 30899 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:33.395757 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1552) took 1653 ms. Trace:
I20260709 12:24:33.396095 30899 rpcz_store.cc:276] 0709 12:24:31.742334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.356343 (+1614009us) service_pool.cc:224] Handling call
0709 12:24:33.370535 (+ 14192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.395501 (+ 24966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.395685 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.368005   619 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.374804 31046 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:33.375428 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 50729.3us
I20260709 12:24:33.383631 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.326406   683 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.393190 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1545) took 3017 ms. Trace:
I20260709 12:24:33.392760 30968 rpcz_store.cc:276] 0709 12:24:30.059001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.292350 (+1233349us) service_pool.cc:224] Handling call
0709 12:24:31.403674 (+111324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.404368 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.323500 (+1919132us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400245250. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.323592 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254859136}
I20260709 12:24:33.394184 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:33.405918 30967 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.411376 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.377373   741 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:33.372056   680 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:33.402817 30894 rpcz_store.cc:276] 0709 12:24:30.375783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.750525 (+2374742us) service_pool.cc:224] Handling call
0709 12:24:32.750876 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.751233 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.751259 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:32.752246 (+   987us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.884964 (+132718us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:32.970914 (+ 85950us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.971493 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.971607 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.392966 (+421359us) raft_consensus.cc:1685] finished
0709 12:24:33.392985 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.393129 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22386,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1631,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":41690,"thread_start_us":196342,"threads_started":2,"wal-append.queue_time_us":254916}
I20260709 12:24:33.414507 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.419008 31044 raft_consensus.cc:2376] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6. Re-sending same reply.
I20260709 12:24:33.419929 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.420485 31044 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.415172 31621 raft_consensus.cc:2368] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4.
I20260709 12:24:33.424750 30894 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.424995 30968 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.425318 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1556) took 1206 ms. Trace:
I20260709 12:24:33.425683 30894 rpcz_store.cc:276] 0709 12:24:32.219106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.424282 (+1205176us) service_pool.cc:224] Handling call
0709 12:24:33.424582 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.425109 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.425265 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.415804 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:33.393321   699 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.428714   699 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.430681   699 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.412051   499 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:33.428247 30894 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:33.403657   687 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.433171 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1557) took 1213 ms. Trace:
I20260709 12:24:33.433710 30967 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:33.433902   735 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:33.438663 30893 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:33.445104 30894 rpcz_store.cc:276] 0709 12:24:32.219322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.426442 (+1207120us) service_pool.cc:224] Handling call
0709 12:24:33.427975 (+  1533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.432896 (+  4921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.433118 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.385090   740 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:24:33.412058   491 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.387496   656 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.452133   656 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.412245   742 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.458530 31051 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:33.459159   639 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.459600   639 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.463696 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1544) took 3089 ms. Trace:
I20260709 12:24:33.464041 30900 rpcz_store.cc:276] 0709 12:24:30.374523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.537205 (+2162682us) service_pool.cc:224] Handling call
0709 12:24:32.537558 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.727619 (+190061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.463446 (+735827us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000320d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:33.463641 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372010752}
I20260709 12:24:33.456015 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:33.466851   705 consensus_meta.cc:287] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.709s	user 0.000s	sys 0.014s
I20260709 12:24:33.467981 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:33.468161 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.469292 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.469817 31046 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:33.470582 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.474646   672 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.424373   619 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.447808 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1550) took 1704 ms. Trace:
I20260709 12:24:33.479456 30897 rpcz_store.cc:276] 0709 12:24:31.741858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.342516 (+1600658us) service_pool.cc:224] Handling call
0709 12:24:33.385656 (+ 43140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.402336 (+ 16680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.411980 (+  9644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.416548 (+  4568us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:33.418359 (+  1811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.426919 (+  8560us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.446049 (+ 19130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.376417   734 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.423489 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:33.433102 31618 raft_consensus.cc:2410] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:33.439020   723 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.447279 30899 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.444983 32735 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.417155   741 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:33.507984   741 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.444505   499 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.401324   620 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.471525 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.467303   705 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.427220   461 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.505369 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1553) took 1287 ms. Trace:
W20260709 12:24:33.505904 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 119376us
I20260709 12:24:33.506789 31044 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:33.403084   726 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.446161 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1514) took 2310 ms. Trace:
I20260709 12:24:33.510313 31046 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:33.511183 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:33.503942 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 167567us
I20260709 12:24:33.501884   683 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.518045 30970 rpcz_store.cc:276] 0709 12:24:31.135675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.534420 (+398745us) service_pool.cc:224] Handling call
0709 12:24:31.534693 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.553610 (+ 18917us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:31.553643 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.557920 (+  4277us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.329214 (+1771294us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b1800354400. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:24:33.404696 (+ 75482us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:33.404733 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.404800 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.426978 (+ 22178us) raft_consensus.cc:1685] finished
0709 12:24:33.426995 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.445744 (+ 18749us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4702,"raft.queue_time_us":5008,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8245,"spinlock_wait_cycles":29446528,"thread_start_us":65756,"threads_started":1,"wal-append.queue_time_us":1863482}
I20260709 12:24:33.520131 31623 raft_consensus.cc:2410] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:33.519390 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.515070 30894 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:33.511060 30895 rpcz_store.cc:276] 0709 12:24:32.218246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.358052 (+1139806us) service_pool.cc:224] Handling call
0709 12:24:33.358355 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.358687 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.358715 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.359183 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.446601 (+ 87418us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:33.446640 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.446721 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.446759 (+    38us) raft_consensus.cc:1685] finished
0709 12:24:33.446769 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.505304 (+ 58535us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":344,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":87043,"threads_started":1,"wal-append.queue_time_us":60289}
I20260709 12:24:33.522359 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.523774 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.524132 31049 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:33.525687 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.525954 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.527683 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.528244 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.529104 30973 raft_consensus.cc:2410] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:33.644315 30968 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.644790 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.645216 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:33.645864 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:33.644341 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.646849 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.648056 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:33.520726 31616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 614) took 2051 ms (client timeout 1667 ms). Trace:
I20260709 12:24:33.526995 31615 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.660646 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.646245 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:33.661509 30968 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.651564 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.649963 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.664129 31623 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:33.665377 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:33.678550 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.662396 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:33.663424 30939 connection.cc:256] RPC call timeout handler was delayed by -1.586633066000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:24:33.526249   656 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:33.524628   745 raft_consensus.cc:2764] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:33.681355 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.682040 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.526204 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:33.684537 30939 connection.cc:256] RPC call timeout handler was delayed by -1.4878771690000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:24:33.744336 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1840) took 2279 ms. Trace:
I20260709 12:24:33.679211 30975 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:33.715536 31623 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:33.745941 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 630) took 1058 ms. Trace:
I20260709 12:24:33.746241 31623 rpcz_store.cc:276] 0709 12:24:32.687461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.681106 (+993645us) service_pool.cc:224] Handling call
0709 12:24:33.745886 (+ 64780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.747573 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.749022 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:33.745041 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3861316319998878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2503s for a response
I20260709 12:24:33.745177 30898 rpcz_store.cc:276] 0709 12:24:31.465156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.138357 (+673201us) service_pool.cc:224] Handling call
0709 12:24:33.744153 (+1605796us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b54003ee4d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.744276 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87080832}
I20260709 12:24:33.524981   740 consensus_queue.cc:1059] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.158s
W20260709 12:24:33.751515 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.774111 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.776135 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.783922 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 553) took 2048 ms. Trace:
I20260709 12:24:33.786437 30939 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:33.791821 31624 rpcz_store.cc:276] 0709 12:24:31.735954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.768947 (+ 32993us) service_pool.cc:224] Handling call
0709 12:24:33.783758 (+2014811us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b5400107054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.783864 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375945600}
I20260709 12:24:33.796478 30968 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:33.794322 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:33.798785 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 191359us
I20260709 12:24:33.802956 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:33.744953   677 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:33.804253   590 raft_consensus.cc:3055] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:33.804621 31045 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:24:33.778863   639 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.805524   620 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.805974 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.806219 31047 pending_rounds.cc:85] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 4
I20260709 12:24:33.783383   361 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.806545 31047 pending_rounds.cc:107] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:33.806844 31047 raft_consensus.cc:2889] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:33.806854   663 raft_consensus.cc:2764] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:33.807964 31624 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:33.808194   514 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.808835 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.808663   514 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.809481 31624 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.809842 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 792) took 1224 ms. Trace:
I20260709 12:24:33.810114 31624 rpcz_store.cc:276] 0709 12:24:32.585494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.808610 (+1223116us) service_pool.cc:224] Handling call
0709 12:24:33.809794 (+  1184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.811002 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.812322   663 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:33.816728 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 414) took 1010 ms. Trace:
I20260709 12:24:33.816825 31624 raft_consensus.cc:2393] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.817821   596 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.804523   677 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.818953 30967 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:33.819784   590 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:33.819914   677 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.817552 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:33.811378   514 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.820178 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 794) took 1234 ms. Trace:
I20260709 12:24:33.821529 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:33.820983 31624 rpcz_store.cc:276] 0709 12:24:32.585925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.810737 (+1224812us) service_pool.cc:224] Handling call
0709 12:24:33.820041 (+  9304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.804863 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.817090 31051 rpcz_store.cc:276] 0709 12:24:32.805833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.807665 (+  1832us) service_pool.cc:224] Handling call
0709 12:24:33.816565 (+1008900us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400158bd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.816674 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491095296}
I20260709 12:24:33.824985 31623 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.825663 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:33.826670 30942 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.098s (SENT)
W20260709 12:24:33.827942 30942 leader_election.cc:336] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.212s (SENT)
I20260709 12:24:33.828338 30942 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:33.810352   554 consensus_meta.cc:287] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.000s
I20260709 12:24:33.714562   658 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.832211 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.836517 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:33.836796 31051 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.837138 30967 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:33.827064 30865 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.834856 31046 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:33.835594 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.833467 31044 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:33.838550 30865 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:33.792559   541 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:33.844342 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 627) took 1159 ms. Trace:
I20260709 12:24:33.844738 31624 rpcz_store.cc:276] 0709 12:24:32.685416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.831760 (+1146344us) service_pool.cc:224] Handling call
0709 12:24:33.844283 (+ 12523us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:33.650689 31616 rpcz_store.cc:269] 0709 12:24:31.468256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.486196 (+ 17940us) service_pool.cc:224] Handling call
0709 12:24:33.413447 (+1927251us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:33.519573 (+106126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24326912}
I20260709 12:24:33.839912 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 400) took 4256 ms. Trace:
I20260709 12:24:33.848688 30892 rpcz_store.cc:276] 0709 12:24:29.583795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.843598 (+1259803us) service_pool.cc:224] Handling call
0709 12:24:30.843975 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.514804 (+1670829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.839663 (+1324859us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400195d54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:33.839842 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3839875328}
I20260709 12:24:33.831327   460 raft_consensus.cc:2764] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:33.808779 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 622) took 1169 ms. Trace:
I20260709 12:24:33.840919   514 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:33.840502   677 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:33.837750   745 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:33.857573 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.851557 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.860066 31624 raft_consensus.cc:2410] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:33.823100   596 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.835141   739 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:24:33.854735   514 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.852336   541 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.867146 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:33.856132   745 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:33.868502 30939 leader_election.cc:336] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 2.068s (SENT)
I20260709 12:24:33.751621   656 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:33.839613   554 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.863478 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 639) took 1079 ms. Trace:
I20260709 12:24:33.875795 31624 rpcz_store.cc:276] 0709 12:24:32.784586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.845347 (+1060761us) service_pool.cc:224] Handling call
0709 12:24:33.863422 (+ 18075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.871155 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 1914) took 1052 ms. Trace:
I20260709 12:24:33.871428 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.881491 31623 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.881103 31044 rpcz_store.cc:276] 0709 12:24:32.818324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.790038 (+971714us) service_pool.cc:224] Handling call
0709 12:24:33.832881 (+ 42843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.870898 (+ 38017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.871090 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.881966 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 636) took 1120 ms. Trace:
I20260709 12:24:33.882301 31623 rpcz_store.cc:276] 0709 12:24:32.761850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.860405 (+1098555us) service_pool.cc:224] Handling call
0709 12:24:33.881900 (+ 21495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.883189 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:33.863595   677 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:33.869035   514 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.831525   590 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.880322 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.868808 30892 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.885911 31623 raft_consensus.cc:2393] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:33.859398   742 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.869357   658 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:33.887250 31622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 779) took 1968 ms (client timeout 2546 ms). Trace:
I20260709 12:24:33.853299 31619 rpcz_store.cc:276] 0709 12:24:32.639601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.742431 (+102830us) service_pool.cc:224] Handling call
0709 12:24:33.808579 (+1066148us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54007328d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.808722 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359290240}
I20260709 12:24:33.869647 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:33.892236 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 638) took 1130 ms. Trace:
I20260709 12:24:33.872771   705 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.873242   745 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:33.895844 31622 rpcz_store.cc:269] 0709 12:24:31.918724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.213865 (+295141us) service_pool.cc:224] Handling call
0709 12:24:33.887053 (+1673188us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001f5754. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.887188 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259972864}
I20260709 12:24:33.901651 31622 raft_consensus.cc:1240] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.903411 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 621) took 1264 ms. Trace:
I20260709 12:24:33.903859 31622 rpcz_store.cc:276] 0709 12:24:32.639374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.901172 (+1261798us) service_pool.cc:224] Handling call
0709 12:24:33.901474 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.903168 (+  1694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.903353 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.905401 31622 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:33.905938 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 629) took 1218 ms. Trace:
I20260709 12:24:33.906225 31622 rpcz_store.cc:276] 0709 12:24:32.687046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.904795 (+1217749us) service_pool.cc:224] Handling call
0709 12:24:33.905079 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.905719 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.905878 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.907804 31622 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:33.908414 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 640) took 1112 ms. Trace:
I20260709 12:24:33.908861 31622 rpcz_store.cc:276] 0709 12:24:32.795572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.907197 (+1111625us) service_pool.cc:224] Handling call
0709 12:24:33.907475 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.908184 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.908364 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.910147 31622 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:33.886232 31051 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:33.898913 31624 rpcz_store.cc:276] 0709 12:24:32.762195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.876466 (+1114271us) service_pool.cc:224] Handling call
0709 12:24:33.892173 (+ 15707us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.911307 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 562) took 1005 ms. Trace:
I20260709 12:24:33.913792 31622 rpcz_store.cc:276] 0709 12:24:32.905907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.909629 (+1003722us) service_pool.cc:224] Handling call
0709 12:24:33.909978 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.911077 (+  1099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.911257 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.917788 30892 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:33.920406 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:33.921289 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 373) took 1345 ms. Trace:
I20260709 12:24:33.921612 30972 rpcz_store.cc:276] 0709 12:24:32.576299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.621536 (+ 45237us) service_pool.cc:224] Handling call
0709 12:24:33.920238 (+1298702us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b5800190598. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:33.921229 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8483072}
I20260709 12:24:33.898267   658 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.925643   658 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.927320 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1554) took 1708 ms. Trace:
I20260709 12:24:33.927969   632 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.928721 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 632) took 1240 ms. Trace:
I20260709 12:24:33.929054 31621 rpcz_store.cc:276] 0709 12:24:32.689155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.928503 (+239348us) service_pool.cc:224] Handling call
0709 12:24:33.928549 (+1000046us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54003f1454. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.928666 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101568384}
I20260709 12:24:33.929553   541 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.930962   663 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.927685 30899 rpcz_store.cc:276] 0709 12:24:32.218503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.396818 (+1178315us) service_pool.cc:224] Handling call
0709 12:24:33.447115 (+ 50297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.507614 (+ 60499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.927127 (+419513us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b5400195850. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.927265 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115029376}
I20260709 12:24:33.931449 31623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:58086
I20260709 12:24:33.932001 31621 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:33.932116 31623 raft_consensus.cc:606] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:33.933231   726 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.933496 31623 raft_consensus.cc:614] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:33.933990   747 log.cc:927] Time spent T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:24:33.932912   514 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.935824   514 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.934005 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58086 (request call id 0) took 1347 ms. Trace:
I20260709 12:24:33.936614 31623 rpcz_store.cc:276] 0709 12:24:32.614045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.891971 (+1277926us) service_pool.cc:224] Handling call
0709 12:24:33.933921 (+ 41950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.945607   677 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.948225 31619 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:33.948948 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 624) took 1266 ms. Trace:
I20260709 12:24:33.949275 31619 rpcz_store.cc:276] 0709 12:24:32.683434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.911225 (+1227791us) service_pool.cc:224] Handling call
0709 12:24:33.948022 (+ 36797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.948666 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.948876 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.950867 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 793) took 1365 ms. Trace:
I20260709 12:24:33.951313 31616 rpcz_store.cc:276] 0709 12:24:32.585711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.858570 (+1272859us) service_pool.cc:224] Handling call
0709 12:24:33.950792 (+ 92222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.952494 31624 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:33.953142 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 565) took 1025 ms. Trace:
I20260709 12:24:33.953433 31624 rpcz_store.cc:276] 0709 12:24:32.928031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.913178 (+985147us) service_pool.cc:224] Handling call
0709 12:24:33.952304 (+ 39126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.952902 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.953090 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.959271   554 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:33.895516   723 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:33.961580 31048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 407) took 2424 ms (client timeout 2084 ms). Trace:
W20260709 12:24:33.962007 31048 rpcz_store.cc:269] 0709 12:24:31.537315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.537433 (+   118us) service_pool.cc:224] Handling call
0709 12:24:33.961355 (+2423922us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540013f454. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.961502 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117699328}
I20260709 12:24:33.918972 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:33.972234 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 53364.8us
I20260709 12:24:33.973084 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1528) took 1282 ms. Trace:
I20260709 12:24:33.973516 30969 rpcz_store.cc:276] 0709 12:24:32.690800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.726310 (+ 35510us) service_pool.cc:224] Handling call
0709 12:24:33.972912 (+1246602us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54001ba3d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.973024 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27319552}
I20260709 12:24:33.974246 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:33.974895 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 641) took 1178 ms. Trace:
I20260709 12:24:33.975265 31615 rpcz_store.cc:276] 0709 12:24:32.796217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.221921 (+425704us) service_pool.cc:224] Handling call
0709 12:24:33.974689 (+752768us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54007616d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:33.974818 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448503680}
I20260709 12:24:33.978111   680 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.978825 31587 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:33.979103   680 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:33.979389 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:33.980122   465 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:33.980737   465 raft_consensus.cc:697] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:33.981590   465 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:33.983770   316 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:33.910943   656 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.987870   600 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.990782 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:33.975512   630 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:33.994238   630 raft_consensus.cc:697] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:33.995122   630 consensus_queue.cc:237] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:33.997321 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:33.997947 30896 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:34.000298 31617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 777) took 2082 ms (client timeout 2397 ms). Trace:
W20260709 12:24:34.000747 31617 rpcz_store.cc:269] 0709 12:24:31.918255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.134677 (+216422us) service_pool.cc:224] Handling call
0709 12:24:34.000070 (+1865393us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400752bd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:34.000234 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843014400}
W20260709 12:24:34.004882 30939 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.777s (SENT)
I20260709 12:24:34.005038 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:34.005352 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:34.005753   536 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:34.006140   726 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.006520 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.007246 31043 raft_consensus.cc:2368] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:34.007622 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 419) took 1200 ms. Trace:
I20260709 12:24:34.007939 31043 rpcz_store.cc:276] 0709 12:24:32.807174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.809421 (+  2247us) service_pool.cc:224] Handling call
0709 12:24:34.006376 (+1196955us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:34.007570 (+  1194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11943808}
W20260709 12:24:34.017570 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 189642us
I20260709 12:24:34.020430 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1546) took 3634 ms. Trace:
I20260709 12:24:34.020824 30901 rpcz_store.cc:276] 0709 12:24:30.386082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.759075 (+2372993us) service_pool.cc:224] Handling call
0709 12:24:32.759355 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.759705 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.759755 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:32.760218 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.822571 (+ 62353us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:32.866448 (+ 43877us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.866909 (+   461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.867060 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.994109 (+1127049us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b18001adac0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d50e2a6 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1
0709 12:24:33.995453 (+  1344us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18001adac0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:24:34.020238 (+ 24785us) raft_consensus.cc:1685] finished
0709 12:24:34.020258 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.020374 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14855,"prepare.queue_time_us":43550,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":1540,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":10727,"spinlock_wait_cycles":17247232,"thread_start_us":53480,"threads_started":1,"wal-append.queue_time_us":124095}
I20260709 12:24:34.023882 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.025478 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.020052 31014 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.026827 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:34.027163 31014 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.029233 31588 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.030040 30939 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.030666 31588 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:34.031683 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:34.031911 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:34.032449 31620 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:34.034135 31620 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:34.035362 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.036863 31620 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:34.038828 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:34.040833 31624 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:34.041263 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.041882 31620 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:34.042876 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.044368 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:34.045003 31050 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:34.045120 31620 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.045830 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:34.047938 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:34.048405 30867 connection.cc:256] RPC call timeout handler was delayed by -1.320493981999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 12:24:34.048781 30867 connection.cc:256] RPC call timeout handler was delayed by -1.3120519039998726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2397s for a response
I20260709 12:24:34.049724 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.050369 31621 raft_consensus.cc:2368] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:34.050582 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:34.051071 31045 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.052073 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:34.029644 31587 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:34.024781 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:34.054957 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:34.057391 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:34.056239 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.058656 31050 raft_consensus.cc:2393] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:34.057920 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:34.058748 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:34.022974   590 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.054749 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.043776   597 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:34.060395   726 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.065831   639 consensus_queue.cc:1059] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:34.066919   639 raft_consensus.cc:3055] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:34.067263   639 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.067746   499 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:34.068106   639 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.069415   639 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:34.069702   734 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:34.054246   504 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:34.072897   504 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:34.073854   504 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.075793   756 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.076331 30799 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48640 (request call id 259) took 6902 ms. Trace:
I20260709 12:24:34.054302   713 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:34.077368   713 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.043915   575 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:34.077989   575 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.078326   575 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.078639 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:34.079173 31044 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.079778   460 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:34.080245   460 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.076645 31046 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:34.081775 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:34.089915 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 63181.6us
I20260709 12:24:34.090163 31050 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:34.081004 31587 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:34.049093 30867 connection.cc:256] RPC call timeout handler was delayed by -1.2751519039998129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24380000000000002s for a response
W20260709 12:24:34.091482 30867 connection.cc:256] RPC call timeout handler was delayed by -1.1779519039996558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2546s for a response
I20260709 12:24:34.085484 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:34.092358 31048 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:34.093312 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:34.094121 30974 raft_consensus.cc:2393] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:34.094379 31044 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:34.095111 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.095434 30896 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:34.044348   554 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:34.117525 30942 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:34.076687 30799 rpcz_store.cc:276] 0709 12:24:27.173801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.173966 (+   165us) service_pool.cc:224] Handling call
0709 12:24:27.266870 (+ 92904us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54001d0510. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d5090b2 00007f0336482759 00007f033641aa76 00007f03363ebd58 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc
0709 12:24:27.376590 (+109720us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b540021d9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330597090 00007f0330635f3a 00007f03363ebe9c 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc 00007f03349aa392 00007f032e96848c 00007f032e9678c6
0709 12:24:34.076270 (+6699680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:29.653449 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:29.753252 (+ 99803us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:29.753288 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:24:29.753301 (+    13us) tablet.cc:662] Decoding operations
0709 12:24:29.753814 (+   513us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:29.753868 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:29.753894 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:24:29.754216 (+   322us) tablet.cc:701] Row locks acquired
0709 12:24:29.754229 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:24:29.754374 (+   145us) write_op.cc:270] Start()
0709 12:24:29.754487 (+   113us) write_op.cc:276] Timestamp: P: 1783599869754322 usec, L: 0
0709 12:24:29.754505 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:24:29.755079 (+   574us) log.cc:844] Serialized 1275 byte log entry
0709 12:24:30.390292 (+635213us) op_driver.cc:464] REPLICATION: finished
0709 12:24:30.740323 (+350031us) write_op.cc:301] APPLY: starting
0709 12:24:30.740414 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:30.740549 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:30.740695 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:30.741156 (+   461us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:30.741352 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:24:30.741411 (+    59us) write_op.cc:312] APPLY: finished
0709 12:24:30.741650 (+   239us) log.cc:844] Serialized 35 byte log entry
0709 12:24:30.741819 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:30.741910 (+    91us) write_op.cc:454] Released schema lock
0709 12:24:30.752493 (+ 10583us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:30.800299 (+ 47806us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:30.801212 (+   913us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":172979456,"child_traces":[["op",{"apply.queue_time_us":349751,"apply.run_cpu_time_us":2153,"apply.run_wall_time_us":23991,"num_ops":3,"prepare.queue_time_us":765258,"prepare.run_cpu_time_us":38683,"prepare.run_wall_time_us":454019,"raft.queue_time_us":71336,"raft.run_cpu_time_us":38931,"raft.run_wall_time_us":120038,"replication_time_us":633540,"thread_start_us":630419,"threads_started":4,"wal-append.queue_time_us":500649,"wal-append.run_cpu_time_us":15610,"wal-append.run_wall_time_us":1491788}]]}
I20260709 12:24:34.104800 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.121202 30892 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:34.118785 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.105612 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.098397 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.122875 31621 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:34.107321 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.123894 30900 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.133697 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:34.138773 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 57859.4us
I20260709 12:24:34.140492 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.099797 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:34.141357 30974 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:34.133037 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 45450.7us
I20260709 12:24:34.144543 31051 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:34.145540 31621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:58086
I20260709 12:24:34.055383   474 raft_consensus.cc:2764] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:34.078451 30794 catalog_manager.cc:5697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.148115 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.145889 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:34.065774   596 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.176542 30900 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:34.147075 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.177659 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.170531 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.178383 30974 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:34.173244 30895 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.173638 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.170855 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.179311 30892 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:34.097215   458 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.196225 31624 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:34.157334 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:34.181102 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.154258 31587 leader_election.cc:400] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:34.377478 31587 leader_election.cc:403] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:34.178340 30900 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:34.169502   739 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:24:34.170933 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.203264 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:34.172881 31617 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:34.146008   756 consensus_queue.cc:1059] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:24:34.169584   742 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 12:24:34.220636 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.203533   620 consensus_queue.cc:1059] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:24:34.140058   694 consensus_queue.cc:1059] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:24:34.169382   541 consensus_queue.cc:1059] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:24:34.146171   581 consensus_queue.cc:1059] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:24:34.116822   754 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.096098   734 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 12:24:34.146155   663 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.097831   536 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:34.167853   361 raft_consensus.cc:2764] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:34.117162   316 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.078213   713 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:34.146188   499 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.146328   597 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:34.369552 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:34.385361 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 284308us
I20260709 12:24:34.365752 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.461377 31048 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:34.396520   683 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.874s	user 0.006s	sys 0.003s
W20260709 12:24:34.414443   741 consensus_meta.cc:287] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.906s	user 0.009s	sys 0.000s
I20260709 12:24:34.285980   460 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:34.372262   605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.020s	sys 0.043s
I20260709 12:24:34.475220   499 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.475952   597 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.444099   754 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.461040   316 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:34.480154   458 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:34.484308 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.487830 31620 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:34.514178   361 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:34.509709   575 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:34.492007   741 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:34.511947   600 consensus_meta.cc:287] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.008s
I20260709 12:24:34.457952   536 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.593446 30794 catalog_manager.cc:5697] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.422017 30864 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:34.364784 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.369135 30895 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:34.599326 30897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.012s	sys 0.016s
I20260709 12:24:34.600196 30898 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.601953 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.603964 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.687834 30892 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:34.606068 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.608359 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:34.385811 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 234568us
I20260709 12:24:34.416478 30972 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:34.359520 30973 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.033s	sys 0.042s
W20260709 12:24:34.617002 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 146256us
W20260709 12:24:34.617890 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 460507us
I20260709 12:24:34.617803 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.703743   774 consensus_queue.cc:1059] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:24:34.706791 31044 raft_consensus.cc:2410] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:34.492622 31045 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:34.705456 30939 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.705735   619 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:34.708355 30901 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:34.708446 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.708825 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.705057   600 consensus_queue.cc:1059] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:34.709514 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.494788 31048 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:34.710367   742 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:34.620065 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 426) took 1746 ms. Trace:
I20260709 12:24:34.712384 30899 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.711241   742 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:34.711133 31049 rpcz_store.cc:276] 0709 12:24:32.873949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.780443 (+906494us) service_pool.cc:224] Handling call
0709 12:24:33.780778 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.781139 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.781167 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.781651 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.870008 (+ 88357us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:34.360317 (+490309us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.619168 (+258851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.619360 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.619444 (+    84us) raft_consensus.cc:1685] finished
0709 12:24:34.619466 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.619743 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7245,"prepare.queue_time_us":652516,"prepare.run_cpu_time_us":880,"prepare.run_wall_time_us":880,"raft.queue_time_us":108912,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":6777,"thread_start_us":808720,"threads_started":3,"wal-append.queue_time_us":203139}
I20260709 12:24:34.492027 31050 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:24:34.620255 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.688922   723 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.716147   723 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:34.716710 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:34.622468 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 482795us
I20260709 12:24:34.717795 31618 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:34.386294 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 242892us
I20260709 12:24:34.689327 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.720049 30895 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:34.721035 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.624512 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.722463 31616 raft_consensus.cc:2410] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:34.723470 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:34.723810   778 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:34.726002   778 consensus_queue.cc:1059] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:34.625521 31013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.021s
I20260709 12:24:34.726917 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.727094   590 raft_consensus.cc:3055] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.625679 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.727690   590 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:34.627138 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 417) took 1820 ms. Trace:
I20260709 12:24:34.728081 31617 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:34.628360 31051 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:24:34.729099   683 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.628583   565 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.730527   778 raft_consensus.cc:3055] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.730966   778 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:34.628901   316 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:34.629823 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 569) took 1597 ms. Trace:
I20260709 12:24:34.630204   575 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:34.726852 31013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.008s	sys 0.021s
I20260709 12:24:34.631980   474 consensus_queue.cc:1059] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:24:34.732288 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 631314us
I20260709 12:24:34.733443   474 raft_consensus.cc:3055] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:34.733946   474 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:34.633025   504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.021s
W20260709 12:24:34.735982   504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.011s	sys 0.021s
I20260709 12:24:34.634330   596 consensus_queue.cc:1059] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:34.736655   565 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:34.737198   596 consensus_queue.cc:1243] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer 9f38f761eded4f28b9d802f6570ee71e log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:34.738689 31616 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:34.739406 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1534) took 1901 ms. Trace:
I20260709 12:24:34.562644   739 raft_consensus.cc:3055] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:34.562438   741 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:34.553478   745 consensus_meta.cc:287] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.640s	user 0.004s	sys 0.005s
I20260709 12:24:34.557168   754 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:34.564970   766 log.cc:927] Time spent T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:24:34.624580 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.786020 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:34.785777   745 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.786335 31043 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:34.601948 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.787670   739 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:34.788108 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.789587 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.790467 30896 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:34.790648 31016 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:34.726253   536 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:34.510774   458 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.792701 30969 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:34.793175   458 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.728303 31047 rpcz_store.cc:276] 0709 12:24:32.806616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.809978 (+  3362us) service_pool.cc:224] Handling call
0709 12:24:33.805892 (+995914us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508eee 000000000036eb39 00007f033557c1e0 00007f03356450c4 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:33.806038 (+   146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.839295 (+ 33257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.841316 (+  2021us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.868910 (+ 27594us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.388350 (+519440us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:34.392343 (+  3993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.413950 (+ 21607us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.491765 (+ 77815us) raft_consensus.cc:1685] finished
0709 12:24:34.626308 (+134543us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.626884 (+   576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30159744,"thread_start_us":479222,"threads_started":1,"wal-append.queue_time_us":544460}
I20260709 12:24:34.794862   458 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.557631   726 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.729399 31046 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:34.740283 30893 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.736045   756 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:34.799072   756 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:34.799537   756 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.743182 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:34.740373 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.805160 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1854) took 1141 ms. Trace:
I20260709 12:24:34.805573 30894 rpcz_store.cc:276] 0709 12:24:33.664097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.677458 (+ 13361us) service_pool.cc:224] Handling call
0709 12:24:33.754158 (+ 76700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.037345 (+283187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.037373 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.049766 (+ 12393us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.383684 (+333918us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:34.383735 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.383804 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.564509 (+180705us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:34.804641 (+240132us) raft_consensus.cc:1685] finished
0709 12:24:34.804677 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.804981 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31079,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15594,"spinlock_wait_cycles":14851328,"thread_start_us":527771,"threads_started":2,"wal-append.queue_time_us":374186}
I20260709 12:24:34.744663 30900 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.745568 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:34.722342 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.710871 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:34.689805 30897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.013s	sys 0.016s
I20260709 12:24:34.731842 31622 rpcz_store.cc:276] 0709 12:24:33.031933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.916130 (+884197us) service_pool.cc:224] Handling call
0709 12:24:33.916402 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.051074 (+134672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.051105 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.051146 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:34.051177 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.629204 (+578027us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54004c04d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:34.629279 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.629554 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309243136}
W20260709 12:24:34.727986 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 305961us
W20260709 12:24:34.709295 30973 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.034s	sys 0.042s
I20260709 12:24:34.743206 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:34.710304   600 raft_consensus.cc:3055] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.813431 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:34.735598   474 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.708912   619 raft_consensus.cc:3055] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:34.687471   740 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.746084 30976 rpcz_store.cc:276] 0709 12:24:32.837650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.022484 (+184834us) service_pool.cc:224] Handling call
0709 12:24:33.058476 (+ 35992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.065361 (+  6885us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:33.087273 (+ 21912us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.003246 (+915973us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b180029bc00. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd23a 00007f0330637a2a
0709 12:24:34.623638 (+620392us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.624718 (+  1080us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.624987 (+   269us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:34.625018 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.625165 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.738913 (+113748us) raft_consensus.cc:1685] finished
0709 12:24:34.739036 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.739194 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24016,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":106055,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":3662,"spinlock_wait_cycles":4027392,"thread_start_us":609342,"threads_started":2,"wal-append.queue_time_us":1445963}
I20260709 12:24:34.710484 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.807698 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.791366 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.813910 30901 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:34.812243 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.807902 31621 raft_consensus.cc:606] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:34.830783 31621 raft_consensus.cc:614] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:34.830678   554 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.016s	sys 0.013s
W20260709 12:24:34.831472   554 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.016s	sys 0.013s
I20260709 12:24:34.831938   554 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:34.835129 31621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1166342933745c5b82da4ee4032736c"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:58086
I20260709 12:24:34.836025 31621 raft_consensus.cc:606] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:34.836668 30972 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:34.838275 30892 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.714437   742 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:34.836724 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.807713 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:34.848104 30896 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.717814   723 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.852882   723 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.824730   600 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.816910   739 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.857661   600 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.814909 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1856) took 1150 ms. Trace:
I20260709 12:24:34.859318 31045 raft_consensus.cc:2368] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:34.859866   622 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:34.860579   622 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.848274 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:34.862608 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 101239us
W20260709 12:24:34.863222 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 87505.5us
I20260709 12:24:34.858227   739 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.864245 30898 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:34.794796   745 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:34.838460   554 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.870249   622 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:34.808434   770 raft_consensus.cc:3055] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:34.870814   779 consensus_queue.cc:1175] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e9d2b069edc4166802ee0456ebcb706" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:34.871984 30894 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.872340 31617 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:34.872946   778 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.884864   778 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.886226 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:34.887004 30975 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:34.873889   460 consensus_queue.cc:1059] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:24:34.888502 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:34.888864   680 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.889324   680 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.889612   783 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.829537   619 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.876204 30899 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:34.890241   680 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:34.809973   639 raft_consensus.cc:3055] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.900496   639 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.901539   639 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:34.902143 30865 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.903012   639 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.903565   514 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.904029   514 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.904377   514 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.906996 31618 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:34.858835   600 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.901463 31042 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:34.907956   787 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:34.908638   536 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:34.909267   536 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:34.901526 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 89584.7us
I20260709 12:24:34.911010 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:34.912606 30975 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:34.913619 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:34.914319 30975 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.915741 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:34.913475   776 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:34.881341   465 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:34.881500   620 consensus_queue.cc:1059] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:24:34.882234   774 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:34.883814 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:34.879166   770 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:34.892098 30895 raft_consensus.cc:2393] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:34.889173 30976 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:34.894294 30900 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:34.876241 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.870888   474 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:34.947654 30972 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:34.911603   536 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:34.728946   590 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.878698 30893 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:34.960549   620 consensus_queue.cc:1243] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer 5e9d2b069edc4166802ee0456ebcb706 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:34.961206 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:34.948321 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56151.8us
I20260709 12:24:34.928467 31045 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:34.890234   783 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:34.932325   658 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:34.938211 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:34.940088 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.883970   541 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:34.942790 30892 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:34.945528   774 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.976009 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:34.946982 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:34.908576   787 raft_consensus.cc:697] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:34.909861   790 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:34.946280 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:34.949888 30896 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:34.958381   713 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:34.960034 30901 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.928174 30867 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:34.896045 30864 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:34.973150 31014 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:34.946215   465 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.000422 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:35.000978   792 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:24:35.001300 30900 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:35.001700   770 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:35.012725 30894 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:35.021185 30895 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:34.999236   541 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.022460   465 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:35.022742 31042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1925) took 2180 ms (client timeout 2068 ms). Trace:
W20260709 12:24:35.023224 31042 rpcz_store.cc:269] 0709 12:24:32.842681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.019439 (+176758us) service_pool.cc:224] Handling call
0709 12:24:35.022482 (+2003043us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540007c1d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:35.022611 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3680510208}
I20260709 12:24:34.999917   774 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.024895 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:35.025729 30972 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.032894 30968 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.033290   694 raft_consensus.cc:3055] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:35.033757   694 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:35.034709   694 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:35.035759 30976 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:35.036051 30899 raft_consensus.cc:2368] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:35.036710 30974 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:34.858700 30897 rpcz_store.cc:276] 0709 12:24:33.664686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.678407 (+ 13721us) service_pool.cc:224] Handling call
0709 12:24:33.795919 (+117512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.834314 (+ 38395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.839052 (+  4738us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.868892 (+ 29840us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.814379 (+945487us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:34.814465 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.814566 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.814624 (+    58us) raft_consensus.cc:1685] finished
0709 12:24:34.814641 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.814833 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":902044,"threads_started":1,"wal-append.queue_time_us":657731}
I20260709 12:24:35.036748 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:35.044272 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:35.052184 30969 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:35.053742 30969 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:35.054507 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1923) took 1394 ms. Trace:
W20260709 12:24:35.056000   663 consensus_meta.cc:287] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.005s
I20260709 12:24:35.056660   663 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.057725 30970 raft_consensus.cc:2410] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:35.057582   787 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.053253   619 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.054929 30973 rpcz_store.cc:276] 0709 12:24:33.660642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.682764 (+ 22122us) service_pool.cc:224] Handling call
0709 12:24:33.683040 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.683228 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:34.816646 (+1133418us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.003186 (+186540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:35.054098 (+ 50912us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:35.054196 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.054289 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.054437 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":763648,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3106,"raft.queue_time_us":25776,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":11953,"thread_start_us":1196881,"threads_started":2}
I20260709 12:24:35.060774 30892 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:35.062356 30901 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
W20260709 12:24:35.063870 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 64241.9us
I20260709 12:24:35.064749   581 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.023576   541 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:35.064018 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 87632.8us
I20260709 12:24:35.058830   770 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.047322   776 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:35.071228 30895 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:35.071959 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 242536us
I20260709 12:24:35.058665   590 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.079190   754 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.088531   619 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.088981 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:35.093200   465 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.093927   465 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.094712 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:35.095247 30974 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:35.095541 30900 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:35.097391 30867 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:35.098662   752 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.100466   776 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:35.102923 30975 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:35.104242 31042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:35.104735   680 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.104997 31042 raft_consensus.cc:606] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.105479 31042 raft_consensus.cc:614] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:35.109694   774 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.072417   694 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.112402 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:35.115705 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 193320us
I20260709 12:24:35.116034 30968 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:35.116361   726 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:35.116904 30974 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:35.098920 30867 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.116936   726 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:35.118160   793 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:35.119464   726 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:35.119371 30971 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:24:35.110932 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.121675 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:35.133020 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 55783.2us
W20260709 12:24:35.133891 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 287380us
I20260709 12:24:35.070050   536 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.150530 31045 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:35.151368 31042 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:35.151836 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 53053.3us
I20260709 12:24:35.152406 30893 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:35.163954 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.182530   745 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:35.183133   745 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:35.185232   745 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:35.151645   514 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.189987 30972 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:35.133760   658 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:35.192642   658 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:35.193042   658 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.193511   663 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:35.194150   663 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:35.201038 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:35.225526   465 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:35.221805 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:35.231933 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 152433us
W20260709 12:24:35.226156   801 log.cc:927] Time spent T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
W20260709 12:24:35.246119 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 69447.5us
I20260709 12:24:35.247927 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:35.451630 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.449609 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 202263us
W20260709 12:24:35.452534 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.462067 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 156066us
I20260709 12:24:35.249032 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:35.402367 30864 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.466192 30976 raft_consensus.cc:2410] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:35.248134   773 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:35.449237   774 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.408041   754 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:35.305191   756 consensus_meta.cc:287] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.007s
W20260709 12:24:35.429178   778 consensus_meta.cc:287] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.002s
W20260709 12:24:35.362890   799 log.cc:927] Time spent T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:24:35.380681   541 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.415313   783 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.248281 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.470790 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:35.471526 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:35.496670 30901 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:35.472214 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:35.472312   590 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:35.251101   683 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.472851 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:35.476137 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:35.480472   805 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:24:35.483021 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:35.483477 30942 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:35.327898   793 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:35.483958 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 283020us
I20260709 12:24:35.486665 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:35.487141 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 204009us
I20260709 12:24:35.296382   514 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.503087   541 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:35.502529   590 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.504397 31618 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:24:35.523958 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 240709us
I20260709 12:24:35.343240   775 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.427933   663 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:35.491613 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:35.492446   752 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:35.520923 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.490407   620 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.523463 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:35.527613 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44685.8us
I20260709 12:24:35.488336   756 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:35.527581 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.505942 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:35.505362 31616 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:35.501281   773 raft_consensus.cc:697] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:35.536724 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.527855 30972 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:35.537281 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.538885 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.533658 31617 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:35.541471   754 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:35.542006   754 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.531669   778 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:35.533119   783 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.546792 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:35.508760   658 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.536077 31619 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.550837 30896 raft_consensus.cc:2393] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:35.564095   775 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.544075   779 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:35.563617   778 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:35.584012   639 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.584632   639 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.586174   465 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:35.586537   639 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.589474   600 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.617386 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 70662.2us
W20260709 12:24:35.619843 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 68201us
I20260709 12:24:35.616377   639 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:35.591171   460 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.546912   663 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:24:35.550431   620 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.599709   541 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:35.588785   752 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:35.631882 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 99560.5us
I20260709 12:24:35.591393   723 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:24:35.619783   619 consensus_meta.cc:287] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:24:35.614058   740 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.636590 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:35.587610   778 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.614282   465 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:35.624730   474 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.642499 30864 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:35.647521 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.644083   639 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:35.649557   807 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:35.650740   639 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.652237 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:35.651981   474 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.655093   474 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.646900   541 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.656217 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.656844 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.657147 31047 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:35.657927   465 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.659952 30867 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:35.660352 31619 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:35.660112   465 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:35.633994   600 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:35.672940 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 175044us
I20260709 12:24:35.671553 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.655851 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.665930   752 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:35.676905 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 91979.7us
I20260709 12:24:35.680039 30968 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:35.679908 30867 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.665380   590 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.669538   658 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.689810 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:35.690321 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 56892.1us
I20260709 12:24:35.673197   541 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.693740 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.694034   683 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:35.694362 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.695046 31047 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:35.676613   465 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:35.695912   739 consensus_meta.cc:287] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.817s	user 0.002s	sys 0.008s
I20260709 12:24:35.698443   756 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:35.701108   600 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.701349   723 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:35.669843   740 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.705093 30901 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:35.705284   745 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:35.705842   740 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.707110 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:35.707412 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:35.708071 30893 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:35.708355 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:35.708961 30899 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:35.709697 30895 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.710165 30976 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.663337   460 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.712569   620 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.713807   460 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.677328   536 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.717200   723 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:35.718070   723 consensus_queue.cc:1243] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer f868402d5ae640e7b362b9fddacbaf44 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:35.679667   554 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.707974 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:35.718843   554 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.719551 30967 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:35.719699 30971 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:35.720528   810 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:35.721094 31045 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:35.693974 30974 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:35.665724   773 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.724290 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.718567   723 raft_consensus.cc:3055] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:35.694505   683 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:35.720105   541 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:35.730451 30895 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:35.692751 30973 raft_consensus.cc:1240] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:35.733498 30971 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:35.724928 31046 raft_consensus.cc:2376] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4. Re-sending same reply.
I20260709 12:24:35.725138   723 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:35.717401 30969 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:35.738667 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:35.734639   683 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.739192 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:35.739315 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.734346 30864 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.739801 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:35.763541 30968 raft_consensus.cc:2410] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:35.738814 30974 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:35.740682 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.738858 31044 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:35.743065   775 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.743171 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:35.744467 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 55379us
I20260709 12:24:35.717278   465 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:24:35.721051   554 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:35.766783 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:35.766783 31048 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:35.746206 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:35.768508 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:35.743996   783 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.774024 31045 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:35.775303 31051 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:35.775511   536 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.776623 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.777331 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.886198 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:35.913713 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 194426us
I20260709 12:24:35.919605 30899 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
W20260709 12:24:35.917318 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 171182us
I20260709 12:24:35.922900 30939 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:35.840250 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:35.927356 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 193077us
I20260709 12:24:35.929903 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.933794 31044 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:35.936456 31046 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:24:35.843405   770 consensus_meta.cc:287] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.004s
I20260709 12:24:35.947788 30968 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:35.947610 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:35.774471   756 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.769376 31042 raft_consensus.cc:2376] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5. Re-sending same reply.
I20260709 12:24:35.952184 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:35.950987 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:35.949301 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.934451   739 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:36.010900 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.010771 31049 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:35.935976   554 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.011914 31620 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:36.012951 31049 pending_rounds.cc:85] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 2
I20260709 12:24:36.012470 31051 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:35.903174   778 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:24:36.014654 31016 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:35.951208   600 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.912468   754 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:36.004828 30939 leader_election.cc:336] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.594s (SENT)
I20260709 12:24:35.950205   775 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:36.027741 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:36.032559 30967 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:36.016176 31049 pending_rounds.cc:107] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:36.033433 31049 raft_consensus.cc:2889] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:35.949059 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:35.952610 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:36.034350   600 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:36.034627 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 82523.9us
I20260709 12:24:36.013497   536 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.952605 30972 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
W20260709 12:24:36.037881 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 106735us
I20260709 12:24:35.988955   783 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:36.016549   739 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.951393   822 consensus_queue.cc:1059] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:24:35.955099   663 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:24:36.051321 31046 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:36.027806   465 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.051803 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.025754   770 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:36.024080 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.058384 30974 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:36.032245   775 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.059613 30864 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:36.060053 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.063874 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 59098.9us
I20260709 12:24:36.065323 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.067840   821 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:36.055661 31046 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:35.950985   723 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.038810 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.011319   756 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.068399 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.564222 31618 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:36.564445   723 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:36.069156 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.069454 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.157318   541 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:36.374748 30976 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.664s	user 0.005s	sys 0.003s
W20260709 12:24:36.566783 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.571871   816 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.566035 30974 pending_rounds.cc:85] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 5
I20260709 12:24:36.573889 30974 pending_rounds.cc:107] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:36.574214 30974 raft_consensus.cc:2889] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:36.067934 31588 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:36.519138   823 log.cc:927] Time spent T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:24:36.056250   739 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.639847 30976 raft_consensus.cc:2410] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:36.519186 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:36.654675 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 586779us
W20260709 12:24:36.654739 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.574261   465 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.569422   600 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.592494 31046 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:36.110049 30969 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:36.698508 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1545) took 1020 ms. Trace:
I20260709 12:24:36.572381   816 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:36.569103   775 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.704341 31620 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:36.705346 30939 leader_election.cc:336] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.645s (SENT)
I20260709 12:24:36.068264   536 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.526s
I20260709 12:24:36.708261 30976 rpcz_store.cc:276] 0709 12:24:35.678195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.678315 (+   120us) service_pool.cc:224] Handling call
0709 12:24:36.698451 (+1020136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:36.048756   554 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.708793 31588 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:36.707577   713 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.710003   663 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.708448   541 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.706528 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.715878 31046 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:36.713330 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.006s	sys 0.022s
I20260709 12:24:36.697749 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:36.709342   683 consensus_meta.cc:287] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.935s	user 0.012s	sys 0.001s
W20260709 12:24:36.720710 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.007s	sys 0.022s
I20260709 12:24:36.722371 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:36.723608 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 941934us
W20260709 12:24:36.726181 30973 consensus_meta.cc:287] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.809s	user 0.005s	sys 0.001s
I20260709 12:24:36.726444 30973 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:36.719938   713 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.728729   541 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.733558   831 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:36.734053   831 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.734490   541 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.735006   541 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.740613   833 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.741020   713 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.741178   833 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:36.748751 30939 leader_election.cc:336] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.731s (SENT)
I20260709 12:24:36.749236 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:36.728256   816 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:36.727624   754 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.761106 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.761754 31620 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
W20260709 12:24:36.779798 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 57505.9us
I20260709 12:24:36.781502   770 raft_consensus.cc:697] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:36.778306 30867 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:36.721439   663 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:36.743160 31618 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:36.792630   754 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.828208   740 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.828527   754 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.830616   754 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.831128   754 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:36.729974   683 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.804611   830 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.808557   829 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:36.812170   756 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.812594   465 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:36.792266   590 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.787411   536 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:36.815315   554 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.816558   663 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:36.735414   541 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.784078   833 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:36.817664 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 73689.4us
I20260709 12:24:36.823179   745 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:36.824889 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1557) took 1051 ms. Trace:
W20260709 12:24:36.825985 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 45471.6us
I20260709 12:24:36.827011 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1873) took 1680 ms. Trace:
I20260709 12:24:36.828984   843 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:36.797174 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 88456.8us
I20260709 12:24:36.872462 30968 rpcz_store.cc:276] 0709 12:24:35.773862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.817734 (+ 43872us) service_pool.cc:224] Handling call
0709 12:24:36.824655 (+1006921us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b5400246154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:36.824800 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56431872}
I20260709 12:24:36.804056   842 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:36.835084 31046 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:36.782905   832 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.813691   831 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.881080 30867 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:36.828500   739 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:36.793308 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:36.866875   465 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:36.867374 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 807802us
I20260709 12:24:36.872802   840 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.878464   783 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.006s	sys 0.012s
I20260709 12:24:36.889460 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:36.889705 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:36.895658 30976 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:36.876677   770 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.890759 30969 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:36.891255   841 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.891903 31013 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.338s (SENT) [suppressed 46 similar messages]
I20260709 12:24:36.892792 31619 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:36.886818   756 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:36.907223   756 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.836725   830 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:36.874560   843 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:36.876418   536 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:36.869912   590 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:36.881949   816 consensus_queue.cc:1059] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:24:36.964049 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 83049.4us
I20260709 12:24:36.963162 30864 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:36.967805 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 87831.9us
I20260709 12:24:36.969394 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:36.970012 31046 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:36.964912   754 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.917418 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1549) took 1238 ms. Trace:
I20260709 12:24:36.972864 31622 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:36.971118   754 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.973754 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:36.963912   756 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:36.944598 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 208830us
I20260709 12:24:36.984498 30972 raft_consensus.cc:2410] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:24:36.896356   783 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.006s	sys 0.014s
I20260709 12:24:36.915915   838 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:36.984323   835 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.963778   541 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:36.954062   841 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:36.988117 30939 leader_election.cc:336] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.731s (SENT)
I20260709 12:24:36.894411   742 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.987880   783 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:36.987941   835 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.995745   837 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:36.886646   832 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:36.998896 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:36.972497 30970 rpcz_store.cc:276] 0709 12:24:35.679156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.679257 (+   101us) service_pool.cc:224] Handling call
0709 12:24:35.694420 (+ 15163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.694668 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:35.852683 (+158015us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.916555 (+1063872us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b180039a780. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f03301d54bc 00007f032d52348b 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f0330625060 00007f0330637716 00007f0330648287
0709 12:24:36.916861 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.917047 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.917088 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:36.917161 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.917224 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.917347 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":465190,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":87,"raft.queue_time_us":384721,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"spinlock_wait_cycles":157122048,"thread_start_us":759283,"threads_started":3,"wal-append.queue_time_us":633417}
I20260709 12:24:37.006160 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:36.909546   713 consensus_queue.cc:1059] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
W20260709 12:24:37.009408 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 128761us
I20260709 12:24:36.917794   683 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:37.000331 31013 connection.cc:256] RPC call timeout handler was delayed by -1.158649269000307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 12:24:37.013355 31045 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:36.995287   830 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:36.916579   840 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.027096 30864 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.000905   835 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.008086   848 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.008924   723 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:37.014283   465 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.041345 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.006096   742 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:37.063294 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 80509.6us
W20260709 12:24:37.063812 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 54330.8us
I20260709 12:24:37.048136   830 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.060863   590 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.061852   683 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.024022   536 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.061882   832 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.042977   723 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.045039   465 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.103554   783 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:37.110148 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 121719us
I20260709 12:24:37.110764 30864 leader_election.cc:400] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:37.130272 30864 leader_election.cc:403] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:37.111954   849 consensus_queue.cc:1059] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:24:37.121500   840 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.039280   848 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.104965 31014 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.026062   843 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:37.150563 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 49949.9us
I20260709 12:24:37.152566 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.151548   832 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
W20260709 12:24:37.176149 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 71224.7us
I20260709 12:24:37.180594 30867 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:37.183053 31587 leader_election.cc:336] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.794s (SENT)
I20260709 12:24:37.193142 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.176112   843 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.199872   465 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.200408   465 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.200872   465 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.201109   775 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.203121 30975 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.874650 30897 rpcz_store.cc:276] 0709 12:24:35.146340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.178512 (+ 32172us) service_pool.cc:224] Handling call
0709 12:24:35.187260 (+  8748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.200213 (+ 12953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.200251 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.200794 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.627518 (+426724us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:35.634801 (+  7283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.826624 (+1191823us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b540009a954. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:36.826673 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:36.826722 (+    49us) raft_consensus.cc:1685] finished
0709 12:24:36.826737 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.826952 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1256,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":18485,"spinlock_wait_cycles":28897152,"thread_start_us":418087,"threads_started":1,"wal-append.queue_time_us":491318,"wal-append.run_cpu_time_us":1663,"wal-append.run_wall_time_us":1006657}
I20260709 12:24:37.189576   793 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:37.190711   849 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.214778 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.190886   840 raft_consensus.cc:3055] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:37.248364 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 158936us
I20260709 12:24:37.196710   787 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:37.209774   658 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.181370   832 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:24:37.255129   856 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.220386   742 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.281255   861 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.255949 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.282838   723 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.245697   793 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.279224 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.317461 30976 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 2.
W20260709 12:24:37.285543 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 130304us
I20260709 12:24:37.222175   816 raft_consensus.cc:3055] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:37.223255   835 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.247407   840 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:37.204350   821 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:24:37.290012 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 114510us
W20260709 12:24:37.264747 30939 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.754s (SENT)
I20260709 12:24:37.215665   841 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:37.312080   694 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.312630   869 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:37.314843 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.253445   787 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.222311   851 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 12:24:37.280593   839 raft_consensus.cc:3055] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:37.324884 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 131823us
I20260709 12:24:37.281474   775 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.326428 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.327415   856 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:37.327545 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.328056 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.326380   770 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.217083   857 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.342279   857 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.299993   861 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.252282   849 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.344934   835 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.345569 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.346344   849 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.347630   877 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:37.330243   694 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.348217   877 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.330551   869 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.329550 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:37.350827   869 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.337766   754 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:37.351569 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 96923.2us
I20260709 12:24:37.351683   856 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.352496   554 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.353091   554 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.352999   840 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.353614   554 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.355849   554 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.320919   816 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:37.278995   848 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.362836   739 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.338953 31044 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:37.340345 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.340559 30976 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:37.353955   856 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.368577 30969 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:37.330523   658 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:37.369282   658 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.370231 30867 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:37.371054   754 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.371342   658 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.371534 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.372901 30865 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:37.343771 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.344426   861 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.377357 31588 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.377882 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.378484 31048 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:37.379160 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.379817 31615 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:37.380705 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.381803 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.373266   857 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:37.355911   875 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.383685   875 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.385308   861 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.385885   875 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:37.356523 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.386623 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.357662 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.330973   787 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.359395 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.359827   770 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.360225 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.332540   839 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:37.362488   816 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.330588 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.336766 31045 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
W20260709 12:24:37.367439 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.416833 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.436137 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.388700   793 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.421263 30976 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:37.429837 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.429468   839 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.389103   835 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:37.354040   840 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.371862   754 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.391685   868 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:24:37.392117 30867 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.417500 30901 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:37.434018 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.421471 30864 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:37.417078 30899 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:37.444510 31045 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:37.429175 30893 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:37.389016 30865 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.439347   793 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.450505 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:37.443187 31013 leader_election.cc:336] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.674s (SENT)
I20260709 12:24:37.392885 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.451488 31013 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:37.451876 31050 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
W20260709 12:24:37.447474 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 70190.4us
I20260709 12:24:37.385202   465 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.424103 30892 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:37.440271   839 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:37.456550 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3479167919999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:24:37.350764   877 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:37.449808 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.431205 31042 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:37.391515   832 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.372020   752 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.472076   752 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.472920   875 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.474212   752 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.362875   694 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:37.478991 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1918) took 2587 ms. Trace:
I20260709 12:24:37.479399 31049 rpcz_store.cc:276] 0709 12:24:34.891806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.895341 (+  3535us) service_pool.cc:224] Handling call
0709 12:24:34.900177 (+  4836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.050467 (+1150290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.478743 (+1428276us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000ae6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:37.478903 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432397568}
W20260709 12:24:37.459906 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.459169 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 70233.5us
I20260709 12:24:37.429934   816 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:37.480675 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.481405 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:37.482364 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.482995 31048 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:37.482385   835 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:37.483701   683 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:37.484228   683 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:37.462428 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:37.486327 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 94284.4us
I20260709 12:24:37.486518 30864 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.454473   821 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.396592   838 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:37.392251 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.450721 30897 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:37.463668 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.496592 30974 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:37.463974 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.497622 30900 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 2.
I20260709 12:24:37.464275 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.463692   658 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.465174 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.440770 30969 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:37.501461 30939 leader_election.cc:336] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.907s (SENT)
I20260709 12:24:37.502015   658 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:37.502235 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1157167919996027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23220000000000002s for a response
I20260709 12:24:37.502323 30864 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:37.387384   861 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.450351   843 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.492285 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.492588 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.495203 30867 leader_election.cc:400] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:37.500751   832 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:37.440376   770 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.454501   663 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:37.503945 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.510712 30867 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.512950 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:37.513631 30900 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:37.492590   830 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.493927   821 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.510257   857 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:24:37.522571   787 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.510322   832 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:37.526161 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 83006.1us
I20260709 12:24:37.485174   683 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.512504   843 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.503525   658 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.504537   754 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.503873   694 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:37.532064 31588 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.532732 31014 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.512013   856 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.509195   868 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:37.528811 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.535986 30968 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:37.549162 30974 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.529585   821 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.493253   838 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:37.536289 30867 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:37.538163 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:37.533519   822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.005s	sys 0.024s
I20260709 12:24:37.508353   875 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:24:37.509065   600 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:24:37.511862   828 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:24:37.553123 30967 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:37.544489   843 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.516304   663 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.573756   832 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.552120   873 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.565148 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.574508   663 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.574517   873 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.575058   873 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.575766 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.555696   694 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.576630 30967 raft_consensus.cc:2393] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:37.577487 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.579344 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.580523 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.581162 30967 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:37.582173 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.549005   868 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.583456 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.552043   465 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.530805   830 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.524089   835 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.572710 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.584287 30967 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:37.577913   694 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.554531 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:37.554849   822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.005s	sys 0.025s
I20260709 12:24:37.585791 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.583986   868 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.593545 30974 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:37.592321 31016 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:37.597568 31016 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.597749 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.598899 30974 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.589247 30972 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 2.
I20260709 12:24:37.602288 31016 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.603534 31016 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.606959 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.588738   465 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.613278 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.615170 31622 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:37.605813   861 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.595358   754 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:37.616777   877 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.605520 30897 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:37.621631 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.605017   694 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.623428 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.626351 30967 raft_consensus.cc:2393] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:37.616854   861 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.608249   849 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.608454   867 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.611109   837 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.614316   770 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.621659   877 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.617441   465 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:37.625612   842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.013s	sys 0.019s
I20260709 12:24:37.644439 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.629719   861 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:37.651865 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 120474us
W20260709 12:24:37.651585 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 66622.2us
I20260709 12:24:37.651422   877 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.625146   694 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.655869 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.635710   770 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.666453 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:37.711712 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 45331.6us
I20260709 12:24:37.712527 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:37.670069 30974 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:37.659701   783 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:37.673285 31619 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:37.676530 30969 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:37.677400   663 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:37.659976   694 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.652001 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.685315 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.685057   873 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.686514 30976 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:37.686666   658 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:37.688392   878 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:24:37.686829 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:37.748714 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 61970.8us
W20260709 12:24:37.749688 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.750180   839 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.750567   839 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:37.750893   839 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:37.752157   820 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 1.035s	user 0.004s	sys 0.006s
I20260709 12:24:37.755589 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.740487   739 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:24:37.691941 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.758562 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:37.759768 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.759990   658 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.760730 31615 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:37.761231 31620 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:37.686537 31624 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:37.764739 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 403) took 1658 ms. Trace:
I20260709 12:24:37.693751 31046 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:37.694368   830 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.618414   838 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.705060   465 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:37.655103   842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.013s	sys 0.020s
I20260709 12:24:37.732167 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.655279 31043 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
W20260709 12:24:37.734400 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 81836.1us
W20260709 12:24:37.734838 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 232565us
W20260709 12:24:37.782127 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.780591 31621 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:37.783566 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.740497 30974 raft_consensus.cc:1240] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:37.743372 31623 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:37.747277   873 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:37.721413   770 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.731546   554 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:37.787215 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.787622   554 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:37.788100   554 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.789420   838 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.731863   834 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.792774 30969 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.765110 30975 rpcz_store.cc:276] 0709 12:24:36.106952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.107120 (+   168us) service_pool.cc:224] Handling call
0709 12:24:36.368414 (+261294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.203571 (+835157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.764542 (+560971us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540016add4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:37.764686 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919182080}
I20260709 12:24:37.770843 31016 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.780361   842 raft_consensus.cc:697] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:37.799973   787 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.802966 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.805893 31014 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:37.816223 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 45462.5us
I20260709 12:24:37.775950   839 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.776644 30897 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:37.778416   713 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:37.791505 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.824232 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.829599 31622 raft_consensus.cc:2410] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:37.801385   873 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.782558   465 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:37.833700 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 92255.6us
W20260709 12:24:37.834533 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.839689 30794 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53550 (request call id 395) took 12960 ms (client timeout 15000 ms). Trace:
I20260709 12:24:37.824896 31618 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:37.841158   840 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:37.841801   581 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.840129   843 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.771371   868 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.860860 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:37.861410   868 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.824604   658 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:37.826201   867 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.854763 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:37.862671   867 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.861528 31043 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.856848   581 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.863036 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.864053 31622 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 2.
I20260709 12:24:37.850274 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:37.859227   843 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.865095   581 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:37.863088   867 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.863420 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:37.870738 31047 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.874063 31043 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:37.832363   879 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:37.879824   867 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.882102   867 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.877229 31047 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:37.823560   861 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.890172   861 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:37.842543   822 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:24:37.895929   856 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.801934   842 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.896826 30892 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:37.832403   845 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 12:24:37.901357 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 76288.8us
I20260709 12:24:37.902007 31016 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:37.902905   816 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:37.903474 31047 raft_consensus.cc:1240] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:37.904305   816 raft_consensus.cc:2764] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:37.906801   843 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.907289   843 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.912693   843 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:37.901949 30864 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:37.916764 30864 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:37.917688   536 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:37.917819   752 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:37.918238   536 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:37.918483 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 72313.6us
I20260709 12:24:37.919142   536 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:37.919688 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.921075   833 consensus_queue.cc:1059] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:37.921329 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.852499   871 consensus_queue.cc:1059] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:24:37.925670 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 65364.2us
I20260709 12:24:37.883420   834 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:37.934562 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 79878.6us
I20260709 12:24:37.936383 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:37.847304   875 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.939461 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:37.940613 31047 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:37.923254   830 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.949116 31046 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:37.951848 30864 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:37.937203   663 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:37.955762 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.963001 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.963392 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.956539   890 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:37.959391   779 raft_consensus.cc:3055] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:37.943131   752 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:37.964453 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:37.964717 31618 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:37.965062 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.938691   793 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:37.967798 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 65860.5us
I20260709 12:24:37.941759   867 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:37.923213   694 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:37.974507 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.975108 30972 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.978673 30973 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:37.937742   739 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:24:37.978796 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.941443   775 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:37.960659   663 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.964525 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:37.979766 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:37.965122   879 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:24:37.962704   835 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.960454   834 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:37.846344 30794 rpcz_store.cc:269] 0709 12:24:24.864252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.867874 (+  3622us) service_pool.cc:224] Handling call
0709 12:24:37.824367 (+12956493us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:34.931356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:34.932115 (+   759us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:34.932175 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:24:34.932205 (+    30us) tablet.cc:662] Decoding operations
0709 12:24:34.932720 (+   515us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:34.932790 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:34.932816 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:34.933334 (+   518us) tablet.cc:701] Row locks acquired
0709 12:24:34.933389 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:24:34.933578 (+   189us) write_op.cc:270] Start()
0709 12:24:34.933737 (+   159us) write_op.cc:276] Timestamp: P: 1783599874933513 usec, L: 0
0709 12:24:34.940677 (+  6940us) op_driver.cc:348] REPLICATION: starting
0709 12:24:35.078199 (+137522us) log.cc:844] Serialized 911 byte log entry
0709 12:24:36.158955 (+1080756us) op_driver.cc:464] REPLICATION: finished
0709 12:24:36.890430 (+731475us) write_op.cc:301] APPLY: starting
0709 12:24:36.890541 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:36.890676 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:36.890793 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:36.891227 (+   434us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:36.891509 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:36.891554 (+    45us) write_op.cc:312] APPLY: finished
0709 12:24:36.905253 (+ 13699us) log.cc:844] Serialized 29 byte log entry
0709 12:24:37.018207 (+112954us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.024875 (+  6668us) write_op.cc:454] Released schema lock
0709 12:24:37.030818 (+  5943us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:37.119825 (+ 89007us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.119857 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1537637,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":496672,"apply.run_cpu_time_us":44144,"apply.run_wall_time_us":201593,"num_ops":2,"prepare.queue_time_us":186538,"prepare.run_cpu_time_us":25026,"prepare.run_wall_time_us":528827,"raft.queue_time_us":380274,"raft.run_cpu_time_us":17755,"raft.run_wall_time_us":741314,"replication_time_us":1106115,"thread_start_us":643068,"threads_started":5,"wal-append.queue_time_us":262939,"wal-append.run_cpu_time_us":30962,"wal-append.run_wall_time_us":1649363}]]}
I20260709 12:24:37.970701 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:37.968310   779 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:37.973495   793 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.987334   867 raft_consensus.cc:697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:37.993747   663 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.018385 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:37.999239   834 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.021467   834 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.996490   835 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.980821   821 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.033033   752 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.042513   554 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:38.039307 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.053691 30972 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:38.040133 30798 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 3, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:38.041833   895 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:38.035066   877 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:38.001044   793 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.009500   873 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.044260   835 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.002786   787 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:24:38.083542 30798 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.091651 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.094244 31623 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.094826 31045 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:24:38.096514 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.064248   873 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.102111 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.102715 31620 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.082161   713 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.059865   839 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:38.112030 30892 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:38.099686   897 log.cc:927] Time spent T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:24:38.115913 30895 raft_consensus.cc:1240] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:38.116115 30798 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:38.136762 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 76726.5us
I20260709 12:24:38.136691 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:38.140205 30899 raft_consensus.cc:2410] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:38.107919   873 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.116904 31619 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:38.148455 30798 catalog_manager.cc:5697] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.152076 30892 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:38.089900   899 consensus_queue.cc:1059] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:24:38.155330 30798 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:38.156598 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.156813 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.157244 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.158841 30892 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:38.159063 30901 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:38.088274   779 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.157361 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.160272 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.140857 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.162171 30896 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:38.113294   694 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:38.166177 30895 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:38.153774 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.186147 30798 catalog_manager.cc:5697] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 3, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.172804 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.154510 30969 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:38.190232 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.199304 30899 raft_consensus.cc:2410] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:38.199963 30975 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:24:38.109200   867 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.228722 30798 catalog_manager.cc:5697] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.230306 30798 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:38.232389   821 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:38.233266   554 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:38.234556   900 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:24:38.236829 30798 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 3, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.186163 31617 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.280164 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:38.280824 30974 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.283052 30798 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 3, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.194937   843 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.331410 30899 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:38.199553 30897 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:38.286532   779 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.336548 30798 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.352993 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:38.318176 30974 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:38.333164 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:38.355625 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 386858us
I20260709 12:24:38.361426 31620 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:38.363448 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.365744 30798 catalog_manager.cc:5697] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:38.366838 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 265067us
I20260709 12:24:38.341854   911 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:38.374269 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 437921us
I20260709 12:24:38.376578 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:38.365897   906 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:24:38.340130   843 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:38.375314 30798 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 3, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.382333 30896 raft_consensus.cc:2410] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:38.376731   877 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:38.384624 30798 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 4, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.388422 30895 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:38.378074   838 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:38.393121 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:38.381808   911 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:38.402002   901 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:24:38.403352 30798 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:38.404666 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:38.405367 31049 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:38.405807 31050 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:38.406816 30899 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:38.409467 30798 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 1 to 2, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:38.415841 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.415997 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:38.418020 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.439416 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:38.437282   838 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:38.443832   838 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:38.447695 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.451588 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:38.452538 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:38.451669 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:38.454097 31049 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:38.455905 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:38.461680 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.468497 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:38.469094 30970 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.451798   787 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:38.481608 31623 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:38.454607   514 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.486143 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:38.454944   832 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:38.489499 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.490067 31044 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:38.472566   838 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:38.489490   909 log.cc:927] Time spent T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:24:38.490998 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:38.491300   787 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:38.517953 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 112620us
I20260709 12:24:38.492527   843 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:38.531069 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.494328   838 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:38.534390 31588 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:38.506491   911 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:38.493178   775 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:24:38.494040   832 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:38.490621   514 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:38.495384   663 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:38.495015   554 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:38.580106 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 45597.7us
I20260709 12:24:38.542241   838 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:38.604733 31587 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 3.291s (SENT)
I20260709 12:24:38.606393 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:38.541867   915 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.704137 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.580686   911 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:38.730209 30968 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:38.618091 31046 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:38.742192 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.608332   903 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.732707 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.861058 31623 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:24:38.825881   910 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.632s	user 0.001s	sys 0.000s
I20260709 12:24:38.775977   536 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.823191   713 raft_consensus.cc:3055] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:38.732735 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.875536 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:38.786507   912 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:24:38.912122 31624 raft_consensus.cc:2393] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:24:38.886556 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.911404 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:38.916862 31623 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:38.852192   514 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:38.784907 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:38.814853 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:38.634866   915 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.875622   713 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:38.919801   919 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
I20260709 12:24:38.945318 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 609) took 1261 ms. Trace:
I20260709 12:24:38.945716 31619 rpcz_store.cc:276] 0709 12:24:37.683497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.755317 (+ 71820us) service_pool.cc:224] Handling call
0709 12:24:38.945112 (+1189795us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400106654. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:38.945243 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764252928}
I20260709 12:24:38.946416   713 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.947014 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:38.920522   921 log.cc:927] Time spent T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:24:38.922253   834 consensus_meta.cc:287] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.900s	user 0.008s	sys 0.000s
I20260709 12:24:38.923295   928 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:38.924532   779 consensus_meta.cc:287] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.000s
W20260709 12:24:38.924718   920 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:24:38.925601   663 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:38.928820 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:38.929260   873 consensus_meta.cc:287] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.001s
I20260709 12:24:38.996284 31620 raft_consensus.cc:2410] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:38.929881 31617 consensus_meta.cc:287] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.000s
I20260709 12:24:38.933959 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:38.911054   770 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.125s	user 0.011s	sys 0.003s
I20260709 12:24:38.935307 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:38.875825 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 295785us
I20260709 12:24:38.938524 31049 raft_consensus.cc:1240] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:38.876565   911 raft_consensus.cc:697] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:38.941613 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:38.941829 31047 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:38.947458   713 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:38.971321 30970 consensus_meta.cc:287] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.000s
W20260709 12:24:38.979630 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.939697   793 consensus_meta.cc:287] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.837s	user 0.008s	sys 0.001s
W20260709 12:24:38.938282   835 consensus_meta.cc:287] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.839s	user 0.009s	sys 0.000s
I20260709 12:24:38.961849 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:38.982983 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.952527 31616 raft_consensus.cc:2410] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:24:38.945662   916 log.cc:927] Time spent T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.451s	user 0.001s	sys 0.000s
I20260709 12:24:38.940219 31618 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.996876 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:39.062768   911 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:39.063673   920 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:39.064049 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:38.981794   834 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.952153   914 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:39.002103 30939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.013s
I20260709 12:24:39.001936 31046 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:38.952523   832 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:38.743379   787 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:38.917618   903 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.919096   536 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:39.098273 30972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.000s	sys 0.026s
W20260709 12:24:39.013856 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.009207 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:39.105942 30939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.008s	sys 0.022s
I20260709 12:24:39.009311 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:39.109467 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.007826 30970 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:24:39.108907 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 700270us
I20260709 12:24:39.108906 30899 raft_consensus.cc:2376] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5. Re-sending same reply.
W20260709 12:24:39.107610 30972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.001s	sys 0.026s
I20260709 12:24:39.110957 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:39.005405   770 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.001772 31615 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:39.062064 31622 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.063741 30901 raft_consensus.cc:2376] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4. Re-sending same reply.
I20260709 12:24:38.956667   817 raft_consensus.cc:3055] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:38.998983 31617 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
W20260709 12:24:39.000849 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2163183510001545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 12:24:38.982312   928 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:39.122977   838 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:39.118170   817 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:39.127882 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 612) took 1037 ms. Trace:
I20260709 12:24:39.128340 31617 rpcz_store.cc:276] 0709 12:24:38.090244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.093237 (+  2993us) service_pool.cc:224] Handling call
0709 12:24:39.127813 (+1034576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:39.129518   817 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.130533   817 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.132797 31622 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
W20260709 12:24:39.105650   904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.022s	sys 0.029s
I20260709 12:24:39.076061 31624 raft_consensus.cc:1240] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:38.999617   873 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:38.947664 31619 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
W20260709 12:24:39.067194 30942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.001s	sys 0.023s
I20260709 12:24:39.065680 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:39.115715 30896 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:38.998723   843 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.066010   663 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.117772 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1589) took 1119 ms. Trace:
W20260709 12:24:39.135375   904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.022s	sys 0.029s
I20260709 12:24:39.180431 30972 rpcz_store.cc:276] 0709 12:24:37.998601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.054421 (+ 55820us) service_pool.cc:224] Handling call
0709 12:24:38.091645 (+ 37224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.091857 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:38.491203 (+399346us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.112497 (+621294us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.117430 (+  4933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.117483 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:39.117542 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.117609 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.117710 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4420,"prepare.queue_time_us":64120,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":253405,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":54040,"thread_start_us":999789,"threads_started":2}
I20260709 12:24:39.066183 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.183894 31623 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
W20260709 12:24:39.135247 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.133545 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 126052us
I20260709 12:24:39.036619   793 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.109282   867 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.138687 30901 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:39.139936 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:39.141697 30942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.003s	sys 0.028s
W20260709 12:24:39.118521 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2136183510001501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:24:39.193135 31587 connection.cc:256] RPC call timeout handler was delayed by -1.0840183510003953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 12:24:39.193490 31587 connection.cc:256] RPC call timeout handler was delayed by -1.0732183510003779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 12:24:39.188238 31043 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:39.180231   514 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.199467   514 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.201781   514 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.202303   514 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:39.204049 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:39.205346 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:39.205935 30892 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:39.206687 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:39.207518   867 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:39.209105   793 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.188261   663 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:39.212000 30971 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:39.212428   915 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:39.108708   914 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.246944 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:39.247786 30896 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:39.028151   835 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:39.186390   843 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.185927 30864 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:39.188613 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:39.132936   940 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:39.111832   875 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.011s	sys 0.020s
I20260709 12:24:39.385440 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:39.259038 30900 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 8. Ops: []
W20260709 12:24:39.332525 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.385447 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 199579us
I20260709 12:24:39.393970 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:39.395668 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:39.631039   663 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:39.323119 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.633039 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 493113us
I20260709 12:24:39.640940 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:39.641342 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:39.641570 31047 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:39.622630 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 425) took 1640 ms. Trace:
I20260709 12:24:39.634311 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1932) took 1850 ms. Trace:
I20260709 12:24:39.643594 31045 rpcz_store.cc:276] 0709 12:24:37.783507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.783616 (+   109us) service_pool.cc:224] Handling call
0709 12:24:37.800532 (+ 16916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.099243 (+298711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.634052 (+1534809us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54000ae6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:39.634247 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672342912}
W20260709 12:24:39.396200 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 183199us
W20260709 12:24:39.647092 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.647573 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.647874 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.648361 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:39.276860 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.396227 31046 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.652312 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:39.653829 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.655295 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:39.281742   939 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:39.655849 31623 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:39.658603 31623 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:39.630151   934 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.660230 30899 raft_consensus.cc:2376] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4. Re-sending same reply.
I20260709 12:24:39.618675   946 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:39.649085   875 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.012s	sys 0.039s
I20260709 12:24:39.660909 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:39.643015   723 raft_consensus.cc:3055] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:39.651283   793 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:39.662755   942 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:39.672556   942 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.674995   942 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.663113   946 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.676026 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.676381   946 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.676896 31622 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:39.677790 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.678467 31621 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:39.623791   914 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.662729 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:39.650094   554 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.683139 31047 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.624413   770 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.258831   834 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.260200   835 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:39.661932 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.392737 31618 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:39.664803 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.353535   903 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.228574   927 consensus_queue.cc:1059] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.429s
I20260709 12:24:39.656901   911 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.651700   787 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:39.657673   663 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:39.716127 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.755944 31623 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:39.644991   775 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:24:39.741328 31046 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:39.741935 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.656667   817 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:24:39.662477   867 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:39.661240   938 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.749384 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 813) took 1126 ms. Trace:
I20260709 12:24:39.753477 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:39.683547   514 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:39.700170   554 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.669243   723 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:39.730433   914 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:39.757999 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 108658us
I20260709 12:24:39.669663   793 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.751474 31047 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:39.761116   787 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:39.740483 31619 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:39.758025   927 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.770772 31624 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:39.773284 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 121054us
I20260709 12:24:39.763705 31616 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:39.669134   926 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.782621 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.796669 31622 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:39.756057   911 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.795292 30939 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:39.774364   914 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:39.762203   663 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.775383   554 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:39.808696   945 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:24:39.781662   942 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:39.806257 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:39.821448 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:39.822772 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:39.823945 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:39.819320 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.825067 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:39.826931 30864 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:39.769076 31618 rpcz_store.cc:276] 0709 12:24:38.616674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.777707 (+161033us) service_pool.cc:224] Handling call
0709 12:24:39.742934 (+965227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:39.828873 30942 leader_election.cc:336] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.514s (SENT)
I20260709 12:24:39.775261   514 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.799398   926 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.839926   926 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.832726 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.830152 30864 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:39.850683 31622 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:39.665998   934 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:39.837772 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:39.838590   950 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:24:39.817824   914 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.830461 30942 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:39.819622   834 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:39.767980   938 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:39.853256 30895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1588) took 1659 ms (client timeout 1848 ms). Trace:
I20260709 12:24:39.853644   835 consensus_queue.cc:1059] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:39.854279   952 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:39.858332 30973 raft_consensus.cc:1240] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:39.642522 30967 rpcz_store.cc:276] 0709 12:24:37.982578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.000869 (+ 18291us) service_pool.cc:224] Handling call
0709 12:24:38.024881 (+ 24012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.025075 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:38.953950 (+928875us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b180027b5c0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f03301d54bc 00007f032d52348b 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f03340253c7 00007f03306379a7 00007f03306470bf
0709 12:24:38.954077 (+   127us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.622268 (+668191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.622321 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:39.622370 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.622437 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.622556 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21435,"prepare.queue_time_us":88008,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":524983,"spinlock_wait_cycles":15816064,"thread_start_us":255205,"threads_started":2,"wal-append.queue_time_us":233043}
I20260709 12:24:39.831562   953 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.831962   770 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:39.845654 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:39.798110   927 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:39.866271 30895 rpcz_store.cc:269] 0709 12:24:38.190043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.191334 (+  1291us) service_pool.cc:224] Handling call
0709 12:24:39.849595 (+1658261us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5400097c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:39.849743 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55072128}
W20260709 12:24:39.875953 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 69771.2us
I20260709 12:24:39.827615   942 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.884649   911 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:39.891072 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:39.865989   903 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.891857 31622 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:39.893824 30973 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:39.871423   952 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.880955   843 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:39.879060   953 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:39.879974   834 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:39.907058 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 79540.2us
I20260709 12:24:39.906334 30898 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:39.909890 30973 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:39.890671   888 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:39.911458 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:39.913057 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:39.913383 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 46880.4us
I20260709 12:24:39.914326 30895 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.912571 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:39.903352   952 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.916972 31046 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:39.903421   958 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.856789   723 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.855907   787 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:39.885246   770 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:39.926250 30895 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:39.919538 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:39.929003 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.930574 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.937980   817 consensus_queue.cc:1175] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f868402d5ae640e7b362b9fddacbaf44" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:39.939307 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:39.940104 30898 raft_consensus.cc:2393] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:39.911620   953 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.913969   888 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:39.914564   843 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:39.953984 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.912693   875 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:39.958293 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.962232 31623 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.919687   958 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.972726 30898 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:39.970598 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:39.971204 31587 connection.cc:256] RPC call timeout handler was delayed by -1.5077396330002557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260709 12:24:39.940618 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:39.975318 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:39.980294 31587 leader_election.cc:336] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.627s (SENT)
I20260709 12:24:40.009191 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:39.954056   723 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.961925   867 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.955050   903 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.973729 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 61244.4us
I20260709 12:24:40.015931 30864 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:40.017059   663 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.017642   663 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:39.981693 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.020839 30898 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.980881 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:39.974422 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:40.037621 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 57357.2us
W20260709 12:24:40.038502 31587 leader_election.cc:336] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.630s (SENT)
W20260709 12:24:40.036708 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 127019us
W20260709 12:24:40.039770 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.041059 30898 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:40.041438 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.042017 30892 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.042083 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.042295 31623 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:40.044561 30898 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.027436 31045 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:40.046571 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.047219 31050 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:40.048141 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.048729 31050 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:40.049472 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.049974 31050 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:40.050714 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:40.051357 31050 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:40.052623 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.053253 30973 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:39.974366   958 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.056699 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:39.972951   965 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:40.057876 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:40.063863 31623 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.066200 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:40.027273 31616 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.068868 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.068706 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:40.071967 31050 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 3: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:40.072119 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:39.974764   911 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:24:40.043840   957 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.004070   775 consensus_queue.cc:1059] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:24:40.062944   961 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 12:24:40.061360   893 log.cc:927] Time spent T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 1.864s	user 0.008s	sys 0.029s
I20260709 12:24:40.075553 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:40.054872   514 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:40.088358 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 147063us
I20260709 12:24:39.971038   875 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.061666 30897 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:39.973054   843 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.093261 31621 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.098469 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.103842 31623 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:40.076144   835 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:40.107501 30973 raft_consensus.cc:2376] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5. Re-sending same reply.
I20260709 12:24:40.110982 31050 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:24:40.039170   867 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.111747 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:40.112363 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 73877.8us
W20260709 12:24:40.113175 31587 leader_election.cc:336] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.774s (SENT)
I20260709 12:24:40.052372   903 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.125196   914 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.125825   952 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.126286   972 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:40.126869   972 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:40.127010 30895 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:40.060985   834 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.127796   972 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.129187   952 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.129344   843 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.131523 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.132221 30897 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:40.133140 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.134148   835 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:40.135084   835 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.069202   965 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.062062   888 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.193097 30892 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:40.405786 30976 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:40.175423 31050 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:40.415931 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 388623us
I20260709 12:24:40.451171 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:40.367643 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 326981us
I20260709 12:24:40.449863 30864 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:40.153231 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 238819us
I20260709 12:24:40.432241   867 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:40.209339   938 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.425005   865 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:40.428114   914 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.187995   942 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.202395   554 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.155444   904 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.517655   843 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.293109   957 raft_consensus.cc:697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:40.578084   843 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:40.209115   898 log.cc:927] Time spent T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 2.073s	user 0.014s	sys 0.016s
I20260709 12:24:40.464078   514 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:40.414229 31615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.002s	sys 0.012s
W20260709 12:24:40.454711   752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.220s	user 0.015s	sys 0.021s
W20260709 12:24:40.581146 31615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.009s	sys 0.026s
I20260709 12:24:40.457334 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:40.582024   752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.347s	user 0.022s	sys 0.033s
W20260709 12:24:40.554827 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.582916   962 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.580s	user 0.000s	sys 0.001s
W20260709 12:24:40.542941   949 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.923s	user 0.000s	sys 0.001s
W20260709 12:24:40.584271   713 consensus_meta.cc:287] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.573s	user 0.009s	sys 0.003s
I20260709 12:24:40.580405   843 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.499656   958 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:40.585215   953 consensus_meta.cc:287] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.000s
I20260709 12:24:40.585590   953 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.586560 30894 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:40.517163   952 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.587282   952 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:40.588310   940 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.933s	user 0.000s	sys 0.009s
I20260709 12:24:40.588711   940 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.210196   868 raft_consensus.cc:3055] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:40.589584 30974 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:40.589829   868 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:40.591027   868 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.591993   868 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.593763 31621 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:40.498494   888 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:40.596014 31616 consensus_meta.cc:287] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.002s
I20260709 12:24:40.596405 31616 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:40.587561   953 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.598913 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.600829   554 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.581090   514 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.602046   514 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.583935   865 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.603891 30970 raft_consensus.cc:2393] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:40.281009 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.607828 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.598961 30892 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:40.175711 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 62566.8us
W20260709 12:24:40.464459 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.505519 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:40.460238 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.461478 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:40.621500 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 116050us
I20260709 12:24:40.623476 30973 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:40.624563 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:40.295199 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 324643us
W20260709 12:24:40.625313 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.625911 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:40.622097 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.627859 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.628741 30865 leader_election.cc:336] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.524s (SENT)
I20260709 12:24:40.140522 30898 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:40.355958   770 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:40.300156 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 322821us
I20260709 12:24:40.630084 30942 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:40.596308   739 raft_consensus.cc:3055] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:40.624086 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.464192 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.202842 31047 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:24:40.629320 30865 leader_election.cc:336] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.552s (SENT)
I20260709 12:24:40.630947 31016 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:40.630407 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:40.539408   926 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.005s
I20260709 12:24:40.567189   903 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.636893 30898 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:40.366138   946 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.689s	user 0.002s	sys 0.008s
I20260709 12:24:40.638526 31588 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:40.645236 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.639240 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:40.645870 31016 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:40.646325 31047 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.544938   875 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:40.631517 31042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.771s	user 0.010s	sys 0.012s
I20260709 12:24:40.641731 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.637755 31045 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:40.541716   960 raft_consensus.cc:3055] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:40.455175   927 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.586671   958 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:40.622593 31587 leader_election.cc:336] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.784s (SENT)
I20260709 12:24:40.671452 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.671545 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:40.134187 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.641351 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.649012 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.116053   934 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.672222 31048 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:40.589583   952 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.632190   834 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:40.651309 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.650911   904 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.634223   739 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:40.669198 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.641115   938 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.672971 30892 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.665728   960 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:40.678288 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.650974   942 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.692890 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:40.680639 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:40.651319   903 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.651657   946 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.696200   903 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.697845   946 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.698858   960 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.699895   960 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.700250 30898 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:40.701009   981 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.702006   978 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.702564   978 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:40.687577   958 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:24:40.703526   978 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.704619   958 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.705081   958 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:40.578606   957 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.512863   775 consensus_queue.cc:1059] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
W20260709 12:24:40.654652 31042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.798s	user 0.010s	sys 0.012s
I20260709 12:24:40.683563 31047 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:40.683701 30864 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:40.684631 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 62067.8us
I20260709 12:24:40.666170   835 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.631632   940 consensus_queue.cc:1059] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:40.685276   904 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.679162 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.682191 30897 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.651124   926 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.672686   867 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:40.726864 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:40.737993 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 54392.4us
I20260709 12:24:40.713193 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:40.740447 30892 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:40.687892   938 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:40.687434   834 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:40.710500   984 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:24:40.743466 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:40.765803 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 52683.1us
I20260709 12:24:40.765848 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:40.748577 30864 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:40.767638 30967 raft_consensus.cc:2368] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4.
I20260709 12:24:40.705992   958 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:40.754855 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 65676.9us
I20260709 12:24:40.737200   904 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.712085   942 raft_consensus.cc:697] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:40.779754 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.782326 31048 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:40.789712 30892 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:40.783229 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.790386 30970 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.689421   787 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:24:40.747361   832 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.764554   938 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.785632 30972 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:40.736673   835 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.798233 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.798822 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.798839 30892 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.742727   914 consensus_queue.cc:1059] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:24:40.799499 30973 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:40.774664   946 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.797412   867 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:40.785490   952 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:40.803467 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.802081 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:40.805497 31048 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.805919 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.806948 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.807878  1002 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:40.803746 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 92168.9us
I20260709 12:24:40.794047   832 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:40.809646 31587 leader_election.cc:336] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.876s (SENT)
I20260709 12:24:40.818041 30892 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:40.819190 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.810034 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:40.823580 30892 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
W20260709 12:24:40.824892   998 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:24:40.827773 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.832109 30973 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:40.831350   834 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:40.834563 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.836086 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.836659 30892 raft_consensus.cc:2376] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4. Re-sending same reply.
I20260709 12:24:40.837483 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.838049 30892 raft_consensus.cc:2376] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6. Re-sending same reply.
I20260709 12:24:40.839983 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.840095   991 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.823911   952 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:40.841789 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.842454 30892 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:40.841923   952 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.843127 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.843659 30892 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:40.844704 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:40.845511   995 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:40.845914   995 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:40.820494   832 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.856969 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.857718 30892 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:24:40.857784   997 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:24:40.858644 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 49021.5us
W20260709 12:24:40.859233 31587 leader_election.cc:336] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.096s (SENT)
I20260709 12:24:40.847096   835 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.859566 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:40.867983 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.866890 31048 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:40.846618   865 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:40.869486 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:40.879333 31048 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:40.881379 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.881930 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1599) took 1738 ms. Trace:
I20260709 12:24:40.883003 31624 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:40.884526 30970 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:40.885862   873 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.882279 30899 rpcz_store.cc:276] 0709 12:24:39.143091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.143573 (+   482us) service_pool.cc:224] Handling call
0709 12:24:40.881768 (+1738195us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002319d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:40.881876 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629635456}
W20260709 12:24:40.895607 30968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1584) took 2922 ms (client timeout 1861 ms). Trace:
W20260709 12:24:40.896070 30968 rpcz_store.cc:269] 0709 12:24:37.961247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.961362 (+   115us) service_pool.cc:224] Handling call
0709 12:24:40.883957 (+2922595us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400244d54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:40.884062 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685554560}
I20260709 12:24:40.896814 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.898445 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.899567 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.864830   965 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.900146 30899 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
W20260709 12:24:40.900110 31587 leader_election.cc:336] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.101s (SENT)
I20260709 12:24:40.903584 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:40.922290 30901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1605) took 1704 ms (client timeout 2019 ms). Trace:
W20260709 12:24:40.922803 30901 rpcz_store.cc:269] 0709 12:24:39.217719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.867666 (+1649947us) service_pool.cc:224] Handling call
0709 12:24:40.922214 (+ 54548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.944584   865 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.877031   991 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.883412   783 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.883260 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.950987 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:40.824784   942 consensus_queue.cc:237] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:40.962881 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.971710 30901 raft_consensus.cc:2368] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 5. Current term is 6.
I20260709 12:24:40.972558 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:40.973496 30901 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.972476 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.901553   926 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:40.992046 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:40.992961 30899 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 3: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:40.994092 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.996728 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:40.961628   783 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:41.001030 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 100934us
W20260709 12:24:41.001757 31587 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.150s (SENT)
W20260709 12:24:41.003692 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.006513 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.009934 30892 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:41.011132 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:41.012091  1001 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:41.012626  1001 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:41.004668   783 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:41.014278 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.014724 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 243041us
I20260709 12:24:41.015453 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:41.016326 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.016857 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:41.021829 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:41.031010 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:41.025630 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.012799  1007 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:24:41.027410 31587 leader_election.cc:336] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.166s (SENT)
I20260709 12:24:41.038596 31587 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:41.037851 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:41.040870 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.050216 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:41.051585 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:41.022075   965 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.014003   926 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:41.055377 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.056684 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1580) took 3096 ms. Trace:
I20260709 12:24:41.009131 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 460) took 2554 ms. Trace:
I20260709 12:24:41.058229 30975 rpcz_store.cc:276] 0709 12:24:37.960161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.962133 (+  1972us) service_pool.cc:224] Handling call
0709 12:24:38.199704 (+237571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:38.200334 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.056488 (+2856154us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b540008b950. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:41.056629 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513538816}
I20260709 12:24:41.058936 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:41.059815 30973 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:41.060230 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 1952) took 1034 ms. Trace:
I20260709 12:24:41.060751 30973 rpcz_store.cc:276] 0709 12:24:40.026078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.049687 (+1023609us) service_pool.cc:224] Handling call
0709 12:24:41.060173 (+ 10486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:40.970993   867 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:41.063602 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.083173 30901 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:41.084478 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.085175 30901 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:41.058192 30899 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
W20260709 12:24:41.065845 31013 connection.cc:256] RPC call timeout handler was delayed by -2.5469062149995807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 12:24:41.068089 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.090234 30892 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:41.068545 31587 leader_election.cc:336] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.218s (SENT)
I20260709 12:24:41.091133 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:41.092866   977 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:41.062361   536 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:41.062497 31042 rpcz_store.cc:276] 0709 12:24:38.452060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.453076 (+  1016us) service_pool.cc:224] Handling call
0709 12:24:38.499167 (+ 46091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.536253 (+ 37086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.538225 (+  1972us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.634555 (+ 96330us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.539068 (+1904513us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f032d5230ac 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b
0709 12:24:40.742043 (+202975us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:40.900708 (+158665us) log.cc:844] Serialized 14 byte log entry
0709 12:24:40.962113 (+ 61405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.982147 (+ 20034us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:40.992176 (+ 10029us) raft_consensus.cc:1685] finished
0709 12:24:40.996009 (+  3833us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.006064 (+ 10055us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283207,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":27379,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":19906,"spinlock_wait_cycles":104652544,"thread_start_us":1955136,"threads_started":2,"wal-append.queue_time_us":1914516}
I20260709 12:24:41.095991  1010 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:41.068022   926 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.096545  1010 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:41.128994 31013 connection.cc:256] RPC call timeout handler was delayed by -2.4542062149998856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 12:24:41.129441 31013 connection.cc:256] RPC call timeout handler was delayed by -2.450829750000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 12:24:41.129745 31013 connection.cc:256] RPC call timeout handler was delayed by -2.3993062149997968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:24:41.130105 31013 connection.cc:256] RPC call timeout handler was delayed by -2.3939062149997881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 12:24:41.057780   871 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.067682 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:41.097860   965 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:41.095671 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:41.146957 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:41.147090 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:41.149652 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 81130.5us
I20260709 12:24:41.146981 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:41.150370 31587 leader_election.cc:336] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.245s (SENT)
I20260709 12:24:41.150817 31587 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:41.151027 30892 raft_consensus.cc:2410] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:41.098749   977 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:41.152730 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.126081   991 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.150303 30899 raft_consensus.cc:2368] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:41.155539 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1611) took 1133 ms. Trace:
I20260709 12:24:41.156003 30901 rpcz_store.cc:276] 0709 12:24:40.021964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.131367 (+1109403us) service_pool.cc:224] Handling call
0709 12:24:41.155468 (+ 24101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:41.157017 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.162470 31044 raft_consensus.cc:1240] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:41.164812 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:41.165575 30892 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:41.166250 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.166949 30901 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 3.
I20260709 12:24:41.167448 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 441) took 1013 ms. Trace:
I20260709 12:24:41.167846 30901 rpcz_store.cc:276] 0709 12:24:40.153704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.165993 (+1012289us) service_pool.cc:224] Handling call
0709 12:24:41.167396 (+  1403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:41.168712 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:41.168856 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.169888 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:41.170755 30892 raft_consensus.cc:2376] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4. Re-sending same reply.
I20260709 12:24:41.171501 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.174268 30892 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:41.152005   940 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:41.180756 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:41.181475 30899 raft_consensus.cc:2368] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 5. Current term is 6.
I20260709 12:24:41.179513 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.148211 31043 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:41.092561  1001 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:41.154166   977 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:41.855744   783 consensus_meta.cc:287] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.002s
I20260709 12:24:41.856225   783 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.857481 30968 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:41.859241   783 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:41.599434 30939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.012s
W20260709 12:24:41.865018 30939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.013s	sys 0.015s
W20260709 12:24:41.865351 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 813786us
I20260709 12:24:41.866520 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:41.209638 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 59312.9us
W20260709 12:24:41.447687 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.580258 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.806529 31050 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.011s	sys 0.019s
W20260709 12:24:41.869208 31050 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.012s	sys 0.019s
W20260709 12:24:41.805720   952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.033s	sys 0.043s
W20260709 12:24:41.867447 31587 connection.cc:256] RPC call timeout handler was delayed by -1.3592396330004703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:24:41.492599 31048 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.016s	sys 0.014s
I20260709 12:24:41.159973   981 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:41.854338   832 consensus_meta.cc:287] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.989s	user 0.007s	sys 0.004s
I20260709 12:24:41.182945 30892 raft_consensus.cc:2410] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:24:41.233781 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.883055 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.883479 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.886528 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:41.887266 30892 raft_consensus.cc:2368] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:41.887632 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 458) took 1092 ms. Trace:
W20260709 12:24:41.860031 30897 consensus_meta.cc:287] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 1.094s	user 0.009s	sys 0.005s
I20260709 12:24:41.851373 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.223474   871 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.183586   940 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:41.871237 31048 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.017s	sys 0.023s
W20260709 12:24:41.497304   834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.020s
W20260709 12:24:41.253363   514 consensus_meta.cc:287] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.005s
W20260709 12:24:41.536298   951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.915s	user 0.014s	sys 0.023s
W20260709 12:24:41.601444   938 consensus_meta.cc:287] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.800s	user 0.009s	sys 0.000s
W20260709 12:24:41.699999  1015 log.cc:927] Time spent T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:24:41.167595   926 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:41.888856 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 442) took 1432 ms. Trace:
I20260709 12:24:41.925931 30899 rpcz_store.cc:276] 0709 12:24:40.456725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.182001 (+725276us) service_pool.cc:224] Handling call
0709 12:24:41.888795 (+706794us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:41.394588 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.907581   834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.001s	sys 0.032s
W20260709 12:24:41.651641   868 consensus_meta.cc:287] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 1.059s	user 0.003s	sys 0.007s
I20260709 12:24:41.887943 30892 rpcz_store.cc:276] 0709 12:24:40.794806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.886284 (+1091478us) service_pool.cc:224] Handling call
0709 12:24:41.887583 (+  1299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:41.201095  1002 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:41.232158  1008 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:41.870502   952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.034s	sys 0.043s
I20260709 12:24:41.896288 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:41.897948 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:41.231868   965 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.898818 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:41.899698   871 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.942520   871 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:41.900959   948 log.cc:927] Time spent T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 2.278s	user 0.010s	sys 0.023s
I20260709 12:24:41.903100   554 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.944053   554 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.946938   554 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:41.905061   775 raft_consensus.cc:3055] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:41.947479   775 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:41.948376   775 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.949715   775 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:41.924171 31013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.000s	sys 0.027s
W20260709 12:24:41.951934 31013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.000s	sys 0.027s
W20260709 12:24:41.952401 31013 connection.cc:256] RPC call timeout handler was delayed by -2.3408062149997022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 12:24:41.952750 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.953013 31013 connection.cc:256] RPC call timeout handler was delayed by -2.2814236320000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:24:41.953281 31013 connection.cc:256] RPC call timeout handler was delayed by -2.2481062149995523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:24:41.953531 31013 connection.cc:256] RPC call timeout handler was delayed by -2.2220062149999649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:24:41.954069 31013 connection.cc:256] RPC call timeout handler was delayed by -2.1143208540001979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:24:41.954381 31013 connection.cc:256] RPC call timeout handler was delayed by -1.9583062149995385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2338s for a response
W20260709 12:24:41.954638 31013 connection.cc:256] RPC call timeout handler was delayed by -1.9338440569999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 12:24:41.954896 31013 connection.cc:256] RPC call timeout handler was delayed by -1.9169062149999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2384s for a response
W20260709 12:24:41.955156 31013 connection.cc:256] RPC call timeout handler was delayed by -1.9114929770003073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 12:24:41.955410 31013 connection.cc:256] RPC call timeout handler was delayed by -1.8673707939997257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 12:24:41.926249 30942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.030s	sys 0.011s
W20260709 12:24:41.927280 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.955886 30942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.030s	sys 0.011s
I20260709 12:24:41.884702 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:41.285123   865 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.957221   865 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.895011   940 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:41.932236 30975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.016s	sys 0.036s
W20260709 12:24:41.958251 30975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.016s	sys 0.036s
I20260709 12:24:41.890993 30897 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:41.909549   783 raft_consensus.cc:2764] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:41.958622 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:41.955663 31013 connection.cc:256] RPC call timeout handler was delayed by -1.7837848259996463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3896s for a response
I20260709 12:24:41.960594 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:41.925199   951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.301s	user 0.018s	sys 0.032s
W20260709 12:24:41.965147 31013 connection.cc:256] RPC call timeout handler was delayed by -1.7544911410000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 12:24:41.964824 30892 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:42.013062 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1607) took 1992 ms. Trace:
I20260709 12:24:42.013391 30892 rpcz_store.cc:276] 0709 12:24:40.021084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.960315 (+1939231us) service_pool.cc:224] Handling call
0709 12:24:42.013004 (+ 52689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.014247 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:41.930902  1026 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:41.978662 30973 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:41.913918   514 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.927037   938 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.962914   834 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.988373 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:41.979182  1002 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:41.992684   928 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:41.993680 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:41.994493   865 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:41.983438   904 consensus_meta.cc:287] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 1.189s	user 0.010s	sys 0.003s
I20260709 12:24:41.984886   977 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:41.928507  1010 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:41.967875 30897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1616) took 1943 ms (client timeout 1771 ms). Trace:
I20260709 12:24:42.003249   971 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.893432   832 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:41.967365 30899 raft_consensus.cc:2393] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:24:42.015136 31013 connection.cc:256] RPC call timeout handler was delayed by -1.7253507569998874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 12:24:42.008921   838 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:42.017524 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 467) took 1009 ms. Trace:
I20260709 12:24:42.090723 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 462) took 1263 ms. Trace:
I20260709 12:24:42.090952 30892 rpcz_store.cc:276] 0709 12:24:41.008143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.014002 (+1005859us) service_pool.cc:224] Handling call
0709 12:24:42.017467 (+  3465us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.019038 30865 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.025s	sys 0.027s
W20260709 12:24:42.091969 30865 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.025s	sys 0.027s
W20260709 12:24:42.092476 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 991293us
I20260709 12:24:42.091172 30899 rpcz_store.cc:276] 0709 12:24:40.826857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.926738 (+1099881us) service_pool.cc:224] Handling call
0709 12:24:42.090658 (+163920us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.093948 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.079624 30901 raft_consensus.cc:2368] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5.
I20260709 12:24:42.072928 30896 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
W20260709 12:24:42.079192 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 208440us
W20260709 12:24:42.090646 31013 connection.cc:256] RPC call timeout handler was delayed by -1.65494326299995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:24:42.094836 30896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1903) took 2199 ms (client timeout 2110 ms). Trace:
W20260709 12:24:42.094954 31587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.805s (SENT) [suppressed 33 similar messages]
W20260709 12:24:42.095103 31013 connection.cc:256] RPC call timeout handler was delayed by -1.6200362439999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260709 12:24:42.082849 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1968) took 1273 ms. Trace:
W20260709 12:24:42.095595 31013 connection.cc:256] RPC call timeout handler was delayed by -1.5165362439997807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
W20260709 12:24:42.095945 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2530396330002986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:24:42.096236 31013 connection.cc:256] RPC call timeout handler was delayed by -1.492137565000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 12:24:42.096899 31013 connection.cc:256] RPC call timeout handler was delayed by -1.4390043739999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 12:24:42.097205 31013 connection.cc:256] RPC call timeout handler was delayed by -1.2072750480001559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:24:42.097471 31013 connection.cc:256] RPC call timeout handler was delayed by -1.1568954290000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 12:24:42.097724 31013 connection.cc:256] RPC call timeout handler was delayed by -1.0384480359998634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31760000000000005s for a response
W20260709 12:24:42.095440 30896 rpcz_store.cc:269] 0709 12:24:39.895109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.993361 (+2098252us) service_pool.cc:224] Handling call
0709 12:24:42.094768 (+101407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.079685 31043 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.096057 31048 rpcz_store.cc:276] 0709 12:24:40.809294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.879997 (+ 70703us) service_pool.cc:224] Handling call
0709 12:24:40.900015 (+ 20018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.900207 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:41.908971 (+1008764us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.082508 (+173537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.082557 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.082609 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.082669 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.082790 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":195413,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":5633,"raft.queue_time_us":6133,"thread_start_us":1166549,"threads_started":2}
I20260709 12:24:42.113004 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.113847 30892 raft_consensus.cc:2410] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:42.117623 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1612) took 2095 ms. Trace:
I20260709 12:24:42.118003 30892 rpcz_store.cc:276] 0709 12:24:40.022180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.112454 (+2090274us) service_pool.cc:224] Handling call
0709 12:24:42.117564 (+  5110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.119396 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1916) took 2065 ms. Trace:
I20260709 12:24:42.119767 30892 rpcz_store.cc:276] 0709 12:24:40.054191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.118626 (+2064435us) service_pool.cc:224] Handling call
0709 12:24:42.118933 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.119098 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.119123 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.119163 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.119199 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.119251 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.119346 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.122555 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 256080us
I20260709 12:24:42.122946 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1912) took 2149 ms. Trace:
I20260709 12:24:42.124747 30899 rpcz_store.cc:276] 0709 12:24:39.973693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.094378 (+2120685us) service_pool.cc:224] Handling call
0709 12:24:42.122453 (+ 28075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.122628 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.122653 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.122694 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:42.122729 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.122779 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.122891 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.126184 30899 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.126659 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 438) took 2065 ms. Trace:
I20260709 12:24:42.039649  1026 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.128876  1026 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.126920 30899 rpcz_store.cc:276] 0709 12:24:40.061259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.125739 (+2064480us) service_pool.cc:224] Handling call
0709 12:24:42.126040 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.126466 (+   426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.126612 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.130640 30899 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:42.131244 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 439) took 2039 ms. Trace:
I20260709 12:24:42.131865   991 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.132413   991 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.132732 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.134748   991 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:42.135149   981 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.135715 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:42.138042 31048 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.137164 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1617) took 2113 ms. Trace:
I20260709 12:24:42.138753 30896 rpcz_store.cc:276] 0709 12:24:40.023316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.116979 (+2093663us) service_pool.cc:224] Handling call
0709 12:24:42.136667 (+ 19688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.136848 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.136872 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.136911 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:42.136956 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.137014 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.137109 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.088091 30897 rpcz_store.cc:269] 0709 12:24:40.023080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.133953 (+110873us) service_pool.cc:224] Handling call
0709 12:24:41.966299 (+1832346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.146914 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1909) took 2199 ms. Trace:
I20260709 12:24:42.131573 30899 rpcz_store.cc:276] 0709 12:24:40.091610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.130096 (+2038486us) service_pool.cc:224] Handling call
0709 12:24:42.130420 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.131020 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.131198 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.147286 30894 rpcz_store.cc:276] 0709 12:24:39.947339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.947451 (+   112us) service_pool.cc:224] Handling call
0709 12:24:39.947749 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.586923 (+639174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.146673 (+1559750us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400195854. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.146854 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468688128}
I20260709 12:24:42.148566 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1967) took 1378 ms. Trace:
I20260709 12:24:42.082571   904 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.152010 30896 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.152637 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 440) took 2046 ms. Trace:
I20260709 12:24:42.152952 30896 rpcz_store.cc:276] 0709 12:24:40.106529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.139640 (+2033111us) service_pool.cc:224] Handling call
0709 12:24:42.150596 (+ 10956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.152408 (+  1812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.152583 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.102336   971 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.158043 30894 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:42.148973 31050 rpcz_store.cc:276] 0709 12:24:40.770678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.835325 (+ 64647us) service_pool.cc:224] Handling call
0709 12:24:40.853661 (+ 18336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.853874 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:41.869648 (+1015774us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.148236 (+278588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.148290 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.148344 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.148410 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.148512 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214916,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":487,"thread_start_us":1255456,"threads_started":2}
I20260709 12:24:42.089687   940 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:42.162961 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 62109.1us
I20260709 12:24:42.166303  1027 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:42.167207  1027 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:42.167757   739 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.168850   739 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.171908 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:42.172204  1022 log.cc:927] Time spent T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:42.172871   663 consensus_queue.cc:1059] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:42.174790 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:42.176709 30898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1913) took 2201 ms (client timeout 2142 ms). Trace:
I20260709 12:24:42.178087 30896 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:42.178642 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 465) took 1254 ms. Trace:
I20260709 12:24:42.178915 30896 rpcz_store.cc:276] 0709 12:24:40.924106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.156628 (+1232522us) service_pool.cc:224] Handling call
0709 12:24:42.177792 (+ 21164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.178414 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.178583 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.161509 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 443) took 1645 ms. Trace:
I20260709 12:24:42.179942 30894 rpcz_store.cc:276] 0709 12:24:40.518002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.148899 (+1630897us) service_pool.cc:224] Handling call
0709 12:24:42.157862 (+  8963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.161246 (+  3384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.161444 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.175578 31046 raft_consensus.cc:2410] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:42.184847 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:42.185252 31013 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.684s (SENT)
W20260709 12:24:42.177122 30898 rpcz_store.cc:269] 0709 12:24:39.975140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.648517 (+673377us) service_pool.cc:224] Handling call
0709 12:24:42.176518 (+1528001us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54003ed0d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.176639 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62576512}
I20260709 12:24:42.175902   783 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:42.188697   926 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:42.189098   926 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:42.189894   926 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.191028   926 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:42.192528 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 79734us
I20260709 12:24:42.185560 31050 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:42.194521 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1999) took 1161 ms. Trace:
W20260709 12:24:42.195230 31046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1979) took 2230 ms (client timeout 2260 ms). Trace:
I20260709 12:24:42.194907 31050 rpcz_store.cc:276] 0709 12:24:41.033493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.161462 (+1127969us) service_pool.cc:224] Handling call
0709 12:24:42.194377 (+ 32915us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.195636 31046 rpcz_store.cc:269] 0709 12:24:39.957663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.957770 (+   107us) service_pool.cc:224] Handling call
0709 12:24:42.174636 (+2216866us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:42.188174 (+ 13538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11088128}
W20260709 12:24:42.194547 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 67879.6us
I20260709 12:24:42.199635 31587 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.201640 31048 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:42.202536 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2001) took 1168 ms. Trace:
I20260709 12:24:42.202943 31048 rpcz_store.cc:276] 0709 12:24:41.033941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.114984 (+1081043us) service_pool.cc:224] Handling call
0709 12:24:42.202439 (+ 87455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.205214 31046 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:42.203965 31587 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:42.210019 31013 leader_election.cc:336] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.848s (SENT)
I20260709 12:24:42.143611   981 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.213466 31013 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.213868 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:42.177008  1028 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.222097 31046 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.197331   783 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:42.233891   867 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.211696   991 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.236997 31046 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
W20260709 12:24:42.239840 31587 leader_election.cc:336] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.907s (SENT)
W20260709 12:24:42.241235 31013 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.854s (SENT)
I20260709 12:24:42.227413   871 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.241693 31013 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.242937 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:42.238298   514 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.256781  1043 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.265234 31076 heartbeater.cc:646] Failed to heartbeat to 127.29.9.62:46357 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.29.9.62:46357 timed out after 15.000s (SENT)
W20260709 12:24:42.271437 31013 leader_election.cc:336] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.913s (SENT)
W20260709 12:24:42.272689 31013 leader_election.cc:336] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.976s (SENT)
I20260709 12:24:42.248654   977 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.249848   867 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:42.287698  1036 log.cc:927] Time spent T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:24:42.290234 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.291055   793 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.292299 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 427) took 2470 ms. Trace:
I20260709 12:24:42.278401   834 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.292678 30976 rpcz_store.cc:276] 0709 12:24:39.821658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.826311 (+  4653us) service_pool.cc:224] Handling call
0709 12:24:39.826607 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.439382 (+612775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.292055 (+1852673us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540016add4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.292244 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331256576}
I20260709 12:24:42.292956   834 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.294044 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.294620 30976 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:42.296027   832 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:42.279254   971 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:42.282374   904 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:42.283001  1044 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.301542   739 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.285763 30939 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:42.295544 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:42.302490 30976 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.302933 30939 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.305362 30967 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
W20260709 12:24:42.302850 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.275676 31013 leader_election.cc:336] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.045s (SENT)
I20260709 12:24:42.317070 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:42.320616 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:24:42.321316 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.322190 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.302050   739 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.321379   793 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:42.324643   830 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:42.326032   830 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:42.326440   830 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.326658 31043 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:42.327312 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2002) took 1293 ms. Trace:
I20260709 12:24:42.327629 31043 rpcz_store.cc:276] 0709 12:24:41.034155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.987996 (+953841us) service_pool.cc:224] Handling call
0709 12:24:42.327252 (+339256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.329023 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:42.330123 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:42.331094 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:42.332160 30971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1587) took 4370 ms (client timeout 1993 ms). Trace:
W20260709 12:24:42.332572 30971 rpcz_store.cc:269] 0709 12:24:37.962002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.962088 (+    86us) service_pool.cc:224] Handling call
0709 12:24:42.331957 (+4369869us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540011a8d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.332080 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2856503552}
I20260709 12:24:42.333968  1028 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:42.334369  1028 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:42.334738  1028 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.335796   965 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.336258   965 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.337090   793 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:42.337546   793 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.339043   965 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:42.278491   940 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.340449   834 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.341080 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1579) took 4228 ms. Trace:
I20260709 12:24:42.341756 30892 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:24:42.333709 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.341439 30900 rpcz_store.cc:276] 0709 12:24:38.112745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.135939 (+ 23194us) service_pool.cc:224] Handling call
0709 12:24:38.150621 (+ 14682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.386583 (+1235962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.340844 (+2954261us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003ec6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.341024 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548746496}
I20260709 12:24:42.353523 30971 raft_consensus.cc:2410] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:24:42.358232 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 82570.7us
W20260709 12:24:42.359040 31013 leader_election.cc:336] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.065s (SENT)
I20260709 12:24:42.359465 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.317675   971 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.323820   977 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:42.319995   783 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.257608  1043 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.327571   739 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.366304 30976 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:42.365267 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1918) took 1861 ms. Trace:
W20260709 12:24:42.375348 31013 leader_election.cc:336] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.104s (SENT)
W20260709 12:24:42.376530   985 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.604s	user 0.029s	sys 0.011s
W20260709 12:24:42.377645 30942 leader_election.cc:336] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.739s (SENT)
I20260709 12:24:42.360320   840 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.341449   981 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:42.380084 30976 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:42.380280 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.386369 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1949) took 2428 ms. Trace:
I20260709 12:24:42.382467   868 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:42.383121   928 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.390758   928 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.391372   793 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.392781   928 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.394243   793 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:42.378778 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.396356 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.381072 30899 rpcz_store.cc:276] 0709 12:24:40.503705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.148111 (+1644406us) service_pool.cc:224] Handling call
0709 12:24:42.159132 (+ 11021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.159336 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:42.238819 (+ 79483us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.363775 (+124956us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.364930 (+  1155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.364982 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.365034 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.365100 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.365214 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131286,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":162,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7285,"thread_start_us":175932,"threads_started":2}
I20260709 12:24:42.336766   775 consensus_queue.cc:1059] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:42.386729 30976 rpcz_store.cc:276] 0709 12:24:39.958227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.379473 (+2421246us) service_pool.cc:224] Handling call
0709 12:24:42.379787 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.386138 (+  6351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.386319 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.398491 30976 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:42.387264 31013 leader_election.cc:336] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.246s (SENT)
I20260709 12:24:42.368091 31043 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.389886   830 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:42.383874 30867 connection.cc:256] RPC call timeout handler was delayed by -1.7926756249999016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 12:24:42.417291 30867 connection.cc:256] RPC call timeout handler was delayed by -1.7674756249998609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 12:24:42.417680 30867 connection.cc:256] RPC call timeout handler was delayed by -1.6315756249996411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 12:24:42.417949 30867 connection.cc:256] RPC call timeout handler was delayed by -1.6207756249996237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 12:24:42.418210 30867 connection.cc:256] RPC call timeout handler was delayed by -1.588375625000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:24:42.418476 30867 connection.cc:256] RPC call timeout handler was delayed by -1.5469756249999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260709 12:24:42.418735 30867 connection.cc:256] RPC call timeout handler was delayed by -1.4200756249997539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:24:42.418987 30867 connection.cc:256] RPC call timeout handler was delayed by -1.3246756250000544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:24:42.419241 30867 connection.cc:256] RPC call timeout handler was delayed by -1.1887756249998347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 12:24:42.419508 30867 connection.cc:256] RPC call timeout handler was delayed by -1.1554756249997808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:24:42.419801 30867 connection.cc:256] RPC call timeout handler was delayed by -1.1428756249997605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260709 12:24:42.396924  1043 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:42.373860  1023 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:42.401121 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.424389 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:42.427276 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.427340 31048 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:42.429023 31048 pending_rounds.cc:85] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 5
I20260709 12:24:42.429255 31048 pending_rounds.cc:107] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:42.429493 31048 raft_consensus.cc:2889] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:42.384907   985 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.616s	user 0.029s	sys 0.011s
W20260709 12:24:42.412883 31013 leader_election.cc:336] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.338s (SENT)
I20260709 12:24:42.400419 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1950) took 2442 ms. Trace:
I20260709 12:24:42.435026 30976 rpcz_store.cc:276] 0709 12:24:39.958458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.398051 (+2439593us) service_pool.cc:224] Handling call
0709 12:24:42.398329 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.398839 (+   510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.400369 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.397573   775 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:42.432212 30867 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.436152 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:42.398653   739 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:42.441555 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:42.444871 30976 raft_consensus.cc:2376] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6. Re-sending same reply.
I20260709 12:24:42.442610 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:42.445758 31048 raft_consensus.cc:2376] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6. Re-sending same reply.
I20260709 12:24:42.444099 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.447933 30867 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.375975   971 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.450984 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.451277 30867 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.449851   928 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.453318 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:42.452777   838 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.399770   868 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.442004   775 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:42.464825 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 51995us
W20260709 12:24:42.472558 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.455232   840 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.453907   952 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:42.454798 30867 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:42.441895   972 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:42.497200 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:24:42.499536 31013 leader_election.cc:336] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.384s (SENT)
I20260709 12:24:42.506018 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:42.507879 31050 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:42.510560   972 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:42.511011   972 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:42.499423   838 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:42.516636 31013 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.788s (SENT)
I20260709 12:24:42.517103 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.497947   952 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.494701 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 469) took 1483 ms. Trace:
W20260709 12:24:42.524255 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.511373   972 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.587793 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.610024 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.610534 30971 raft_consensus.cc:2376] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7. Re-sending same reply.
I20260709 12:24:42.611287 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.540745   775 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.612350 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.552994   840 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.612583   775 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.589885 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1960) took 1951 ms. Trace:
I20260709 12:24:42.524452   838 raft_consensus.cc:697] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:42.587908   830 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:42.592918 30969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 1965) took 2130 ms (client timeout 2350 ms). Trace:
I20260709 12:24:42.597501 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1948) took 2639 ms. Trace:
I20260709 12:24:42.600950  1028 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.602165 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.541292   952 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:42.603976 30972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1596) took 2785 ms (client timeout 1774 ms). Trace:
I20260709 12:24:42.621714 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:42.605007 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1599) took 2672 ms. Trace:
I20260709 12:24:42.627492 30893 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:42.605775 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 1984) took 2646 ms. Trace:
W20260709 12:24:42.629395 30893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 1904) took 2722 ms (client timeout 2826 ms). Trace:
W20260709 12:24:42.624291 30969 rpcz_store.cc:269] 0709 12:24:40.462144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.849124 (+386980us) service_pool.cc:224] Handling call
0709 12:24:42.592724 (+1743600us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001ba3d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.592859 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200275840}
W20260709 12:24:42.628638 30972 rpcz_store.cc:269] 0709 12:24:39.818356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.828111 (+  9755us) service_pool.cc:224] Handling call
0709 12:24:42.603713 (+2775602us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b540016bcd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.603883 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096657664}
I20260709 12:24:42.630657 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.628983 30975 rpcz_store.cc:276] 0709 12:24:39.932098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.059401 (+1127303us) service_pool.cc:224] Handling call
0709 12:24:41.059700 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.097009 (+ 37309us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:41.097273 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:24:41.963533 (+866260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:41.963582 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:41.963631 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.604782 (+641151us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b540016b7d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.604827 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.604946 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4850,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":14849,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"spinlock_wait_cycles":85189504,"thread_start_us":861058,"threads_started":1,"wal-append.queue_time_us":981774}
I20260709 12:24:42.606878   995 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:42.608333 30901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 460) took 1782 ms (client timeout 2190 ms). Trace:
W20260709 12:24:42.608809 30942 leader_election.cc:336] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.888s (SENT)
W20260709 12:24:42.632933 30901 rpcz_store.cc:269] 0709 12:24:40.826233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.168489 (+342256us) service_pool.cc:224] Handling call
0709 12:24:42.608168 (+1439679us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54002319d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.608280 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093231744}
W20260709 12:24:42.539666 31013 leader_election.cc:336] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 3.176s (SENT)
W20260709 12:24:42.629839 30893 rpcz_store.cc:269] 0709 12:24:39.906661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.539010 (+2632349us) service_pool.cc:224] Handling call
0709 12:24:42.629331 (+ 90321us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.616366 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 119207us
I20260709 12:24:42.632162 30969 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:42.634514 30867 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.634641 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 439) took 1923 ms. Trace:
I20260709 12:24:42.634749 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 440) took 1906 ms. Trace:
I20260709 12:24:42.613240 31044 rpcz_store.cc:276] 0709 12:24:40.638876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.727892 (+ 89016us) service_pool.cc:224] Handling call
0709 12:24:40.764564 (+ 36672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.162865 (+398301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.589624 (+1426759us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54002a5154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.589818 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914659584}
I20260709 12:24:42.635181 30969 rpcz_store.cc:276] 0709 12:24:40.728520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.631584 (+1903064us) service_pool.cc:224] Handling call
0709 12:24:42.631923 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.634518 (+  2595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.634702 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.625926 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.637058 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.637373 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.624470 30973 rpcz_store.cc:276] 0709 12:24:39.957990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.061497 (+1103507us) service_pool.cc:224] Handling call
0709 12:24:41.061789 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.018360 (+956571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.597272 (+578912us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400245754. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.597436 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083132160}
W20260709 12:24:42.637679 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.635046 30971 rpcz_store.cc:276] 0709 12:24:40.711276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.623408 (+1912132us) service_pool.cc:224] Handling call
0709 12:24:42.634179 (+ 10771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.634337 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.634362 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.634403 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.634440 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.634490 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.634590 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.623809 30865 leader_election.cc:336] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.135s (SENT)
W20260709 12:24:42.640159 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.640712 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.641315 30901 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:42.638768 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.642596 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.631659 31051 rpcz_store.cc:276] 0709 12:24:39.959339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.959456 (+   117us) service_pool.cc:224] Handling call
0709 12:24:42.338458 (+2379002us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:42.338678 (+   220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.361318 (+ 22640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.361349 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.379436 (+ 18087us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.448298 (+ 68862us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:42.448338 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.448421 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.605468 (+157047us) raft_consensus.cc:1685] finished
0709 12:24:42.605488 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.605717 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18741,"raft.queue_time_us":22499,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":12446,"spinlock_wait_cycles":7445632,"thread_start_us":51763,"threads_started":1,"wal-append.queue_time_us":102301}
I20260709 12:24:42.645195 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:42.647668 31013 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.648293 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.649175 30901 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:42.650550 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.651506 30901 raft_consensus.cc:2410] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:42.648581   830 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:42.653023 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:42.653474 30972 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.654074 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 441) took 1914 ms. Trace:
I20260709 12:24:42.654372 30972 rpcz_store.cc:276] 0709 12:24:40.739381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.644960 (+1905579us) service_pool.cc:224] Handling call
0709 12:24:42.653313 (+  8353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.653861 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.654024 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.636476   957 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:42.667514   957 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.669646   957 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.669838 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1917) took 2610 ms. Trace:
I20260709 12:24:42.671316 30898 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:42.675987   903 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:42.677385 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.678056 30893 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:42.655483 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:42.652980   830 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:42.662101 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.540632 30897 rpcz_store.cc:276] 0709 12:24:41.011056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.157000 (+1145944us) service_pool.cc:224] Handling call
0709 12:24:42.201045 (+ 44045us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:42.207245 (+  6200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.207279 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:42.207934 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 12:24:42.239116 (+ 31182us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:42.368297 (+129181us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.414740 (+ 46443us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.449497 (+ 34757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.454536 (+  5039us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.457162 (+  2626us) raft_consensus.cc:1685] finished
0709 12:24:42.457892 (+   730us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.473503 (+ 15611us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1248,"prepare.queue_time_us":103293,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":11329,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":3453,"spinlock_wait_cycles":7298688,"thread_start_us":136018,"threads_started":2,"wal-append.queue_time_us":67550}
I20260709 12:24:42.665657   875 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.642524   873 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:42.645183   947 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.642890   969 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:42.636363   980 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:42.679193 30901 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:42.680223 30865 leader_election.cc:336] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.044s (SENT)
I20260709 12:24:42.636190   867 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.683091 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.683231 30892 rpcz_store.cc:276] 0709 12:24:40.058974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.120807 (+2061833us) service_pool.cc:224] Handling call
0709 12:24:42.341522 (+220715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.342165 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.669651 (+327486us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003ec6d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.669779 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506861824}
W20260709 12:24:42.682943 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.664091   838 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.643981   995 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.719611 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:42.692811 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 452956us
I20260709 12:24:42.694177 30972 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:42.691120   830 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.696062 30896 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:42.696466 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:42.723579 30898 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.712247 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.724200 30892 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:42.696579 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:42.700235 31620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 814) took 3845 ms (client timeout 1552 ms). Trace:
I20260709 12:24:42.652426   971 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.710153 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.667081   938 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.650413   985 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:42.712931 31014 connection.cc:256] RPC call timeout handler was delayed by -1.396542590000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
I20260709 12:24:42.732419 30901 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:42.690075  1064 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.720603 31624 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.721581 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 442) took 1978 ms. Trace:
I20260709 12:24:42.736685 30972 rpcz_store.cc:276] 0709 12:24:40.743195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.655158 (+1911963us) service_pool.cc:224] Handling call
0709 12:24:42.693861 (+ 38703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.721294 (+ 27433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.721520 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.695822 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:42.722322 31587 leader_election.cc:336] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.072s (SENT)
I20260709 12:24:42.690395   683 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.725382 30892 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.727228 30900 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:42.724995 31620 rpcz_store.cc:269] 0709 12:24:38.855205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.855363 (+   158us) service_pool.cc:224] Handling call
0709 12:24:42.700005 (+3844642us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54004a1fd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.700158 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274693888}
I20260709 12:24:42.742507 30893 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:42.733911 30901 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:42.719563 30865 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:42.743391 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 203741us
I20260709 12:24:42.738619 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:42.744191 31621 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.740051 31622 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:42.745712 31013 leader_election.cc:336] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 3.963s (SENT)
I20260709 12:24:42.746434 30865 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:42.721066   969 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:42.747267 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:42.748169 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.753242 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:42.755183 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:42.749001 31587 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.748946 31623 raft_consensus.cc:2410] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:42.757866 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.757664   969 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.758450 31622 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:42.759032 30898 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:42.759307 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.759869  1066 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.760499 31622 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:42.763835 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.764418 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.765021 31620 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:42.741391   985 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.769791   985 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.770825  1028 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:42.739012   875 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.771479   875 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:42.773452   875 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:42.709615   873 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.775857   873 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.776551   972 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.764652 31619 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:42.773072   952 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:42.837916 30968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 1977) took 2102 ms (client timeout 2527 ms). Trace:
W20260709 12:24:42.838361 30968 rpcz_store.cc:269] 0709 12:24:40.735544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.961511 (+225967us) service_pool.cc:224] Handling call
0709 12:24:42.837715 (+1876204us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b5400247554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.837853 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983823104}
I20260709 12:24:42.839078 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:42.840281 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.769685 30967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 1973) took 2055 ms (client timeout 2044 ms). Trace:
I20260709 12:24:42.717183   947 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.781967 31621 raft_consensus.cc:2410] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:42.748353   971 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.787354 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:42.847972 31014 leader_election.cc:336] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.861s (SENT)
I20260709 12:24:42.788450 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 426) took 2967 ms. Trace:
W20260709 12:24:42.813516 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.824000 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.827622 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.720794   980 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.720669   867 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:42.841481 30967 rpcz_store.cc:269] 0709 12:24:40.714159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.806721 (+ 92562us) service_pool.cc:224] Handling call
0709 12:24:42.769517 (+1962796us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540008af54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.769616 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3423065472}
I20260709 12:24:42.779206  1064 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:42.873943 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.779570 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.879232 30970 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:42.781472 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:42.853449 31620 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:42.748705   683 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.855368 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:42.856096   972 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.857815   952 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.858155 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.858376 30899 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:42.851576 30972 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:42.848510 30974 rpcz_store.cc:276] 0709 12:24:39.821389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.821485 (+    96us) service_pool.cc:224] Handling call
0709 12:24:39.821742 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.589967 (+768225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.788206 (+2198239us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540008b454. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.788388 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765512064}
I20260709 12:24:42.841718 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:42.755910   953 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:42.868113 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 145822us
W20260709 12:24:42.912411 31587 leader_election.cc:336] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.190s (SENT)
I20260709 12:24:42.912880 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:42.871178 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.870677 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.874523 30967 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:42.875360 30942 leader_election.cc:336] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.996s (SENT)
I20260709 12:24:42.920711 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:42.921655 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 46328.1us
W20260709 12:24:42.922526 30942 leader_election.cc:336] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.075s (SENT)
I20260709 12:24:42.922905 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:42.842221   981 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.886147 31622 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.846971  1066 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.886354 30901 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.880993 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.889176 30892 raft_consensus.cc:2376] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6. Re-sending same reply.
I20260709 12:24:42.882413 31620 pending_rounds.cc:85] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 6
I20260709 12:24:42.928936 31620 pending_rounds.cc:107] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:24:42.929236 31620 raft_consensus.cc:2889] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:42.890111 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 142901us
I20260709 12:24:42.961210 30901 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:42.904258 30900 raft_consensus.cc:2376] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6. Re-sending same reply.
I20260709 12:24:42.987042 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.987699 31621 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
W20260709 12:24:42.988034 30970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 1951) took 2986 ms (client timeout 3183 ms). Trace:
W20260709 12:24:42.988417 30970 rpcz_store.cc:269] 0709 12:24:40.001762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.920999 (+919237us) service_pool.cc:224] Handling call
0709 12:24:42.987593 (+2066594us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400245c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.987978 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4381105024}
I20260709 12:24:42.989213 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.989455 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.989915 31623 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:42.989856   683 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:42.990491 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.991071 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:42.991631 30899 raft_consensus.cc:2376] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6. Re-sending same reply.
I20260709 12:24:42.992038 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:42.992441 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:42.993173 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.992961 30970 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:42.990761 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.907226 31616 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:42.905565 31045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 1993) took 2941 ms (client timeout 2021 ms). Trace:
I20260709 12:24:42.903941 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.910964 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:42.843546 31624 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:42.879854  1021 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.014354 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 103491us
I20260709 12:24:42.879012  1043 consensus_queue.cc:1059] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:24:42.912113   953 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.982558 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:42.971316   903 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:42.995247 30897 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:43.025544 30967 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:42.982601 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 62588.2us
I20260709 12:24:43.028330 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.029131 31047 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:42.976963   995 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.973686 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.983668 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:42.904495 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.030104 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.040766 30974 raft_consensus.cc:2410] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:43.041023 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.041613 31048 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.002352 31622 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:42.988591 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:42.911783   861 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:24:43.007135 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:42.964854   873 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:24:42.891180  1053 consensus_queue.cc:1059] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:24:42.976253   981 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:42.996404   952 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:24:42.975324 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1905) took 3041 ms. Trace:
I20260709 12:24:43.016320 31013 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.020475 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.021209 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.022507 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.033601 31044 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:43.034221   966 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:24:43.035661 31617 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.978062  1066 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.036338   554 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.034318 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.037762 31046 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:24:43.039036 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.972630 30865 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:42.965019   875 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:24:42.996131   865 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:24:43.013211 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.005848 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:43.164996 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 192432us
W20260709 12:24:43.091778 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.166481 31622 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:43.042930 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 177616us
I20260709 12:24:43.165511 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.091821 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.028510 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:43.168007 31046 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.076915 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.094487 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.169847 30895 rpcz_store.cc:276] 0709 12:24:39.933534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.933682 (+   148us) service_pool.cc:224] Handling call
0709 12:24:39.933987 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.127370 (+193383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.975071 (+2847701us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540014b4d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:42.975262 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443529984}
I20260709 12:24:43.148257 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.070214 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.078470 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.172874 30974 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:43.174657 30864 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:43.168678 30975 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:43.167694 31621 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:43.170836 30900 raft_consensus.cc:2376] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5. Re-sending same reply.
I20260709 12:24:43.082221 31048 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:43.172151 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:43.011993 31045 rpcz_store.cc:269] 0709 12:24:39.963702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.052281 (+ 88579us) service_pool.cc:224] Handling call
0709 12:24:42.905369 (+2853088us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54000aebd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:42.905490 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306944256}
I20260709 12:24:43.097107 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.169817 31047 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:43.167318 31624 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:43.170987 30892 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:43.031795 31043 consensus_meta.cc:287] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.584s	user 0.003s	sys 0.007s
I20260709 12:24:43.180471 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.179826   683 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:43.192797   783 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:43.192917 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.179548   554 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.193372   783 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:43.024293  1021 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.194739   783 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.196060 30973 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:43.196619   980 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:43.199128 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 170704us
I20260709 12:24:43.191015 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.200299 31044 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:43.200615 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.202210   830 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.202597   903 consensus_queue.cc:1059] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:43.203539   903 raft_consensus.cc:3055] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:43.024461  1069 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.203889   903 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:43.043509   938 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.161s
I20260709 12:24:43.204159   947 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:43.204798   903 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.205749   903 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.206836 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.207521   867 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:43.207978 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.208546 31048 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:43.208937   683 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:43.209702   972 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:43.209923  1075 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:43.211290 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:43.213380 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1972) took 2714 ms. Trace:
I20260709 12:24:43.174702  1044 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.215128  1068 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.223873 30976 rpcz_store.cc:276] 0709 12:24:40.499202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.451942 (+1952740us) service_pool.cc:224] Handling call
0709 12:24:42.452195 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.457305 (+  5110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.457335 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.457375 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:42.457407 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.213183 (+755776us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b54001e6ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:43.213225 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.213329 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11350272}
I20260709 12:24:43.015869  1028 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.173s
I20260709 12:24:43.091990  1070 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.195446   554 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:43.030666   953 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.177693 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:43.245895 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 68259us
I20260709 12:24:43.190104 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.224251 31623 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:43.224750 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.225322 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.247608 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.066212  1043 raft_consensus.cc:3055] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:43.213413 30864 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.229382 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.251030 30976 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:24:43.251350 30976 pending_rounds.cc:85] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 5
I20260709 12:24:43.251550 30976 pending_rounds.cc:107] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:24:43.251793 30976 raft_consensus.cc:2889] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:43.252360 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1980) took 1081 ms. Trace:
I20260709 12:24:43.252552 30976 rpcz_store.cc:276] 0709 12:24:42.171369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.250483 (+1079114us) service_pool.cc:224] Handling call
0709 12:24:43.250747 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.252185 (+  1438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.252321 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.228185 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.183699 30968 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
W20260709 12:24:43.182682 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 166430us
I20260709 12:24:43.208894 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:43.254739 30894 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.230664 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.229698 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:42.901782 30898 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:43.228121 31046 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:43.207652   868 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.222106 31043 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:43.233561 31044 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
W20260709 12:24:43.186313 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 309073us
I20260709 12:24:43.239239 30969 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.300347 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 443) took 1336 ms. Trace:
I20260709 12:24:43.300679 30969 rpcz_store.cc:276] 0709 12:24:41.964070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.238806 (+1274736us) service_pool.cc:224] Handling call
0709 12:24:43.239082 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.300125 (+ 61043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.300297 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.298898 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.239167 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:43.302886 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 63817.5us
I20260709 12:24:43.304518 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:43.305612 30939 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:43.237952   972 raft_consensus.cc:697] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:43.248656 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:43.257714 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44479.9us
I20260709 12:24:43.256233 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.259836 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:43.228050 31048 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:43.261345 30865 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:43.276225 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:43.279474 30975 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.282681 30968 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:43.275876   969 consensus_queue.cc:1059] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:24:43.257438   928 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.185119 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:43.312676 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 51385us
I20260709 12:24:43.312043 30898 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:43.312932 30900 raft_consensus.cc:2376] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7. Re-sending same reply.
I20260709 12:24:43.294986 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:43.285331   838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.040s	sys 0.064s
I20260709 12:24:43.295997 30974 raft_consensus.cc:1240] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:43.225399  1021 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.277480  1075 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.306864 30894 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:43.249804  1043 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:43.352341 31045 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
W20260709 12:24:43.313037 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.320657 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 60909us
I20260709 12:24:43.378185 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:43.350358 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44817.4us
I20260709 12:24:43.378968 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.380070 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:43.323091 31623 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:43.324977 31016 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.349858 31044 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:43.318543 30971 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:24:43.381292 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 56419.4us
I20260709 12:24:43.357416 30895 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:43.381424 30970 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.382287 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.358107 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 444) took 1393 ms. Trace:
I20260709 12:24:43.382887 30975 rpcz_store.cc:276] 0709 12:24:41.964381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.248791 (+1284410us) service_pool.cc:224] Handling call
0709 12:24:43.279237 (+ 30446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.357858 (+ 78621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.358050 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.260613   957 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 12:24:43.390424 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 478000us
I20260709 12:24:43.390785 30894 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:43.391161 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:43.391247 31587 leader_election.cc:336] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.657s (SENT)
W20260709 12:24:43.392336 31587 connection.cc:256] RPC call timeout handler was delayed by -1.927619519000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 12:24:43.392400 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.383818  1064 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:43.393754  1064 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.394549 31047 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:43.367573 30968 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:43.245031  1070 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.397390 30893 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:43.383030 31621 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:43.383682 30967 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:43.388366 30900 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:43.310535  1053 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.386844 30898 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:43.389129 31013 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:43.384261 30972 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:43.355650   838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.040s	sys 0.064s
I20260709 12:24:43.417699 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:43.354609 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 1975) took 1029 ms. Trace:
W20260709 12:24:43.387033 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.428355 31045 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:43.389988   873 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:43.433200 30896 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:43.358644  1023 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.355625   947 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:43.364377   969 consensus_queue.cc:1243] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer f868402d5ae640e7b362b9fddacbaf44 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:24:43.423535 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:43.384922   840 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.427927  1053 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.427397 31043 rpcz_store.cc:276] 0709 12:24:42.300028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.330876 (+ 30848us) service_pool.cc:224] Handling call
0709 12:24:43.328850 (+997974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.439275  1070 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.396353  1043 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.354080   683 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.362684   938 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.443836   965 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:43.368872   554 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:43.355818   995 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:43.396384   830 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.453411 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.430442  1028 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.450680 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.454082 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:43.429852   957 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.381774 31042 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:43.431398   867 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:43.437412  1023 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.414243   980 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:24:43.438098   770 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:24:43.497704 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 43745.6us
W20260709 12:24:43.450994 31618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.057s	sys 0.082s
W20260709 12:24:43.502877 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.486986 31042 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:43.502189 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:43.479118   938 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:43.457937   947 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:43.485286   972 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.458892   775 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.488734  1028 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:43.500310  1023 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.492363 30897 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:43.501353  1021 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:43.504429 31618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.063s	sys 0.088s
I20260709 12:24:43.486814   554 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:43.497974   981 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.502466  1043 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:43.519065 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 300634us
I20260709 12:24:43.508821   938 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.510213   995 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.511462  1028 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.540361 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.544612 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.545852 30867 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.505671   830 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:43.547981 30867 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:43.548897   952 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:43.549304   514 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.556541   969 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.556945  1078 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:43.538884   981 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.558600  1077 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.532646   775 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.563815 30976 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:24:43.581167 30976 pending_rounds.cc:85] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 4
I20260709 12:24:43.581444 30976 pending_rounds.cc:107] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:24:43.581688 30976 raft_consensus.cc:2889] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:43.534888  1021 raft_consensus.cc:697] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:43.500900   867 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.569438 30867 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.557700   947 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.543128   995 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.515990   783 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:24:43.568533   514 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:43.574666  1070 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:43.592634   775 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.579645  1068 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:43.574596   969 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:43.595048 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.568248  1075 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:24:43.604722   995 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.599402   952 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.543967 31042 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.607481   514 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.608071  1070 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:43.622579 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.613528   969 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.627139 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.585877   981 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.585440  1077 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.606426   832 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:24:43.599073   554 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:43.638154  1071 log.cc:927] Time spent T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:24:43.639451 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:43.625896  1070 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.621809   838 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.624987  1053 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.627687 31042 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.647817 31620 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:43.648654 31587 connection.cc:256] RPC call timeout handler was delayed by -1.266119518999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2885s for a response
W20260709 12:24:43.647605 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.651310 31622 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:43.628964   952 consensus_queue.cc:1059] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:24:43.684940 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 177409us
I20260709 12:24:43.656953 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:43.691552 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:43.693478 30900 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.655853  1053 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:43.696609 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 82189.9us
I20260709 12:24:43.700349   865 consensus_queue.cc:1059] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:43.700642 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:43.701181   865 raft_consensus.cc:3055] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.701402 30972 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:43.701601   865 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:43.702406   775 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:43.632889  1021 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.702688 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.703506 30967 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:24:43.684301   830 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.703882 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:43.704192   830 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:43.705140 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.703883  1053 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.709036 31621 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:43.711670 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:43.713318 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.714356 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.713353  1053 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.717772  1068 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:43.718683   969 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.706740  1076 raft_consensus.cc:3055] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:43.768043 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.768419 31050 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.720294 30867 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:43.771828 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:43.772330 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52112.8us
I20260709 12:24:43.725011 30900 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:43.708988  1086 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:43.732157   867 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:43.788087   972 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:43.788605   972 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:43.790153  1084 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 12:24:43.790586   972 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:43.791352 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.702442   865 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.741501   969 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:43.792810   865 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:43.795317  1081 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:24:43.796526 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1928) took 1110 ms. Trace:
I20260709 12:24:43.796903 30896 rpcz_store.cc:276] 0709 12:24:42.686354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.723940 (+ 37586us) service_pool.cc:224] Handling call
0709 12:24:42.738709 (+ 14769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.436648 (+697939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.796275 (+359627us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b540014a0d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:43.796465 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596754304}
I20260709 12:24:43.797645 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.798125 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.798772 30896 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:43.799098 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.696940  1075 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:24:43.737993  1066 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:43.731472  1068 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.749079   981 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.750495   938 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:43.807395 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.809279 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.841331 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:43.753477 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.757462 31042 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:43.760879 30893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1627) took 1006 ms. Trace:
I20260709 12:24:43.861938 30893 rpcz_store.cc:276] 0709 12:24:42.754179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.754315 (+   136us) service_pool.cc:224] Handling call
0709 12:24:43.005130 (+250815us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800002798. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:43.760636 (+755506us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003eb2d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:43.760809 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564123776}
I20260709 12:24:43.764526  1077 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.765019 31046 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.766501 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:43.730240   830 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:43.785140 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.785640 31013 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:43.785830 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.786432 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:43.896337 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 110794us
I20260709 12:24:43.896595 30898 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:43.897114 30900 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:43.897527 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.897993 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:43.787169 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 58094.8us
I20260709 12:24:43.899122 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.787652  1096 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:43.787887 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.792085 30894 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:24:43.745471 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.814214 30867 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:43.905385 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 91235.2us
I20260709 12:24:43.799643 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.907155 30867 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:43.768095  1076 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:43.909230 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.864167 31051 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:43.729348   903 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:43.786134   832 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.891549 31621 raft_consensus.cc:2376] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6. Re-sending same reply.
I20260709 12:24:43.912621 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.770380 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.809116 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:43.925251 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.926062 30971 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:43.911032  1086 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:43.936198 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.937479 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.938294 30967 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:43.939167 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.940814 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.916401 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.944262 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.944945 31621 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:43.945823 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:43.946625 30972 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:43.890496   957 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:43.811399   953 consensus_meta.cc:287] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 12:24:43.899824 30900 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:43.899497 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:43.908011   770 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.841876 31622 raft_consensus.cc:2376] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5. Re-sending same reply.
I20260709 12:24:43.801903   969 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.837896  1043 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.809329 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.909965 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.981277 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.981714 31048 raft_consensus.cc:2410] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:43.949047 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.941488 30894 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:43.943914  1086 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.959636 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:43.989573  1086 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.989800 31044 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:43.990834  1094 log.cc:927] Time spent T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.291s	user 0.000s	sys 0.003s
I20260709 12:24:43.993510 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:43.995404 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1975) took 3266 ms. Trace:
I20260709 12:24:43.995831 30973 rpcz_store.cc:276] 0709 12:24:40.728850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.641944 (+1913094us) service_pool.cc:224] Handling call
0709 12:24:42.987702 (+345758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.196417 (+208715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.801221 (+604804us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400245c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:43.995215 (+193994us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400245c50. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:43.995345 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250673920}
I20260709 12:24:43.997167  1086 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.998445 30893 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:44.000998  1086 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:44.004546  1082 log.cc:927] Time spent T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.380s	user 0.000s	sys 0.003s
I20260709 12:24:44.009039 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:44.010689 30970 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:24:43.961009 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 61588.8us
I20260709 12:24:43.894572 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.999655 30864 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:43.944104   965 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:43.908936   867 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:24:43.913945  1096 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:43.968180 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:43.859920  1023 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:43.969115 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.980343 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:44.021667 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.022224 31621 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:44.023891 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:43.943967   903 raft_consensus.cc:697] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:43.965103 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.040311 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.040840 31622 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.022961 31616 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:24:43.968530  1079 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 12:24:44.016726 30972 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:24:44.024272 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.023685 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:43.916172   928 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.034351 31049 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:43.968700  1092 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:44.048173 31622 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:44.034106 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.018323 31014 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.035534 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:44.065650 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.064491 30894 raft_consensus.cc:2410] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:44.063702 31588 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:43.893287 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.068478 31623 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:44.068575 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 291907us
I20260709 12:24:44.040025   713 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:43.965492   953 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.033826  1086 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:24:44.082755 30899 raft_consensus.cc:2368] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7.
I20260709 12:24:44.083889 31622 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:44.035059 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:44.067119 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 48868.1us
I20260709 12:24:43.965754   995 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.016541   832 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.084764 30898 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:44.091760 31014 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.074431 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.014122   969 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:44.076776 31587 leader_election.cc:336] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.179s (SENT)
I20260709 12:24:44.006283  1043 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.021325   775 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:44.021440   783 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:24:44.087085 30894 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.084895 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.087632 30900 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:24:44.112159 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.126544 31621 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:44.062595 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 839) took 1208 ms. Trace:
W20260709 12:24:44.130995 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 54236.9us
I20260709 12:24:44.020582 30864 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:44.082288   953 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.094233 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.034252   830 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:24:44.127115 30900 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:44.088201 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:44.041358   957 consensus_queue.cc:1059] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:24:44.082701 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.144419 31615 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:44.145339 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:44.145862  1089 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.444s	user 0.005s	sys 0.008s
I20260709 12:24:44.076557  1069 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:44.134718 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 114198us
I20260709 12:24:44.037685   965 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.082949  1077 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:44.126807 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:44.154839 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.155016 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 1981) took 1983 ms. Trace:
W20260709 12:24:44.155125 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 66993.8us
I20260709 12:24:44.033826  1076 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:44.152613 30942 leader_election.cc:336] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.247s (SENT)
I20260709 12:24:44.106276   770 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:44.131992 31587 leader_election.cc:336] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.885s (SENT)
I20260709 12:24:44.104159  1066 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:24:44.136981   903 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.154541 31622 raft_consensus.cc:2410] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:44.168045 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.129951 31619 rpcz_store.cc:276] 0709 12:24:42.853764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.163412 (+309648us) service_pool.cc:224] Handling call
0709 12:24:43.204894 (+ 41482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.205260 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.205290 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.205794 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.510121 (+304327us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:43.710265 (+200144us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.742408 (+ 32143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.742482 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.003967 (+261485us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:44.005940 (+  1973us) raft_consensus.cc:1685] finished
0709 12:24:44.039606 (+ 33666us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.045110 (+  5504us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29978,"prepare.queue_time_us":223907,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":67804,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":16944,"spinlock_wait_cycles":209088256,"thread_start_us":448527,"threads_started":2,"wal-append.queue_time_us":393433}
I20260709 12:24:44.142189 30894 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:44.146081 31615 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:44.156162 30942 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:44.162392  1028 consensus_meta.cc:287] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.002s
I20260709 12:24:44.157413 31587 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.159010 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.161321  1077 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.183509 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.179865  1076 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.185420 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.190287 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.192312 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.143258 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.192606 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:44.193293 31623 raft_consensus.cc:2410] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 6 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:24:44.164979 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 71555us
I20260709 12:24:44.034082  1093 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 12:24:44.083092  1090 consensus_queue.cc:1059] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:24:44.197067 31622 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:44.198511 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.199146 31622 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:44.200019 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.201179 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.201763 31622 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:44.174538 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.202811 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.151427   938 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:44.155366 30976 rpcz_store.cc:276] 0709 12:24:42.171624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.253002 (+1081378us) service_pool.cc:224] Handling call
0709 12:24:43.253197 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.582139 (+328942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.154795 (+572656us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54001e64d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:44.154962 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713499392}
I20260709 12:24:44.139103   867 consensus_queue.cc:1059] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:44.152613 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.135488  1070 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.210884 30893 raft_consensus.cc:1240] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:44.181545 30942 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.254s (SENT)
I20260709 12:24:44.137924   947 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.193176 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:44.232395 30894 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.150072 30864 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.174499   832 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:44.194458   770 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.179826  1092 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:44.204704   928 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.207499 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.215072 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:44.216152 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.216871 30942 leader_election.cc:336] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.537s (SENT)
W20260709 12:24:44.234303 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 84292.8us
W20260709 12:24:44.252976 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.181737   783 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.185400  1077 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:44.184669  1066 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.241274   867 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:44.242417 30967 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.242753   965 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:44.242961 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:44.243865 30973 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:44.244396 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:44.184461  1028 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:44.247534 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 115568us
W20260709 12:24:44.247391  1021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.018s	sys 0.012s
I20260709 12:24:44.246477   953 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.249538 30894 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:44.208793  1108 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:44.257089 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 244526us
I20260709 12:24:44.257732 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.278327 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:44.258992 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1637) took 1388 ms. Trace:
I20260709 12:24:44.218343 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.183820  1023 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:44.259791 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:44.266220 30970 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:44.256534   514 consensus_meta.cc:287] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.628s	user 0.000s	sys 0.009s
I20260709 12:24:44.278380 31622 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 3: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:44.279484 30892 rpcz_store.cc:276] 0709 12:24:42.871022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.184872 (+313850us) service_pool.cc:224] Handling call
0709 12:24:44.258825 (+1073953us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400195854. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:44.258940 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673761024}
I20260709 12:24:44.277741 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:44.247927 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 46404.4us
I20260709 12:24:44.257560  1070 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:44.265409  1107 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.286374  1107 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:44.288185  1097 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:24:44.289630  1098 log.cc:927] Time spent T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:24:44.276829  1021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.019s	sys 0.012s
I20260709 12:24:44.254812   832 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:44.267459  1096 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:44.298399 30894 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:44.302028 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:44.311849   995 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.312252 31616 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:44.313859  1106 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:44.314234   969 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.314435  1106 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:44.316120  1043 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:44.316355 31620 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:44.318336  1092 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.307946  1023 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 12:24:44.303227  1099 log.cc:927] Time spent T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 12:24:44.305702  1072 log.cc:927] Time spent T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.687s	user 0.007s	sys 0.000s
I20260709 12:24:44.307205 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1947) took 1068 ms. Trace:
W20260709 12:24:44.309497 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 57457.2us
W20260709 12:24:44.328260 30942 leader_election.cc:336] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.707s (SENT)
I20260709 12:24:44.261590   868 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:44.276202   770 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:24:44.278862 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:44.326903 31014 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.257089   783 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:44.329018 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.328848 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.328063 30895 rpcz_store.cc:276] 0709 12:24:43.238586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.382429 (+143843us) service_pool.cc:224] Handling call
0709 12:24:43.768608 (+386179us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:43.769002 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.769029 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:43.808287 (+ 39258us) log.cc:844] Serialized 52 byte log entry
0709 12:24:44.138668 (+330381us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:44.138705 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.138763 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.306023 (+167260us) raft_consensus.cc:1685] finished
0709 12:24:44.306042 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.306904 (+   862us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54003eb2d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:44.307138 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4,"raft.queue_time_us":410,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":26489,"spinlock_wait_cycles":887409536,"thread_start_us":330024,"threads_started":1,"wal-append.queue_time_us":383584}
I20260709 12:24:44.335304 30942 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:44.342221 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.299486  1113 raft_consensus.cc:3055] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:44.296542  1075 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:44.358502 30942 leader_election.cc:336] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.755s (SENT)
I20260709 12:24:44.360853  1116 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.290107   514 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.356096  1113 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:44.365181  1113 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.362497  1043 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:24:44.366324  1113 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:44.368274   865 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 12:24:44.369064 31617 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:24:44.370775 31617 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:44.371116 31617 pending_rounds.cc:85] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 5
I20260709 12:24:44.371328 31617 pending_rounds.cc:107] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:44.373608   783 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:44.376026 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.315407  1106 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.374353 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:44.371553 31617 raft_consensus.cc:2889] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:44.357360  1076 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:44.348701  1023 consensus_queue.cc:1059] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:24:44.404918 30942 leader_election.cc:336] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.767s (SENT)
I20260709 12:24:44.361935  1114 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:44.357995   770 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.407406 31617 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:44.409005 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 131206us
I20260709 12:24:44.311842   832 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.408636 30942 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:44.413090 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.421346 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:44.418057 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:44.423200 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.418763 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 91927.7us
I20260709 12:24:44.419776 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.425209 30900 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:44.425699 30865 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.409140  1114 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:44.430872 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:44.431595 30895 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:44.433557 31014 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.438042 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:44.443356 31050 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:44.447863 31051 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:44.448020  1023 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.421239   867 raft_consensus.cc:3055] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:44.448582   867 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:44.449540   867 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.450711   867 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.444938 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:44.452702 31014 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.453548  1131 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.454133 30894 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:44.456127 31051 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:44.456691 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:44.457082 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:44.457098 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:44.458901 31051 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.457249 31047 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:24:44.454829 31014 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:44.472299 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.476060  1139 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.428737  1116 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.467902   938 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.477213   903 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.485853  1111 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:44.482787  1021 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:44.483397   775 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:44.409369  1076 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.430027  1064 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.429905  1070 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.455408   953 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:24:44.507061 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 146858us
I20260709 12:24:44.466445   995 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.482275 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:44.530944 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 89436.4us
I20260709 12:24:44.445624   947 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:24:44.536257  1114 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.537322  1114 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:44.480165   514 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:44.526535 30942 leader_election.cc:336] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.657s (SENT)
I20260709 12:24:44.496714 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:44.538488 31043 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:44.531380 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 49188.7us
I20260709 12:24:44.538674 31617 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:44.540041 31622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:58086
I20260709 12:24:44.540658 31622 raft_consensus.cc:606] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:44.540979 31622 raft_consensus.cc:614] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:44.541479   783 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:44.541908   783 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.542225   783 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:44.517235  1121 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:24:44.530318 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.532169   995 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.534629   981 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:44.545157 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.517979  1123 log.cc:927] Time spent T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:24:44.546928 30942 leader_election.cc:336] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.864s (SENT)
W20260709 12:24:44.553795 30942 leader_election.cc:336] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.868s (SENT)
I20260709 12:24:44.548374  1133 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:44.545481  1116 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:44.550772 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:44.551501 31013 leader_election.cc:336] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.793s (SENT)
I20260709 12:24:44.559552 31051 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:44.552210 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:44.517177  1124 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:24:44.508633 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:44.593911 30974 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.530323   971 raft_consensus.cc:3055] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:44.596730 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:44.509639   938 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.544546  1076 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.549624   981 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:44.514770   903 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.610744 30974 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
W20260709 12:24:44.625662 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 170898us
I20260709 12:24:44.630769 30976 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:44.599509 31619 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.656281 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.600662   971 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:44.592203   775 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:44.660132 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:44.555296  1077 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.665877 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:44.668511 31014 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.562062  1133 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.674187 30975 raft_consensus.cc:2410] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:44.682405  1133 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.677181   980 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:44.683087   980 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.683425   980 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.572896   783 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.688390 31619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:58086
I20260709 12:24:44.689962 31621 raft_consensus.cc:2368] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6.
I20260709 12:24:44.694815 30969 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:24:44.693887 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 336835us
I20260709 12:24:44.695995 30969 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.630643  1021 consensus_queue.cc:1059] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:24:44.698863 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:44.672269   867 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.703835 31587 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.677251   770 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.711052 31587 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.694983 31619 raft_consensus.cc:606] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:44.702132 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 698) took 1047 ms. Trace:
W20260709 12:24:44.770743 31013 leader_election.cc:336] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 2.016s (SENT)
I20260709 12:24:44.771207 31013 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:44.756177 31619 raft_consensus.cc:614] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:44.698319   981 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.773118   981 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.718353   971 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.776479 30971 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.776708 30975 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:24:44.726953  1119 consensus_queue.cc:1059] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 12:24:44.780452  1136 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:24:44.780802  1028 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:44.781615  1066 consensus_queue.cc:1175] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f868402d5ae640e7b362b9fddacbaf44" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:44.690124  1141 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:24:44.799389 30971 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:44.765519  1103 log.cc:927] Time spent T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:44.758291  1090 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.776469   971 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.865195 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 652) took 1431 ms. Trace:
I20260709 12:24:44.865645 31624 rpcz_store.cc:276] 0709 12:24:43.433537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.433685 (+   148us) service_pool.cc:224] Handling call
0709 12:24:43.800316 (+366631us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:43.812477 (+ 12161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.812846 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:43.862031 (+ 49185us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.993722 (+131691us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b18003d4c80. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:24:44.152542 (+158820us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.156615 (+  4073us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.159677 (+  3062us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:44.159713 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.159795 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.318116 (+158321us) raft_consensus.cc:1685] finished
0709 12:24:44.318133 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.865012 (+546879us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54005e33d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:44.865131 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6487,"prepare.queue_time_us":49183,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":2539,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":29024,"spinlock_wait_cycles":95755776,"thread_start_us":240330,"threads_started":1,"wal-append.queue_time_us":341408}
W20260709 12:24:44.868872  1145 log.cc:927] Time spent T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:24:44.874636  1085 raft_consensus.cc:3055] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:44.875147  1085 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:44.876015  1085 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:44.877254  1085 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.879993 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:44.881693  1077 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:44.882885   995 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.860644   938 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.768807 31616 rpcz_store.cc:276] 0709 12:24:43.654517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.312936 (+658419us) service_pool.cc:224] Handling call
0709 12:24:44.313312 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.313755 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:44.313792 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.314311 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.362002 (+ 47691us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:44.363148 (+  1146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.403069 (+ 39921us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.680285 (+277216us) raft_consensus.cc:1685] finished
0709 12:24:44.686978 (+  6693us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.700270 (+ 13292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1890,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":38915,"threads_started":1,"wal-append.queue_time_us":60671}
I20260709 12:24:44.726804  1130 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:44.784829  1133 consensus_queue.cc:1175] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1a7b44e2d0ed440985e5f643a5a54587" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:44.901337 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:44.902523 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:44.859628 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 686) took 1208 ms. Trace:
I20260709 12:24:44.797837   867 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.896266 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:44.856886  1119 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.903506 31620 rpcz_store.cc:276] 0709 12:24:43.651564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.993245 (+341681us) service_pool.cc:224] Handling call
0709 12:24:44.859443 (+866198us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540054ef54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:44.859563 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740928256}
I20260709 12:24:44.906184 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:44.906144 31048 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:44.906860 31047 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:44.869189  1069 raft_consensus.cc:3055] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:44.887161   865 consensus_queue.cc:1059] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:24:44.909307  1109 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:44.910884  1069 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:45.012596  1144 raft_consensus.cc:3055] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:45.013113  1144 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:45.014012  1144 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.015224  1144 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.018573  1107 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:44.998265  1109 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.022651  1109 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:44.911701  1119 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:45.030508  1149 log.cc:927] Time spent T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.150s	user 0.003s	sys 0.000s
I20260709 12:24:45.057741 30974 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:45.060359 30895 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:45.068732 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 438940us
W20260709 12:24:45.075977 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.077410 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.078258 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.078758 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.082588 30894 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:45.084589 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 373407us
W20260709 12:24:45.085005 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.085791 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.086177 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:45.087750 31616 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:45.088321 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 847) took 1311 ms. Trace:
I20260709 12:24:45.088948 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 853) took 1304 ms. Trace:
I20260709 12:24:45.089578 31616 rpcz_store.cc:276] 0709 12:24:43.784900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.911039 (+1126139us) service_pool.cc:224] Handling call
0709 12:24:44.911374 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.088454 (+177080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.088853 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:45.091284 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 655) took 1335 ms. Trace:
I20260709 12:24:45.091807 31617 rpcz_store.cc:276] 0709 12:24:43.756114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.539506 (+783392us) service_pool.cc:224] Handling call
0709 12:24:44.596568 (+ 57062us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:44.679384 (+ 82816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.681668 (+  2284us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:44.682273 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 12:24:44.753563 (+ 71290us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.757392 (+  3829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.771100 (+ 13708us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.029658 (+258558us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:45.090531 (+ 60873us) raft_consensus.cc:1685] finished
0709 12:24:45.090581 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.091059 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34070,"raft.queue_time_us":54172,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4524,"spinlock_wait_cycles":16033152,"thread_start_us":43188,"threads_started":1,"wal-append.queue_time_us":103269}
I20260709 12:24:44.996099   783 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:45.084439 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:45.097249 30897 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:45.088903 31622 rpcz_store.cc:276] 0709 12:24:43.776414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.549228 (+772814us) service_pool.cc:224] Handling call
0709 12:24:44.550929 (+  1701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.551281 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.551312 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.551783 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.689891 (+138108us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:44.974402 (+284511us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.087442 (+113040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.087681 (+   239us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.087774 (+    93us) raft_consensus.cc:1685] finished
0709 12:24:45.087788 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.088034 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14403,"prepare.queue_time_us":338998,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":20917,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":11073,"thread_start_us":399612,"threads_started":2,"wal-append.queue_time_us":174140}
I20260709 12:24:45.100049 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 659) took 1103 ms. Trace:
W20260709 12:24:45.100317 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.096532 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.095204 31587 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.100435 31622 rpcz_store.cc:276] 0709 12:24:43.996651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.098713 (+1102062us) service_pool.cc:224] Handling call
0709 12:24:45.099200 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.099623 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.099654 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.099714 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:45.099766 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.099844 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.099966 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:45.106570   981 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:45.020284  1023 consensus_meta.cc:287] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.002s
I20260709 12:24:45.107173   981 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.107590   981 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.106698 31047 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:45.107745  1023 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.112267  1096 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:45.025463  1119 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:44.945468   980 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.123319   980 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:45.124831 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 849) took 1347 ms. Trace:
I20260709 12:24:45.125324 31624 rpcz_store.cc:276] 0709 12:24:43.776907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.867603 (+1090696us) service_pool.cc:224] Handling call
0709 12:24:44.886232 (+ 18629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.886595 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.886623 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.887662 (+  1039us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.124299 (+236637us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:45.124401 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.124494 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.124529 (+    35us) raft_consensus.cc:1685] finished
0709 12:24:45.124539 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.124689 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":826,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3437,"thread_start_us":203357,"threads_started":1,"wal-append.queue_time_us":122079}
I20260709 12:24:45.128158  1023 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.129055  1023 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:44.944137   903 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:45.100276 31048 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:45.150353 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:45.100356   783 consensus_queue.cc:1059] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:24:45.160830 31622 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:45.161593 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 857) took 1153 ms. Trace:
I20260709 12:24:45.161927 31622 rpcz_store.cc:276] 0709 12:24:44.008051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.152181 (+1144130us) service_pool.cc:224] Handling call
0709 12:24:45.160310 (+  8129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.161298 (+   988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.161530 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:45.164532 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 660) took 1126 ms. Trace:
I20260709 12:24:45.165004 31624 rpcz_store.cc:276] 0709 12:24:44.038429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.127155 (+1088726us) service_pool.cc:224] Handling call
0709 12:24:45.127630 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.164149 (+ 36519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.164179 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.164233 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:45.164263 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.164318 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.164471 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:45.166050  1068 consensus_meta.cc:287] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.264s	user 0.013s	sys 0.000s
I20260709 12:24:45.151846 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 658) took 1141 ms. Trace:
I20260709 12:24:45.132841  1069 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.166597  1068 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.170100 31617 rpcz_store.cc:276] 0709 12:24:43.996386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.094358 (+1097972us) service_pool.cc:224] Handling call
0709 12:24:45.094904 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.095420 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.095456 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.095529 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:45.095582 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.095647 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.137267 (+ 41620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:45.172874  1068 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:45.177183 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:45.177579 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 97710.3us
W20260709 12:24:45.183743  1162 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:24:45.185823 30893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1648) took 1391 ms. Trace:
I20260709 12:24:45.186158  1096 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:45.187124 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 654) took 1525 ms. Trace:
I20260709 12:24:45.144927  1023 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:45.190346 30968 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:24:45.191866  1144 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:45.201758 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 661) took 1152 ms. Trace:
I20260709 12:24:45.202844 31622 rpcz_store.cc:276] 0709 12:24:44.040838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.162729 (+1121891us) service_pool.cc:224] Handling call
0709 12:24:45.163194 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.163631 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.163657 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.168572 (+  4915us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:45.192881 (+ 24309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.192950 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.193067 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:45.206010  1144 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:45.207783 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 73328.8us
I20260709 12:24:45.208745 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:45.208935 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 851) took 1424 ms. Trace:
I20260709 12:24:45.209142   783 raft_consensus.cc:3055] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:45.209657   783 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:45.210350  1133 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.210814  1133 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:45.211278  1133 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.211902 31587 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.211086  1076 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:45.213011 30899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1634) took 2373 ms (client timeout 1793 ms). Trace:
I20260709 12:24:45.213335  1130 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.213796  1130 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.215667  1130 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.216050  1119 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:45.220329 30901 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:45.220824 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:45.221861 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1642) took 2034 ms. Trace:
I20260709 12:24:45.222198 30901 rpcz_store.cc:276] 0709 12:24:43.187157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.309630 (+122473us) service_pool.cc:224] Handling call
0709 12:24:45.219873 (+1910243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.220791 (+   918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.221663 (+   872us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54000320d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:45.221805 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4379474688}
I20260709 12:24:45.201313 31615 rpcz_store.cc:276] 0709 12:24:43.661263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.364797 (+703534us) service_pool.cc:224] Handling call
0709 12:24:44.365194 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.480858 (+115664us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:44.919047 (+438189us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.088534 (+169487us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.089802 (+  1268us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.090127 (+   325us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:45.090172 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.090308 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.144146 (+ 53838us) raft_consensus.cc:1685] finished
0709 12:24:45.145276 (+  1130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.186942 (+ 41666us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":527892,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":24731,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":359,"thread_start_us":616860,"threads_started":3,"wal-append.queue_time_us":113892}
I20260709 12:24:45.226519  1130 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.193003 30893 rpcz_store.cc:276] 0709 12:24:43.793878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.999140 (+205262us) service_pool.cc:224] Handling call
0709 12:24:43.999403 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.211295 (+211892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.185302 (+974007us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540014afd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:45.185627 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485927296}
W20260709 12:24:45.215250 30899 rpcz_store.cc:269] 0709 12:24:42.839211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.006890 (+167679us) service_pool.cc:224] Handling call
0709 12:24:45.212534 (+2205644us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54000320d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:45.212782 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102060928}
I20260709 12:24:45.211197 31620 rpcz_store.cc:276] 0709 12:24:43.784451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.906770 (+1122319us) service_pool.cc:224] Handling call
0709 12:24:44.917411 (+ 10641us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:44.929535 (+ 12124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.929567 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:44.930172 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 12:24:45.150038 (+219866us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:45.208164 (+ 58126us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.208387 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.208510 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.208552 (+    42us) raft_consensus.cc:1685] finished
0709 12:24:45.208566 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.208766 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57682,"prepare.queue_time_us":57949,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":16211,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":3676,"thread_start_us":49015,"threads_started":1,"wal-append.queue_time_us":48387}
I20260709 12:24:45.240208 30967 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:45.241693 30972 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:45.211059   783 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.243187  1154 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.243471   783 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.244012  1154 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:45.256701 31043 consensus_meta.cc:287] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.696s	user 0.016s	sys 0.002s
I20260709 12:24:45.257318 31043 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:45.258411 31051 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: [3.3-4.4]
I20260709 12:24:45.259874  1154 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:45.260044  1066 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.262337  1133 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.262835 31587 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.265357 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 692) took 1612 ms. Trace:
I20260709 12:24:45.265800 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.268163  1076 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:45.268618  1076 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.268970  1076 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.271962  1023 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:45.272809  1023 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.273205  1154 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.276605   980 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.277480 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.277326   980 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.274822 31587 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.278898  1066 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.279834 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 680) took 5424 ms. Trace:
I20260709 12:24:45.280881 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:45.265760 31621 rpcz_store.cc:276] 0709 12:24:43.653160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.192096 (+538936us) service_pool.cc:224] Handling call
0709 12:24:45.264880 (+1072784us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54005ff854. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:45.265130 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142689664}
I20260709 12:24:45.284368 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 856) took 1469 ms. Trace:
I20260709 12:24:45.285490 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:45.286638 31623 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:24:45.287062 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 693) took 1633 ms. Trace:
I20260709 12:24:45.288435 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:45.289721  1066 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.290405  1066 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.284880 31616 rpcz_store.cc:276] 0709 12:24:43.814960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.091173 (+1276213us) service_pool.cc:224] Handling call
0709 12:24:45.119828 (+ 28655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.120397 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.120440 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.121099 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.149407 (+ 28308us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:45.229636 (+ 80229us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.254141 (+ 24505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.275834 (+ 21693us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.281799 (+  5965us) raft_consensus.cc:1685] finished
0709 12:24:45.282672 (+   873us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.284289 (+  1617us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58295,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":19469,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":27759,"threads_started":1,"wal-append.queue_time_us":25969}
I20260709 12:24:45.292649  1066 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:45.293545   838 raft_consensus.cc:3055] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.293984   838 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:45.280328 31618 rpcz_store.cc:276] 0709 12:24:39.855586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.881153 (+ 25567us) service_pool.cc:224] Handling call
0709 12:24:42.710587 (+2829434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.745626 (+ 35039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.747426 (+  1800us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.763028 (+ 15602us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.537515 (+774487us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:43.539013 (+  1498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.557485 (+ 18472us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.305152 (+747667us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:44.374219 (+ 69067us) raft_consensus.cc:1685] finished
0709 12:24:44.374243 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.279430 (+905187us) spinlock_profiling.cc:243] Waited 2.8 s on lock 0x7b54004a1fd0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:45.279618 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4510,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"spinlock_wait_cycles":6655419392,"thread_start_us":755173,"threads_started":1,"wal-append.queue_time_us":818849}
I20260709 12:24:45.287448 31623 rpcz_store.cc:276] 0709 12:24:43.653404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.195938 (+542534us) service_pool.cc:224] Handling call
0709 12:24:45.285191 (+1089253us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:45.287008 (+  1817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76995840}
I20260709 12:24:45.295176   838 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.302095   980 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:45.305315   969 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.306758 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.308513 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:45.309460 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2026) took 1538 ms. Trace:
I20260709 12:24:45.309855 31049 rpcz_store.cc:276] 0709 12:24:43.771149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.772779 (+  1630us) service_pool.cc:224] Handling call
0709 12:24:43.773086 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.062678 (+289592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.308890 (+1246212us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540007c6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:45.309236 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600339712}
I20260709 12:24:45.306130   969 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:24:45.301487   838 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.311601   965 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:45.311959 30865 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:45.311978  1066 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.316908   713 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:45.326129  1133 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:45.328460 31623 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:45.334530 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.343183 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:45.344041 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:45.344118   965 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:45.344818   947 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:45.344937 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:45.345351 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:45.325254  1023 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:45.369282 30899 raft_consensus.cc:2410] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:45.346403   969 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:45.346558  1144 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:45.349939 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.372774 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:45.374732   683 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.355278 30894 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:45.361688 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 80971.6us
W20260709 12:24:45.364619 30942 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.939s (SENT)
W20260709 12:24:45.353533 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.366488 31051 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.375165 30864 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:45.351565   981 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.384667 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.382310   713 consensus_queue.cc:1059] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:45.394105   713 raft_consensus.cc:3055] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:45.394488   713 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:45.399098  1023 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:45.399577  1023 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:45.400650  1023 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.402035  1023 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.408201  1110 raft_consensus.cc:3055] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:45.408622  1110 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:45.409636  1110 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.411005  1110 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.414324 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:45.415925 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:45.416720 31615 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:45.420368   938 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.421020   938 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.423174   938 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:45.424340 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 96057.8us
I20260709 12:24:45.425061   947 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:45.425335 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:45.426532  1114 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:45.427095  1114 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:45.428151  1114 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.431609  1109 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.434319   981 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:45.424642 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 1993) took 1416 ms. Trace:
I20260709 12:24:45.436038 31046 rpcz_store.cc:276] 0709 12:24:44.008408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.010878 (+  2470us) service_pool.cc:224] Handling call
0709 12:24:44.011131 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.166824 (+155693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.166854 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.166892 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.166921 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.424248 (+1257327us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001595d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:45.424304 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.424499 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357647232}
W20260709 12:24:45.440943 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.395500   713 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.442781   713 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.444999 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:45.449509   947 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.456691 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:45.457005 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:45.457571 30970 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.459103 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:45.459868 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.460161 30973 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:45.461812 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:45.462553 30972 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.470598 30972 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:45.472172 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:45.472711  1176 log.cc:927] Time spent T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:24:45.473074  1130 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:45.474658  1076 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.479501 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb8d20fced0547649402e6668241468c"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:45.481474 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:45.525498 31046 raft_consensus.cc:606] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.525851 31046 raft_consensus.cc:614] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:45.482795   965 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.335139  1066 consensus_queue.cc:1059] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:24:45.484246  1173 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 12:24:45.485921 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.486485  1069 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.490859  1109 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:45.493331 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:45.543491 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.494401 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:45.495035 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:45.496634 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:45.499738 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:45.501797 31616 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:45.503683 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:45.504431 31051 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:45.552868 31623 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:45.558739 30901 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:45.517612 31587 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:45.522132 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 142628us
I20260709 12:24:45.523065 30970 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:45.532132 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 157193us
I20260709 12:24:45.494026 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:45.544102 31045 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:45.545845  1120 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:45.548138 30974 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:45.551008   952 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:45.552103 30895 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:45.566807 30894 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:45.568372 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:45.571280 30971 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:45.559386   969 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:45.575609 30973 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:45.577390 31618 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:45.578341 31050 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:45.577744 30795 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.577646  1144 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.544646   965 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.580621  1120 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.590782 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:45.592463 30867 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:45.595172   969 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:45.606036 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:45.627615 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 58575.3us
W20260709 12:24:45.628050 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.638891 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 48248.4us
W20260709 12:24:45.640337 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 247138us
I20260709 12:24:45.629561   969 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.642696 31587 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.648540 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:45.667373 31050 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:45.646646  1069 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:45.686553 30864 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.666949  1066 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:45.701730 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 109434us
I20260709 12:24:45.687996  1069 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:45.690634   683 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.713987 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:45.716482 31046 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:24:45.721405 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 78818.8us
I20260709 12:24:45.721058  1076 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:45.724799 30795 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 3 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:45.726046 30798 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53570 (request call id 372) took 18495 ms (client timeout 15000 ms). Trace:
W20260709 12:24:45.727849 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.728017   868 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:45.728777 31048 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:45.729569   830 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.731159 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:45.732527   995 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:24:45.733973  1138 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:24:45.735149 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.720837  1114 consensus_queue.cc:1059] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:24:45.739115  1114 raft_consensus.cc:3055] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:45.739537  1114 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:45.732478   971 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:24:45.741494  1075 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.742745   965 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:45.743844  1120 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:45.729677  1021 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:24:45.740095  1130 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:45.727068 30795 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 3, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 3 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.683171   952 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:45.709029  1069 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.743261  1075 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:45.748376 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.713339 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:45.739430 31618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:58086
W20260709 12:24:45.753243 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 196433us
I20260709 12:24:45.748515  1130 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:45.758002 31618 raft_consensus.cc:606] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.761384 31618 raft_consensus.cc:614] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:45.759215 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:45.759547 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:45.763659 31050 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:45.767589 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:45.767589 31046 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:45.726433 30798 rpcz_store.cc:269] 0709 12:24:27.230431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.230673 (+   242us) service_pool.cc:224] Handling call
0709 12:24:27.617637 (+386964us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b540021d9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330597090 00007f0330635f3a 00007f03363ebe9c 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc 00007f03349aa392 00007f032e96848c 00007f032e9678c6
0709 12:24:28.495026 (+877389us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b54001d0510. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d509640 00007f03363e0846 00007f03364ea90e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc 00007f03349aa392 00007f032e96848c 00007f032e9678c6
0709 12:24:45.725766 (+17230740us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:38.947972 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:38.948508 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:38.948543 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:38.948560 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:38.949776 (+  1216us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:38.949828 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:38.949853 (+    25us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:24:38.950960 (+  1107us) tablet.cc:701] Row locks acquired
0709 12:24:38.950978 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:38.951117 (+   139us) write_op.cc:270] Start()
0709 12:24:38.951232 (+   115us) write_op.cc:276] Timestamp: P: 1783599878951069 usec, L: 0
0709 12:24:38.951253 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:39.004627 (+ 53374us) log.cc:844] Serialized 6223 byte log entry
0709 12:24:39.939180 (+934553us) op_driver.cc:464] REPLICATION: finished
0709 12:24:40.186312 (+247132us) write_op.cc:301] APPLY: starting
0709 12:24:40.186394 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:40.186679 (+   285us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:40.186799 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:40.424624 (+237825us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:40.424885 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:24:40.424926 (+    41us) write_op.cc:312] APPLY: finished
0709 12:24:40.425233 (+   307us) log.cc:844] Serialized 113 byte log entry
0709 12:24:40.431905 (+  6672us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:40.432058 (+   153us) write_op.cc:454] Released schema lock
0709 12:24:40.432115 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:40.432499 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:40.432525 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101688,"reported_tablets":26,"spinlock_wait_cycles":319434368,"child_traces":[["op",{"apply.queue_time_us":246899,"apply.run_cpu_time_us":7677,"apply.run_wall_time_us":246181,"num_ops":16,"prepare.queue_time_us":389883,"prepare.run_cpu_time_us":28274,"prepare.run_wall_time_us":404853,"raft.queue_time_us":119403,"raft.run_cpu_time_us":22858,"raft.run_wall_time_us":179276,"replication_time_us":977929,"thread_start_us":723716,"threads_started":4,"wal-append.queue_time_us":610280,"wal-append.run_cpu_time_us":17059,"wal-append.run_wall_time_us":1828366}]]}
I20260709 12:24:45.769053 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:45.769832 31043 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.771854 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:45.772464   981 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:45.732487  1092 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:24:45.772884   981 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.772739 31046 raft_consensus.cc:2410] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:45.773619  1133 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.774024  1133 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:45.774423  1133 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.775010  1143 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:24:45.776613 31588 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:45.777483  1076 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:45.778097 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:45.778024  1076 raft_consensus.cc:697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:45.757738   965 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.779289  1076 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.780241   965 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.780957  1130 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.782586  1130 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.784528   971 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:45.785220  1143 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:45.785687  1143 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:45.757639  1138 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:24:45.785866  1092 consensus_queue.cc:1243] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer 5e9d2b069edc4166802ee0456ebcb706 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:45.786688  1143 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:45.788445  1021 raft_consensus.cc:3055] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:45.788422  1066 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:45.788986  1021 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:45.789206  1066 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.773257  1119 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:45.790021  1021 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.791591  1021 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:45.792644 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 199659us
W20260709 12:24:45.793984 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.795378 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:45.779561  1175 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.237s	user 0.000s	sys 0.004s
I20260709 12:24:45.793985 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:45.809080 30795 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 3 to 4, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.773310   981 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.827566  1131 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:45.829020 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:45.830317 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:45.832063 30795 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 3 to 5, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 5 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.833696 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.833813 30795 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.834852 31016 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:45.836836  1023 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.837103  1186 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.837559  1186 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.837903  1186 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.836207 30795 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:45.852550 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 47191.1us
I20260709 12:24:45.852620 31016 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:45.853775 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.822911  1143 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:45.862310 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 151798us
I20260709 12:24:45.865507 31016 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:45.866683 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 123955us
I20260709 12:24:45.867197 31049 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:45.812147  1114 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:45.868345  1131 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.896251 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:45.870482   965 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:45.899708 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 164660us
I20260709 12:24:45.901018 30970 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:45.903668 30795 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.868981  1092 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:24:45.896246 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:45.887141   783 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.925858 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.933511 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:45.904037  1096 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.917562  1109 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:45.940222 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.940698 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.937721  1131 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:45.937904 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:45.948377 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 82967.6us
I20260709 12:24:45.946774  1131 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.952426  1131 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.952330 30795 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 3 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.954490 30795 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 4 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:45.956211 30795 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.958546 30795 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.960914 30795 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:45.963990 30971 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:45.921998  1075 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.952096  1164 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:45.984705 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:45.985471 30971 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:45.985633  1189 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:45.985831 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:45.900555 30783 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8f02e5ab61a44506bdae958f8a275d96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1a7b44e2d0ed440985e5f643a5a54587 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:24:45.987793 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 96709.7us
I20260709 12:24:45.925722   683 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:24:45.947438  1109 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:46.028777   840 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.008347 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:45.966302  1144 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.970399  1066 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:46.040771  1197 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:24:46.049527 31588 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:46.033595  1109 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.964895   783 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:46.055303 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.061069 31620 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:46.073010 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 168536us
W20260709 12:24:46.044963  1194 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:24:46.085000   969 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.087297   969 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.090653 30968 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:46.052567  1068 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.071945  1144 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:46.051935  1187 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:46.102226 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:46.034933  1075 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:46.106200  1144 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:46.050603  1164 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.042640   840 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.149653  1075 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:46.149554 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 68757.4us
I20260709 12:24:46.106669  1068 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:46.168833 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.139691  1144 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.122916  1131 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:46.205871 30942 leader_election.cc:336] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.546s (SENT)
I20260709 12:24:46.217322 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:46.239589  1186 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.223310   980 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:46.140491  1187 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:46.264686  1186 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:46.265512 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 113029us
W20260709 12:24:46.266361 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.291335   980 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:46.328686  1164 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.329563   980 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:46.268311   783 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:46.334158  1130 consensus_meta.cc:287] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.012s
W20260709 12:24:46.335377  1069 consensus_meta.cc:287] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.006s
W20260709 12:24:46.336544  1021 consensus_meta.cc:287] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260709 12:24:46.273208  1195 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:46.319939  1109 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.321206  1131 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.321597 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:46.322165  1207 log.cc:927] Time spent T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:46.323181   840 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.292946  1213 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:46.325212  1187 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:46.326081  1133 consensus_meta.cc:287] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.003s
I20260709 12:24:46.273581  1204 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.364928  1133 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.365078  1204 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:46.316584 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 43674.7us
I20260709 12:24:46.336058  1069 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:46.362316 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:46.363094  1213 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.366952  1133 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:46.371632 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 103408us
I20260709 12:24:46.370112 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:46.376058 31047 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.378747 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:46.341393   981 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.382745  1068 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:46.383141  1204 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.377189 31615 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:46.382915 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:46.377413  1110 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:46.382781 31043 consensus_meta.cc:287] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.001s
I20260709 12:24:46.397091  1213 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.402607 31043 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:46.378008  1021 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:46.404682  1133 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.405309  1133 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:46.416121  1198 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
I20260709 12:24:46.407558  1133 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:46.416884  1109 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.417773 30975 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:46.418322  1069 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:46.378126  1230 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:46.380966  1144 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:46.431175 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 53831.6us
I20260709 12:24:46.437670 31047 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:46.440702 30975 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:46.441146 30975 pending_rounds.cc:85] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 2
I20260709 12:24:46.441396 30975 pending_rounds.cc:107] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:46.441705 30975 raft_consensus.cc:2889] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:46.442895 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:46.443545 30968 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.444355   981 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:46.428834  1164 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:46.450592 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:46.451159  1164 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:46.452176  1164 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:46.425002  1021 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:46.457553  1021 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.470486   971 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:46.471128  1199 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:46.471776  1199 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.473491 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:46.474239 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.475174 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.476132 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:46.476306 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.476831 30976 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:46.477345 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.478005 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.478626 30898 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:46.479692 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:46.480324 30973 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:46.480638 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:46.479442 30893 raft_consensus.cc:2393] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:46.481920 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:46.483076 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:46.484579 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:46.485232 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:46.485349 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.495275 30976 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:46.485495   830 consensus_queue.cc:1059] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:46.486384 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.487250 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:46.487584 31049 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:24:46.487284 31046 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:46.488328 31047 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:46.488909 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:46.501169 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.506834 30973 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:46.510367 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.513413 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:46.515393 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:46.516405 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:46.479149  1197 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:46.518679 30969 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:46.473878  1199 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.520223   981 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:46.520263 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.521944  1092 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:46.517661 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:46.523195 31014 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:46.490099  1195 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:46.471084   971 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:46.534402 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.529906  1195 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:46.528211  1197 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.430963  1230 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.529443   980 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:46.539597 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:46.524910  1069 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:46.548216  1195 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:46.556246   554 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:24:46.556545  1144 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:46.542702   830 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:24:46.558036  1069 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:46.563639  1231 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.556492  1213 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:46.569166  1110 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:46.524755  1109 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:24:46.548630   980 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:46.529069  1164 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:46.588019 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:46.595295 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.582247  1069 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:46.586035  1110 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.626801 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:46.698760  1234 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:24:46.589617  1213 raft_consensus.cc:697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:46.699865  1236 log.cc:927] Time spent T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:24:46.701171 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:46.701846 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:46.702265  1197 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.702397   783 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.588141  1231 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.704077  1230 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:46.590474   980 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.712674 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.724103 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:46.886976 31049 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:46.889210 30969 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:46.767033 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.727686 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 178471us
I20260709 12:24:46.893986 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:46.902887 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.904774 31051 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
W20260709 12:24:46.909729  1241 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.204s	user 0.000s	sys 0.019s
I20260709 12:24:46.895742 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:46.911048 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.707669  1144 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:46.928220 30901 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:46.952685   971 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:46.706319  1092 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.193s
I20260709 12:24:46.966936 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:46.968425 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:46.969138  1213 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.970711 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:46.975611 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:46.976586 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.975062 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:46.972488 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:46.885649  1133 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.983785 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:46.992964 31049 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:46.996500 31623 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:24:46.998759  1238 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.459s	user 0.001s	sys 0.000s
I20260709 12:24:46.999466  1230 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:47.000059 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:46.897903   783 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.009836   783 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.014752  1120 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:47.015232  1120 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:47.016224  1120 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.017544  1120 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:46.956341  1144 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.023092  1144 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:46.972520  1246 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:47.029978 30892 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:47.030680  1110 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.032702  1110 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:47.033681 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 49481us
I20260709 12:24:47.043578  1200 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.044203  1200 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.046823   947 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:47.047439   947 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.049031 31049 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:47.049695   947 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.051257 31620 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:46.974701  1197 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.056454 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 84052.7us
I20260709 12:24:46.970407   980 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:46.983115  1218 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:47.030545  1114 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:46.994149   838 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:47.033860  1133 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.086742 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.067600 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.047022   683 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.027483  1069 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.121098 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:47.122104  1195 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.002s
I20260709 12:24:47.122511  1195 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.124742  1231 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.132318 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:47.134032 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:47.134647 30901 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:47.136256 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:47.136857 30901 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:47.142509 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:47.146498 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:47.147053 30896 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:47.054369  1200 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.148759 31622 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:24:47.149147 31622 pending_rounds.cc:85] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 5
I20260709 12:24:47.149362 31622 pending_rounds.cc:107] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:47.149590 31622 raft_consensus.cc:2889] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:47.150637 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.081139  1197 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.160013 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:47.160609 30897 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:47.161569  1197 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.082371   995 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:47.176523 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:47.215461 30893 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:47.169255 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.168365 31588 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:47.206895 30901 raft_consensus.cc:2410] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:47.166520 30892 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:47.194200 31624 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:47.208962 30896 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:47.000070  1230 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.233847  1230 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:47.234319  1230 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:47.234761  1230 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.236647  1144 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.237246   980 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.237150  1144 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.237962   981 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:47.238461   981 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.239043  1144 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:47.241585 30897 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:47.213037  1069 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:47.224118 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.224118 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:47.225741  1245 log.cc:927] Time spent T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.518s	user 0.001s	sys 0.002s
I20260709 12:24:47.225660  1200 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.227959  1247 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:24:47.093314   838 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.228942 31042 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:47.231897  1164 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:47.245517 30893 raft_consensus.cc:2410] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:47.136179  1203 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.245908 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 77597.3us
I20260709 12:24:47.239516  1144 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:47.248926 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:47.290225 30864 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:47.289099 30783 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8f02e5ab61a44506bdae958f8a275d96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1a7b44e2d0ed440985e5f643a5a54587 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:47.293840 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:47.294445 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:47.296650 30974 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.294481   952 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.218525   947 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:47.277369 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.301785 31622 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.302181 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:47.299185 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.296205 31624 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 12:24:47.300895 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 80277.2us
I20260709 12:24:47.305488 31624 pending_rounds.cc:85] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 3
I20260709 12:24:47.305766 31624 pending_rounds.cc:107] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:24:47.305991 31624 raft_consensus.cc:2889] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:47.308001 30972 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:47.308096 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:47.308139 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.329095 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.206343   683 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.325963 31621 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:24:47.309091 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:47.353742 30969 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:47.215232   995 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:47.359391 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:47.285538  1133 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.308288  1206 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:47.368932 30892 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:47.284736  1200 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.093860  1218 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.370645 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.324821  1164 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:47.372872 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:47.376485 31621 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:47.374747 30976 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:47.326584  1231 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.378130 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.378850 31624 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:47.379371 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:47.330638   969 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:47.373893 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:47.323849   947 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.308404   952 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.393774   981 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.578526 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:47.579231 30895 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:47.365402  1195 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.366860   995 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:47.384379 30970 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:47.303387  1203 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.582654 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:47.581456 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:47.437693 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:47.444283 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:47.360332 31619 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:47.384696 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.444638 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.461210 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.484913 31623 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:47.444909 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:47.588371 30942 leader_election.cc:336] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.831s (SENT)
I20260709 12:24:47.589155 30969 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
W20260709 12:24:47.436029 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 401685us
I20260709 12:24:47.592573 31620 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:47.618773 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:47.619410 30968 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:47.384050  1133 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:47.617544 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:47.656996 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:47.360139  1144 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.664167  1144 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.665025 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.669147  1203 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.669811  1203 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.670656 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.579787   981 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:47.671497   981 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.674037   981 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.445221   683 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.675172 31618 raft_consensus.cc:2410] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:24:47.534916 31616 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.019s	sys 0.015s
I20260709 12:24:47.660071 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.435781   980 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.676220   980 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.676756 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.660693 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.677333 31620 raft_consensus.cc:2376] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5. Re-sending same reply.
I20260709 12:24:47.678180 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.678236 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.678735 31620 raft_consensus.cc:2376] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5. Re-sending same reply.
I20260709 12:24:47.679302 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:47.661022 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 72699.4us
I20260709 12:24:47.660295 31013 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:47.661480   947 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.661975  1069 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:47.660318 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.457257  1220 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.399212  1231 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:47.675907 31616 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.024s	sys 0.015s
W20260709 12:24:47.680068 30942 leader_election.cc:336] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.842s (SENT)
I20260709 12:24:47.686103   838 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:47.686631 30942 leader_election.cc:336] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.876s (SENT)
I20260709 12:24:47.680636 31013 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:47.682200  1069 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:47.686920 31623 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:47.688124  1069 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.688534  1069 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.688825 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.689560 31623 raft_consensus.cc:2393] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:47.684125  1220 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.694051  1220 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.435819   969 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.684698 30898 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:24:47.694897 30898 pending_rounds.cc:85] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 3
I20260709 12:24:47.695113 30898 pending_rounds.cc:107] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 12:24:47.695219 30942 leader_election.cc:336] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.030s (SENT)
I20260709 12:24:47.684239 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.695633 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:47.695952 31619 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:47.695971   969 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:47.681655 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:47.696859 30942 leader_election.cc:336] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.181s (SENT)
I20260709 12:24:47.697171 31624 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.697587  1195 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.698608 31619 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:47.696280 30898 raft_consensus.cc:2889] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:47.680981   980 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:47.697278 30942 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:47.679584 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.703882  1195 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:47.705682  1200 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.611701  1131 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.706548 31624 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:47.706486  1131 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.611277  1230 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:47.709283 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:47.693974 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 478) took 1107 ms. Trace:
I20260709 12:24:47.714934 31622 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:47.584302  1247 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.452314  1164 raft_consensus.cc:697] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:47.761644 30942 leader_election.cc:336] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.234s (SENT)
W20260709 12:24:47.761993 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 51444.5us
I20260709 12:24:47.710237 30975 rpcz_store.cc:276] 0709 12:24:46.586750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.586909 (+   159us) service_pool.cc:224] Handling call
0709 12:24:46.596166 (+  9257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.713087 (+116921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.713117 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.968026 (+254909us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.080422 (+112396us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:47.080472 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.080550 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.693743 (+613193us) raft_consensus.cc:1685] finished
0709 12:24:47.693765 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.693889 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101608,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":97068,"threads_started":1,"wal-append.queue_time_us":425800}
I20260709 12:24:47.782487 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:47.761337  1230 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:47.717375   980 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:47.792040 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.793305 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:47.716817  1133 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:47.794391 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:47.786801  1247 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.795181 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:47.795199 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:47.796952 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:47.797919 31589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.024s	sys 0.055s
W20260709 12:24:47.781350 31617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.033s	sys 0.024s
I20260709 12:24:47.799750 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:47.813936 31589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.027s	sys 0.056s
I20260709 12:24:47.816776  1230 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:47.818854 31050 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:47.788945  1258 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:47.795534  1246 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:47.795715  1203 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.814105 31617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.034s	sys 0.024s
I20260709 12:24:47.815868 31619 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:24:47.835484 30974 consensus_meta.cc:287] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 12:24:47.835889 30974 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:47.837878 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:47.833825  1138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.021s	sys 0.026s
W20260709 12:24:47.843919  1138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.022s	sys 0.026s
I20260709 12:24:47.821645  1069 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.846957 31046 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:47.848496  1069 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:47.817881  1144 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:47.819741  1230 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:47.833561  1195 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.855451 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.856117 31622 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.857141 31587 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:47.834159  1258 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.936337 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:47.852039  1203 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.946871 31622 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:47.940275 31047 raft_consensus.cc:2410] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:24:47.965131 30864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.012s	sys 0.043s
I20260709 12:24:47.873543  1144 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:47.894534   981 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:47.974993 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:47.967794 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.014s	sys 0.042s
I20260709 12:24:47.844178  1164 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:47.969278 30864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.012s	sys 0.043s
I20260709 12:24:47.969723 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:47.980268 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.014s	sys 0.042s
W20260709 12:24:47.971180 31014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.016s	sys 0.042s
W20260709 12:24:47.970623 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 125446us
W20260709 12:24:47.980706 31014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.016s	sys 0.042s
I20260709 12:24:47.980849 31619 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:47.981344 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 680872us
W20260709 12:24:47.871766  1092 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.010s	sys 0.034s
I20260709 12:24:47.989953 31587 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:47.995669 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.889530  1133 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:47.988524  1092 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.010s	sys 0.034s
I20260709 12:24:48.000061 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.002635 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.020782 31619 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:48.022022 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:48.023341 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.024047 31622 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
W20260709 12:24:48.026298 31016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.002s	sys 0.029s
I20260709 12:24:48.026461 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:48.026657 30896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.020s	sys 0.008s
W20260709 12:24:48.028407 30896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.020s	sys 0.008s
W20260709 12:24:48.032701 31016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.002s	sys 0.029s
I20260709 12:24:48.038920 30892 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:47.997953  1069 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.040359 30865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.006s	sys 0.024s
W20260709 12:24:47.999472  1248 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.010s
W20260709 12:24:48.043949 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 54097.1us
I20260709 12:24:48.000552   980 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.047376 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:47.991298   981 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:48.049466 30865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.006s	sys 0.024s
I20260709 12:24:48.024935  1253 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.058398 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 679907us
I20260709 12:24:48.059252 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:48.060263 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.028590  1247 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.028795  1252 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:48.072245 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:48.049111  1021 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.026s	sys 0.016s
W20260709 12:24:48.078876  1021 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.026s	sys 0.017s
I20260709 12:24:48.079123 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:48.062813 30899 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:48.080250 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:48.080348 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:48.080775 30899 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.063479 30865 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.080915 30901 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.074823 31622 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:48.082938 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.040113  1220 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.084283 31619 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
W20260709 12:24:48.051875  1248 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.007s	sys 0.011s
I20260709 12:24:48.078408 30892 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:48.060133 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.040235  1114 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:48.061906  1195 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.088498 31615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.030s	sys 0.035s
W20260709 12:24:48.092497 31615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.030s	sys 0.035s
I20260709 12:24:48.092625 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.093096 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:48.101250 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.101895 30901 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:48.102103 30892 raft_consensus.cc:2410] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:48.052345  1069 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.087850  1252 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:48.061699   980 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.086859  1220 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.077246  1253 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.088562  1114 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.097852  1259 consensus_queue.cc:1059] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:48.125385 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.113830  1262 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:48.128371 31015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.019s	sys 0.016s
W20260709 12:24:48.128842 31015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.020s	sys 0.016s
I20260709 12:24:48.100803  1195 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.141230 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.134260  1271 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:48.141991 30892 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:48.112640   995 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.130398  1110 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.169817 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:48.141484  1258 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:48.178349 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 467331us
I20260709 12:24:48.149474  1262 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:48.185357 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.197222 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:48.199647 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.200297 31622 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:48.201539 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.202093 31622 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:48.203240 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:48.203755 31622 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.210630 31622 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:48.226348 30942 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 3.406s (SENT) [suppressed 69 similar messages]
I20260709 12:24:48.226616  1267 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.234948 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.182633  1262 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:48.170225  1110 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:48.226763   683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.007s
I20260709 12:24:48.184360  1269 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:48.239933 30892 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:48.190189 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 882) took 1188 ms. Trace:
I20260709 12:24:48.187215   981 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:48.243636 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 160299us
I20260709 12:24:48.228895  1268 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:48.249697 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:48.240339 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 191329us
W20260709 12:24:48.243381   683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.007s	sys 0.007s
I20260709 12:24:48.241142  1262 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.237042 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 876) took 1266 ms. Trace:
I20260709 12:24:48.261984 30892 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:48.267194 30899 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:48.249136  1263 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:24:48.269083 30865 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.242148   947 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:48.246855  1269 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.274200 31587 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.276479 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.242847  1266 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:48.227267  1267 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.281926 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.284121 31045 raft_consensus.cc:2393] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:48.286329 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 187271us
I20260709 12:24:48.287037 31013 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:48.287945 31013 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.301895 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.179661  1252 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.273105  1271 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:48.305660 30865 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.259939  1265 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:24:48.314345 31051 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:48.303246 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 76925.6us
I20260709 12:24:48.306349 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.317795 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.324704 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:48.325291 31045 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:48.329260 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.330740 30942 leader_election.cc:336] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.406s (SENT)
I20260709 12:24:48.331887 30942 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.279429  1269 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.371459 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.299856   838 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.300012   981 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:48.378126 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:48.378623 31016 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:48.380373 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 115485us
I20260709 12:24:48.307024  1114 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:48.384732 31044 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:48.388056 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.388976 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.389616 31620 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:48.254606  1268 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.313728  1259 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:48.394444 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:48.394968 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.278000   947 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.400759 31051 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:48.402873 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.404965 31044 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 3.
I20260709 12:24:48.322151  1257 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.410274 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1663) took 1193 ms. Trace:
I20260709 12:24:48.412547 31587 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.372835  1021 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.380714  1295 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.391901  1213 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:48.419272 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:48.416077 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.418854 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:48.411993 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 106375us
I20260709 12:24:48.418972 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:48.420176 30894 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:48.418860 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.421042 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:48.421404 30892 raft_consensus.cc:2410] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:48.421489 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.301515  1266 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.423182 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.419516  1114 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.424260 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:48.328594  1271 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.394529  1164 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.398604   995 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:48.432641 31045 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:24:48.412665 30973 rpcz_store.cc:276] 0709 12:24:47.217188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.218136 (+   948us) service_pool.cc:224] Handling call
0709 12:24:47.225328 (+  7192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:47.242021 (+ 16693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.242048 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:47.242465 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.792618 (+550153us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:47.792658 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.792728 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.410065 (+617337us) raft_consensus.cc:1685] finished
0709 12:24:48.410087 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.410214 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16276,"raft.queue_time_us":16391,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6720,"thread_start_us":483967,"threads_started":1,"wal-append.queue_time_us":703754}
W20260709 12:24:48.436728 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 58161.8us
W20260709 12:24:48.437469 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 106754us
I20260709 12:24:48.439023 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:48.440623  1272 log.cc:927] Time spent T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:24:48.440852  1302 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.408679  1253 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.440913 31014 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:48.440647 30942 leader_election.cc:336] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.514s (SENT)
I20260709 12:24:48.442723 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.443598 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.444731 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.445293 30894 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 3.
I20260709 12:24:48.445780 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.447345 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.447664 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.414568   981 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.449080 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.409679  1259 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.432166  1295 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.452785 31045 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:48.454144  1268 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:48.454687  1268 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:48.455161  1295 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.419664  1213 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.455837  1213 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.452889 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.459506 31016 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.462482 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.462802 31044 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:48.471242 30973 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:48.455919  1287 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.487298 30970 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:48.441089  1021 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:48.497279 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 56656.9us
I20260709 12:24:48.473069 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 875) took 1506 ms. Trace:
I20260709 12:24:48.504508 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.506868 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.504714  1285 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.507949 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.507995  1285 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:48.498174  1302 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.511225  1285 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:48.502712 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:48.512295 30972 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.487937  1248 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:48.491459   995 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:48.514362 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 55126.1us
I20260709 12:24:48.535956 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:48.539348 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 134091us
W20260709 12:24:48.538993 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 97568.7us
I20260709 12:24:48.499883  1265 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.503887   981 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:48.540392 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 99525us
I20260709 12:24:48.495832  1021 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.518756  1195 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.570466 30942 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.577311 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.579391 30975 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:24:48.579499 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 158474us
I20260709 12:24:48.580458 31587 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.582845 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:48.587792 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 68960.5us
I20260709 12:24:48.536962  1164 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:48.591142 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.594794 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.555263   981 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:48.247488 31617 rpcz_store.cc:276] 0709 12:24:46.999041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.000646 (+  1605us) service_pool.cc:224] Handling call
0709 12:24:47.000936 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.001124 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:47.844021 (+842897us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.150261 (+306240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.169288 (+ 19027us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.172726 (+  3438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.177020 (+  4294us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.183513 (+  6493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1463,"prepare.queue_time_us":948657,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":105107,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10081,"thread_start_us":1128096,"threads_started":2,"wal-append.queue_time_us":397029}
I20260709 12:24:48.639039 30972 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:48.642048   952 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:48.643846  1069 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:48.547858  1092 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:24:48.652874 30973 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:48.577209  1288 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:48.530097  1248 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.571210  1247 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:24:48.578496   995 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:24:48.548308  1265 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.663514 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:48.661208 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 56968.4us
I20260709 12:24:48.269869 31616 rpcz_store.cc:276] 0709 12:24:46.967351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.974254 (+  6903us) service_pool.cc:224] Handling call
0709 12:24:46.997613 (+ 23359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.997848 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:47.684761 (+686913us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.179477 (+494716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.181765 (+  2288us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:48.186279 (+  4514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.189368 (+  3089us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.233370 (+ 44002us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":893379,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3022,"raft.queue_time_us":101783,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17995,"spinlock_wait_cycles":29666560,"thread_start_us":1158917,"threads_started":2,"wal-append.queue_time_us":608276}
W20260709 12:24:48.703960  1299 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:24:48.722211  1289 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.722672  1293 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:48.723292  1282 log.cc:927] Time spent T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 12:24:48.724264  1301 log.cc:927] Time spent T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 12:24:48.724989  1296 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
W20260709 12:24:48.725705  1286 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:24:48.591109  1295 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.590304  1287 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:48.727556 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:48.602013  1253 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.703054  1246 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:48.748512  1298 log.cc:927] Time spent T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:48.723356  1069 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.703203  1303 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.703054  1312 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:48.504328 31615 rpcz_store.cc:276] 0709 12:24:46.966995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.969831 (+  2836us) service_pool.cc:224] Handling call
0709 12:24:46.970181 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:47.365098 (+394917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.370191 (+  5093us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:47.453230 (+ 83039us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.104336 (+651106us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.107740 (+  3404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.117413 (+  9673us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.441646 (+324233us) raft_consensus.cc:1685] finished
0709 12:24:48.449549 (+  7903us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.463377 (+ 13828us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30346,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":927674,"threads_started":2,"wal-append.queue_time_us":778993}
I20260709 12:24:48.654023  1267 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:48.781571 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 178662us
I20260709 12:24:48.742399   947 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.832050  1259 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.843629  1312 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:48.843712 31051 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:48.845031 31051 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:48.844628  1312 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.764523  1246 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.840397 31016 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:48.856225 31016 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:48.857039 31016 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:48.849630  1291 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:24:48.849947  1247 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.851931 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:48.859200 30898 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:48.852528  1144 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:48.860813 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:48.861613 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 496) took 1061 ms. Trace:
I20260709 12:24:48.863332 31046 rpcz_store.cc:276] 0709 12:24:47.793726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.793838 (+   112us) service_pool.cc:224] Handling call
0709 12:24:48.855215 (+1061377us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54002a4c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:48.855351 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111545856}
I20260709 12:24:48.865674  1269 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:48.866393 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 145050us
I20260709 12:24:48.867051 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1990) took 1487 ms. Trace:
I20260709 12:24:48.867794 30864 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.867383 30896 rpcz_store.cc:276] 0709 12:24:47.379860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.379972 (+   112us) service_pool.cc:224] Handling call
0709 12:24:47.392950 (+ 12978us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:48.028828 (+635878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.028856 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:48.085833 (+ 56977us) log.cc:844] Serialized 566 byte log entry
0709 12:24:48.297053 (+211220us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:48.297082 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.297146 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.866853 (+569707us) raft_consensus.cc:1685] finished
0709 12:24:48.866873 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.866999 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":235572,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":782995,"threads_started":2,"wal-append.queue_time_us":458763}
I20260709 12:24:48.848240  1092 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.731456  1288 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.871025   995 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:48.882691  1110 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:48.764983  1253 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.866967  1069 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:48.862900  1267 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:48.890617 30864 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:48.867919  1289 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:48.870144  1133 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.884138   554 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:48.903296 30864 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:48.869594  1318 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:48.908965  1200 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:48.909368  1313 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:48.909600  1200 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:48.910046  1200 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.909920  1313 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.902801  1267 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.914211  1267 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.917019  1131 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.917847  1307 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:48.918309  1307 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.918665  1307 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:48.919003  1200 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:48.919749  1266 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.868615  1247 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.922575  1200 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:48.841322  1303 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.702857  1308 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.257s
I20260709 12:24:48.924041  1247 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.838465   981 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.924945  1203 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.925202  1265 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.927433  1258 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:48.928283  1318 consensus_queue.cc:1243] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 1a7b44e2d0ed440985e5f643a5a54587 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:48.928614  1218 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.930557  1271 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:48.931941 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 737) took 1572 ms. Trace:
I20260709 12:24:48.978557 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.672868  1285 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.940953 31013 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:49.006737 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 65884.4us
I20260709 12:24:48.939170 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:48.942271 30867 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:48.943292   554 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:49.008692 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 66496us
I20260709 12:24:49.007966 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:48.903959  1289 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:48.953187 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:49.010726 31013 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:49.010869 31619 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:48.936841  1069 raft_consensus.cc:697] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:49.013163  1069 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.977865 30893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1989) took 1611 ms. Trace:
I20260709 12:24:49.015874 30893 rpcz_store.cc:276] 0709 12:24:47.366222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.367154 (+   932us) service_pool.cc:224] Handling call
0709 12:24:47.367425 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.580026 (+212601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.580056 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.580095 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:47.580125 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.977598 (+1397473us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003408d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:48.977643 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.977791 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488527744}
I20260709 12:24:48.890067   995 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.018589   995 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:48.958472  1269 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.010269 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:49.002379 31618 rpcz_store.cc:276] 0709 12:24:47.359866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.670386 (+310520us) service_pool.cc:224] Handling call
0709 12:24:48.931739 (+1261353us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b54006bbf54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:48.931885 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8513408}
I20260709 12:24:48.908972   947 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.943755  1213 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:48.996455  1258 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:49.005627  1313 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:49.048004 31049 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:49.033630  1318 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.020368  1308 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.049604  1278 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 12:24:49.050428  1288 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:49.050269  1304 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:24:49.051752  1303 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.037091  1248 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.086596  1253 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.020154  1289 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.092167   554 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:49.036861  1271 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:49.098682  1271 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:49.099133  1271 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.049656  1331 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.102375  1331 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.102764  1331 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.061236  1308 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.108055  1308 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.097420  1258 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.120559  1258 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.061556 31616 raft_consensus.cc:2410] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:24:49.129098  1260 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 1.038s	user 0.002s	sys 0.002s
W20260709 12:24:49.096233  1262 consensus_meta.cc:287] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.820s	user 0.006s	sys 0.004s
I20260709 12:24:49.131893  1262 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.134056  1262 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:49.117877  1246 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:49.119088  1297 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:24:49.034718  1307 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:49.151705  1284 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.698s	user 0.001s	sys 0.001s
I20260709 12:24:49.254415  1308 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.272102  1231 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.153681   980 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.283738  1308 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.284348  1329 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.284823  1329 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:49.283456 31047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 494) took 1490 ms (client timeout 1503 ms). Trace:
I20260709 12:24:49.289203 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 1987) took 1945 ms. Trace:
W20260709 12:24:49.291352 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 281121us
W20260709 12:24:49.288879 31047 rpcz_store.cc:269] 0709 12:24:47.793174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.796697 (+  3523us) service_pool.cc:224] Handling call
0709 12:24:49.283236 (+1486539us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540007d0d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:49.283396 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279815936}
I20260709 12:24:49.154101  1021 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.299495  1203 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:49.289728 30897 rpcz_store.cc:276] 0709 12:24:47.343533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.344911 (+  1378us) service_pool.cc:224] Handling call
0709 12:24:47.365708 (+ 20797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.704393 (+338685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.704428 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.704470 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:47.704499 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.288963 (+1584464us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54003eb2d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:49.289011 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.289140 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778434304}
I20260709 12:24:49.152084  1307 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.296866   947 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:49.308799  1320 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:49.308866  1314 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 12:24:49.310469  1305 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:49.175282  1246 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:49.307109  1203 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:49.171344  1271 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:49.160789  1267 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.328884 30867 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:49.320986   947 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.251155  1289 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.292716  1329 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.333043 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:49.342450 30893 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:49.342643  1329 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.339831 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:49.340123 30895 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:49.341056 30898 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:49.341572 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:49.345455 30900 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:49.344839 30898 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:49.346246 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:49.346892 30896 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:49.329541  1213 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.363795 30898 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:49.372730 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:49.380879 30897 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:49.381148 30898 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.338707   947 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.380631 31619 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:49.392894 31013 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:49.393345 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:49.374044  1331 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.393769  1231 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.430470  1231 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:49.327877  1305 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:49.391292 30971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.041s	sys 0.060s
I20260709 12:24:49.327679  1320 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:49.443408 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.433029 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.481521 31587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.006s	sys 0.067s
W20260709 12:24:49.689626 31587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.006s	sys 0.075s
W20260709 12:24:49.690235 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 1.10977e+06us
W20260709 12:24:49.479544 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 86689.2us
W20260709 12:24:49.582480 31015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.016s	sys 0.054s
I20260709 12:24:49.666139 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:49.633123 30967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.004s	sys 0.056s
W20260709 12:24:49.680732 30971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.044s	sys 0.077s
W20260709 12:24:49.629473 31589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.035s	sys 0.041s
I20260709 12:24:49.669493 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:49.692556 30967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.007s	sys 0.058s
W20260709 12:24:49.692603 31015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.017s	sys 0.061s
W20260709 12:24:49.694653 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.695237 30892 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:49.692418 31589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.035s	sys 0.045s
I20260709 12:24:49.692271 31621 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.693771 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2045) took 1116 ms. Trace:
I20260709 12:24:49.344285  1265 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.733757 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:49.592492 31048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.009s	sys 0.043s
W20260709 12:24:49.737784 31048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.010s	sys 0.045s
I20260709 12:24:49.732010 30864 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:49.742899 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:49.743628 30897 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:49.741689  1218 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.744545  1218 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.746585  1218 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.747493  1138 consensus_queue.cc:1059] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:49.748401 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:49.749086 30897 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:49.749258  1138 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:49.749604  1138 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:49.750350  1138 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:49.751941  1257 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:49.752249  1197 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:49.752693  1197 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:49.753036  1197 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.759958  1267 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.702318 30967 rpcz_store.cc:276] 0709 12:24:48.577237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.577845 (+   608us) service_pool.cc:224] Handling call
0709 12:24:48.578134 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.578340 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:48.596258 (+ 17918us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.693442 (+1097184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.693505 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:49.693552 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.693616 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.693720 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77936,"prepare.queue_time_us":17759,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":140136,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"thread_start_us":1017093,"threads_started":2,"wal-append.queue_time_us":437009}
I20260709 12:24:49.764062 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2059) took 1453 ms. Trace:
I20260709 12:24:49.764624 31045 rpcz_store.cc:276] 0709 12:24:48.310481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.454156 (+143675us) service_pool.cc:224] Handling call
0709 12:24:48.454459 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.651395 (+196936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.651641 (+   246us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.653503 (+  1862us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.964127 (+310624us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.964163 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.964230 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.763820 (+799590us) raft_consensus.cc:1685] finished
0709 12:24:49.763842 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.763975 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58370,"raft.queue_time_us":122927,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4670,"thread_start_us":380943,"threads_started":2,"wal-append.queue_time_us":1059924}
I20260709 12:24:49.770630 30892 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:24:49.780985 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:49.781643 31047 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:49.376327  1220 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:49.442342 31043 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:49.670220  1331 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:49.785060 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 94228.1us
I20260709 12:24:49.792985  1289 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:49.439546 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:49.795332 30867 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:49.799322 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:49.736856  1265 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:49.764837  1138 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:49.807919 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 65306.5us
I20260709 12:24:49.845755 31013 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:49.813969 30865 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.013s	sys 0.042s
W20260709 12:24:49.847055 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 51781us
I20260709 12:24:49.780524  1257 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:49.817605 30942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.020s	sys 0.085s
W20260709 12:24:49.817869  1252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.023s	sys 0.032s
W20260709 12:24:49.812170 30941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.019s	sys 0.047s
I20260709 12:24:49.804621 31616 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.442940  1203 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:49.816361  1289 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:49.814800  1231 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:49.823866 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:49.799875 31621 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
W20260709 12:24:49.843237 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 43980.5us
I20260709 12:24:49.798431 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2054) took 1519 ms. Trace:
I20260709 12:24:49.793707  1305 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:49.847538 30865 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.014s	sys 0.042s
W20260709 12:24:49.822446  1312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.009s	sys 0.026s
W20260709 12:24:49.833909  1144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.014s	sys 0.030s
W20260709 12:24:49.850706 31050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.006s	sys 0.017s
W20260709 12:24:49.967111 30942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.363s	user 0.021s	sys 0.085s
W20260709 12:24:49.968349 31050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.013s	sys 0.022s
W20260709 12:24:49.961917 30939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.087s	user 0.015s	sys 0.044s
W20260709 12:24:49.974421 30939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.016s	sys 0.044s
W20260709 12:24:49.974730 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 1.09969e+06us
I20260709 12:24:49.975489  1329 consensus_queue.cc:1059] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:49.976078 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 1.38124e+06us
I20260709 12:24:49.845342  1262 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:49.941604 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 75100.6us
W20260709 12:24:49.971251 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 1.23061e+06us
W20260709 12:24:49.971634 30941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.020s	sys 0.047s
I20260709 12:24:49.972594 31045 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:49.844728  1265 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.968998 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:49.858212  1252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.023s	sys 0.032s
W20260709 12:24:49.971079  1312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.015s	sys 0.030s
W20260709 12:24:49.994364 30894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.002s	sys 0.082s
W20260709 12:24:50.008036 30894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.003s	sys 0.082s
I20260709 12:24:50.009399 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:50.002679 30867 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:49.940770  1230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.013s	sys 0.020s
W20260709 12:24:49.946949  1206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.506s	user 0.027s	sys 0.034s
I20260709 12:24:49.969432 31048 rpcz_store.cc:276] 0709 12:24:48.278632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.373579 (+ 94947us) service_pool.cc:224] Handling call
0709 12:24:48.373898 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.374097 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:48.553528 (+179431us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.798052 (+1244524us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.798176 (+   124us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:49.798222 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.798283 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.798380 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59755,"prepare.queue_time_us":321625,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":65318,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7637,"thread_start_us":1266017,"threads_started":2}
I20260709 12:24:49.995747 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:50.005201 30940 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.010s	sys 0.019s
I20260709 12:24:50.005445 30898 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:50.006072  1320 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:49.983274  1144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.018s	sys 0.033s
W20260709 12:24:49.982755   554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.020s	sys 0.016s
W20260709 12:24:49.972151   969 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.000s	sys 0.027s
W20260709 12:24:49.947120 31042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.243s	user 0.020s	sys 0.037s
I20260709 12:24:49.849749  1317 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.849434  1307 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:50.007634 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:50.003768 30969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.512s	user 0.019s	sys 0.061s
W20260709 12:24:49.995805   981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.016s	sys 0.021s
I20260709 12:24:50.014681 30942 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:24:50.015130 30940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.010s	sys 0.019s
I20260709 12:24:50.015667 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:50.020646 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:50.014724  1338 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.986013  1289 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:50.003651  1069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.006s	sys 0.007s
I20260709 12:24:50.024570  1257 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:50.011646  1230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.016s	sys 0.020s
W20260709 12:24:50.013944  1206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.576s	user 0.028s	sys 0.035s
I20260709 12:24:50.027900 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:50.015519 31013 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:24:49.938802  1295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.008s	sys 0.025s
W20260709 12:24:50.028242 31051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.018s	sys 0.037s
W20260709 12:24:50.119381 31051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.272s	user 0.019s	sys 0.037s
I20260709 12:24:50.120236 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2034) took 1687 ms. Trace:
I20260709 12:24:50.029431 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:50.091912   981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.016s	sys 0.021s
I20260709 12:24:50.035640  1345 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:50.027918  1262 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:50.224481  1308 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:50.013867  1231 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:50.092027 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:50.109877 31045 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:50.110610 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.097210 30900 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:50.007947  1326 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:24:50.028187  1323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.003s	sys 0.024s
W20260709 12:24:50.265496  1323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.004s	sys 0.031s
W20260709 12:24:50.269683 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 258582us
I20260709 12:24:50.254853  1345 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:50.268919  1285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.185s	user 0.048s	sys 0.043s
W20260709 12:24:50.116822 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.095700 30865 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:50.070667   969 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.000s	sys 0.027s
W20260709 12:24:50.036139 31042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.332s	user 0.021s	sys 0.038s
I20260709 12:24:50.007310  1213 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:49.985690  1335 raft_consensus.cc:3055] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:50.120595 31051 rpcz_store.cc:276] 0709 12:24:48.432650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.845735 (+413085us) service_pool.cc:224] Handling call
0709 12:24:48.845987 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.846170 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:48.846689 (+   519us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.119862 (+1273173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.119917 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.119979 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.120049 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.120179 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":1272828,"threads_started":1}
W20260709 12:24:50.114851  1069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.006s	sys 0.007s
W20260709 12:24:50.147172 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 133694us
I20260709 12:24:50.148391 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:50.282636 30901 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.284860 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.148350  1338 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.149120  1271 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:50.109685  1317 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.091420  1307 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:50.120842  1295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.214s	user 0.009s	sys 0.027s
W20260709 12:24:50.150695  1333 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:50.151552 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1694) took 1744 ms. Trace:
W20260709 12:24:50.155144 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.157131 31049 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:50.159030 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:50.159935  1197 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:50.161110 30895 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.169718  1289 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:50.174780   947 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:50.176524 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.183868  1332 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.113837  1200 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:24:50.120596  1206 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:50.215058 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.244973 31616 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
W20260709 12:24:50.219595 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 204717us
I20260709 12:24:50.071517  1303 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.091429 30969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.600s	user 0.019s	sys 0.071s
I20260709 12:24:50.027793 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:50.346781 30901 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
W20260709 12:24:50.222884  1281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.368s	user 0.025s	sys 0.056s
I20260709 12:24:50.258410  1231 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:50.033241   554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.020s	sys 0.016s
W20260709 12:24:50.280176 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 184533us
I20260709 12:24:50.269348  1308 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:50.274780  1285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.049s	sys 0.043s
I20260709 12:24:50.288511 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:50.319839 31589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.046s	sys 0.075s
I20260709 12:24:50.319463 30894 rpcz_store.cc:276] 0709 12:24:48.407299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.445807 (+ 38508us) service_pool.cc:224] Handling call
0709 12:24:48.446110 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.542243 (+ 96133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.547043 (+  4800us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.589751 (+ 42708us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.008476 (+1418725us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:50.008523 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.008582 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.151299 (+142717us) raft_consensus.cc:1685] finished
0709 12:24:50.151321 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.151473 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":64141,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":1500031,"threads_started":2,"wal-append.queue_time_us":1488498}
W20260709 12:24:50.360077 30971 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.032s	sys 0.059s
W20260709 12:24:50.360127 31589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.046s	sys 0.075s
I20260709 12:24:50.331393 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.301043  1307 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.299278  1317 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.286043  1262 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:50.299463  1305 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.354460 30897 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 7. Ops: []
I20260709 12:24:50.355341 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.378934 31048 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:50.379895 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:50.358018 30865 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.360299 31045 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 4: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:24:50.360605 30971 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.032s	sys 0.059s
I20260709 12:24:50.328320 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:50.365095 31044 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.009s	sys 0.060s
W20260709 12:24:50.381628 31044 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.009s	sys 0.060s
W20260709 12:24:50.381896 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 53642.4us
W20260709 12:24:50.353233  1281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.495s	user 0.025s	sys 0.056s
I20260709 12:24:50.372227 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.372852 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.281791  1335 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:50.382989 31587 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.384124 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.349862  1271 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.385558 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.330879  1257 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:50.391783 31624 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:50.387122 31623 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:50.389201 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:50.365154 31617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.029s	sys 0.047s
I20260709 12:24:50.326848   981 consensus_queue.cc:1059] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:50.392875 31587 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.358033 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 900) took 1015 ms. Trace:
I20260709 12:24:50.392493 31621 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:50.393335 31620 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:50.400429 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.403343 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.408372 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.403158 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.416431 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2043) took 1845 ms. Trace:
I20260709 12:24:50.361773  1351 raft_consensus.cc:2764] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:24:50.400079 31617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.029s	sys 0.047s
I20260709 12:24:50.416880 30971 rpcz_store.cc:276] 0709 12:24:48.571074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.571414 (+   340us) service_pool.cc:224] Handling call
0709 12:24:48.574505 (+  3091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.574852 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.574880 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.584424 (+  9544us) log.cc:844] Serialized 26 byte log entry
0709 12:24:49.696822 (+1112398us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:50.381338 (+684516us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.386259 (+  4921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.386325 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.403900 (+ 17575us) raft_consensus.cc:1685] finished
0709 12:24:50.403923 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.416363 (+ 12440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4698,"raft.queue_time_us":151246,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":1666002,"threads_started":2,"wal-append.queue_time_us":1384717}
I20260709 12:24:50.393813  1285 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.431862 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.353811  1332 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.390738  1336 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.448624 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.367384  1303 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.400712  1267 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.394510  1354 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.443400 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:50.459406 31045 raft_consensus.cc:2410] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:50.444108  1350 log.cc:927] Time spent T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:24:50.450438 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:50.452013  1356 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:24:50.441758 31622 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:50.405419  1271 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:50.457213  1348 log.cc:927] Time spent T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:24:50.454608  1200 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.486052 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:50.447295 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.453752  1345 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.496250  1345 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.496680  1332 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.492451 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:50.502203 31622 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:50.405068 31616 rpcz_store.cc:276] 0709 12:24:49.338156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.347604 (+  9448us) service_pool.cc:224] Handling call
0709 12:24:50.353455 (+1005851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.459957  1336 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.493556 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:50.505839 31045 raft_consensus.cc:606] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:50.494309  1355 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:24:50.494099  1197 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:50.487847  1285 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.531955 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:50.532711 31622 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 4: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:50.458223  1351 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:24:50.445142  1231 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.483510  1267 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.453584  1308 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.503616  1144 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.556054 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:50.558264  1364 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:50.443600  1206 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.482213  1354 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:50.609736 31014 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.028s	sys 0.054s
W20260709 12:24:50.610160 31014 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.028s	sys 0.054s
W20260709 12:24:50.610425 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 816092us
I20260709 12:24:50.488411  1262 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.553050   947 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.611828 31051 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:50.619966 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:50.620731 31622 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.563403  1317 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.622309 31048 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:50.625491  1339 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:50.626060  1339 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:50.628707  1339 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:50.637935  1317 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:50.664641 31047 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.022s	sys 0.038s
W20260709 12:24:50.665845 31047 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.022s	sys 0.038s
I20260709 12:24:50.618659 31615 raft_consensus.cc:3055] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.617137  1338 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.668056 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:50.677811 31620 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.619202  1363 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:50.585520  1144 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.531090  1335 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.692407 31622 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:50.693745 31619 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:50.697211  1354 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.668769 31615 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:50.689307  1363 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.698431  1303 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.735292 31051 pending_rounds.cc:85] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 2
I20260709 12:24:50.708729  1267 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.737741 31048 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:50.740218 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46178 (request call id 90) took 2094 ms. Trace:
I20260709 12:24:50.740912  1213 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:50.741405  1213 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.735646 31051 pending_rounds.cc:107] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:24:50.748088 31051 raft_consensus.cc:2889] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:50.711603  1265 consensus_meta.cc:287] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.705s	user 0.004s	sys 0.007s
I20260709 12:24:50.749311  1265 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.739670 31048 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:50.716163  1271 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:50.750873 30893 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:50.717587  1144 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:50.718350  1336 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:50.753140  1345 raft_consensus.cc:3055] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.753545  1345 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:50.756681 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2060) took 2436 ms. Trace:
I20260709 12:24:50.757085 31050 rpcz_store.cc:276] 0709 12:24:48.320006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.513803 (+193797us) service_pool.cc:224] Handling call
0709 12:24:48.923234 (+409431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.923444 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:48.923741 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 12:24:49.130688 (+206947us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18004631e0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d540522 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:24:50.001922 (+871234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.001983 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:50.002029 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.002093 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.756479 (+754386us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54001c8750. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:50.756602 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28236,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":39299,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2500,"spinlock_wait_cycles":971478144,"thread_start_us":1029500,"threads_started":1,"wal-append.queue_time_us":1352669}
I20260709 12:24:50.758996 31050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:50.759959  1345 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.718708  1203 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.720945 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2061) took 2398 ms. Trace:
I20260709 12:24:50.764768 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2036) took 1031 ms. Trace:
W20260709 12:24:50.722669  1358 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:24:50.766111 31049 rpcz_store.cc:276] 0709 12:24:49.733632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.734418 (+   786us) service_pool.cc:224] Handling call
0709 12:24:49.752871 (+ 18453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.156973 (+404102us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b540014f620. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305a4dc0 00007f033062f1c0 00007f0330630231 00007f033062cd8f 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c
0709 12:24:50.319934 (+162961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.764529 (+444595us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54001c9154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:50.764707 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841312768}
I20260709 12:24:50.740607 31046 rpcz_store.cc:276] 0709 12:24:48.646065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.864819 (+218754us) service_pool.cc:224] Handling call
0709 12:24:50.739975 (+1875156us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002a4c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f0330633735 00007f033062b9fa 00007f03355f34c9 00007f032eb6fc54 00007f032eb6fbe2 00007f032eb6fb11 00007f032eb6fa8c 00007f032eb6ed42 00007f032e96848c 00007f032e9678c6
0709 12:24:50.740140 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3293991680}
W20260709 12:24:50.768150 30783 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8f02e5ab61a44506bdae958f8a275d96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:50.768697  1265 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.770620  1230 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.771282 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:50.771085  1230 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.764196 31043 rpcz_store.cc:276] 0709 12:24:48.322494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.696232 (+373738us) service_pool.cc:224] Handling call
0709 12:24:49.287459 (+591227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.797619 (+510160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.153165 (+355546us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540007d0d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:50.720748 (+567583us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540007d0d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:50.720886 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461822208}
I20260709 12:24:50.759541 31050 raft_consensus.cc:606] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.773823 31050 raft_consensus.cc:614] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:50.774840 31620 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:50.723960 31615 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.724509  1363 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.728231 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:50.780659 31615 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.781533 31623 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.724154  1335 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.725631 31622 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:50.784416  1230 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.722957  1307 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.786372 30896 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 6. Ops: []
I20260709 12:24:50.787375  1307 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.788491 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 904) took 1396 ms. Trace:
I20260709 12:24:50.724968 31616 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:50.799222 31617 rpcz_store.cc:276] 0709 12:24:49.392401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.392756 (+   355us) service_pool.cc:224] Handling call
0709 12:24:49.393107 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.441763 (+ 48656us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:50.436605 (+994842us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.695807 (+259202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.787913 (+ 92106us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.787962 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.788317 (+   355us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.788436 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1180769,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":62747,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":1228771,"threads_started":2}
I20260709 12:24:50.792004 31050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:50.801472 31050 raft_consensus.cc:606] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.802067 31050 raft_consensus.cc:614] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:50.801661  1213 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:50.797516 31623 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
W20260709 12:24:50.806892 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 47454.1us
I20260709 12:24:50.808396 31050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
W20260709 12:24:50.808605 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.809314 31016 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:50.809465 31050 raft_consensus.cc:606] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:50.810017 31050 raft_consensus.cc:614] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:50.810432 31016 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:50.811138  1264 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.811895  1264 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.812211  1264 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.812505  1264 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.820643  1295 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:50.823683  1295 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.824819 30799 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 4 to 5, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 5 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.825520  1264 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.826828  1295 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.827276 31050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:50.830143 31050 raft_consensus.cc:606] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.830546 31050 raft_consensus.cc:614] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:50.828573 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 800821us
I20260709 12:24:50.837368 31016 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:50.847278 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:50.827958  1323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.015s	sys 0.035s
W20260709 12:24:50.821300  1342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.007s	sys 0.047s
I20260709 12:24:50.851269 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2038) took 2404 ms. Trace:
I20260709 12:24:50.852262 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:50.854013 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:50.828183  1230 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.854983 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:50.848340 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 490370us
I20260709 12:24:50.826498 30799 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 3 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 5 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.858435 31016 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:50.828356  1203 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:50.853327  1342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.007s	sys 0.048s
I20260709 12:24:50.873364 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:50.847754  1195 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.847813  1295 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:50.847641  1267 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.851677 30969 rpcz_store.cc:276] 0709 12:24:48.442506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.442782 (+   276us) service_pool.cc:224] Handling call
0709 12:24:48.457301 (+ 14519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.457505 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:48.491046 (+ 33541us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.846563 (+2355517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.846620 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:50.846673 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.846756 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.846882 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7489,"prepare.queue_time_us":36145,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":147222,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":2347616,"threads_started":2,"wal-append.queue_time_us":1661716}
W20260709 12:24:50.853493  1323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.015s	sys 0.035s
W20260709 12:24:50.873804 30942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.001s	sys 0.016s
W20260709 12:24:50.850875   969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.001s	sys 0.013s
I20260709 12:24:50.873361  1363 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.878036  1092 consensus_queue.cc:1059] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:50.878233 30865 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.878778  1303 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:50.879237  1265 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:50.851930  1271 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.851791  1326 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.873937  1339 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:50.873868  1269 consensus_queue.cc:1059] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:24:50.883208 30799 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 4 to 6, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.872493  1230 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.871189 31016 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:50.849992  1335 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:50.906963 30795 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48640 (request call id 260) took 11002 ms. Trace:
W20260709 12:24:50.946405 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 75275.3us
I20260709 12:24:50.905306   554 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:24:50.946568 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.007s	sys 0.018s
W20260709 12:24:50.951336 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.008s	sys 0.018s
I20260709 12:24:50.946069 30799 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 4 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:50.951471   554 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:50.952293   554 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:50.952589 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 691628us
I20260709 12:24:50.952783   554 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:50.954105 30799 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 7 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.955616   947 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:50.956063   947 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:50.956928  1230 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.956815   947 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:50.950722 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:50.958065   947 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.960423   554 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:50.961073   554 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:50.961474   554 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:50.962288   554 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.963456   554 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:24:50.964812 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.967068 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:50.967676 31623 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.967978  1069 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:50.955629 30799 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 2 to 5, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:24:50.970135 30799 catalog_manager.cc:5697] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 3 to 6, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 6 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:24:50.944573  1339 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:50.975121  1339 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.976156 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:50.916697 30942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.001s	sys 0.016s
W20260709 12:24:50.916950 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 524111us
I20260709 12:24:50.974139 31623 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:50.978471 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:50.979707 31587 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:50.928236 30892 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:50.910982 30893 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:50.936040  1307 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.926070 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:50.905750  1332 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:50.888799  1203 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.983633 30896 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:50.916096  1295 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:50.990300 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 719858us
I20260709 12:24:50.917896  1267 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:50.992606  1144 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.944846  1264 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:50.949169 30795 rpcz_store.cc:276] 0709 12:24:39.890566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.916475 (+ 25909us) service_pool.cc:224] Handling call
0709 12:24:50.887234 (+10970759us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:46.261165 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:46.288438 (+ 27273us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:46.288487 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:24:46.288506 (+    19us) tablet.cc:662] Decoding operations
0709 12:24:46.364187 (+ 75681us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:46.364264 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:46.364290 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:24:46.365525 (+  1235us) tablet.cc:701] Row locks acquired
0709 12:24:46.365567 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:24:46.365726 (+   159us) write_op.cc:270] Start()
0709 12:24:46.365872 (+   146us) write_op.cc:276] Timestamp: P: 1783599886365666 usec, L: 0
0709 12:24:46.365890 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:24:46.404695 (+ 38805us) log.cc:844] Serialized 5072 byte log entry
0709 12:24:47.013303 (+608608us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b540021d9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f0330628e28 00007f0334063581 00007f0334062d58 00007f03340679f1 00007f03340679a9 00007f0334067939 00007f0334067901 00007f0334066b2d 0000000000388634 0000000000388479
0709 12:24:47.827035 (+813732us) op_driver.cc:464] REPLICATION: finished
0709 12:24:48.376576 (+549541us) write_op.cc:301] APPLY: starting
0709 12:24:48.398535 (+ 21959us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:48.456566 (+ 58031us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:48.456606 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:48.853788 (+397182us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:48.854121 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:24:48.854169 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:48.854570 (+   401us) log.cc:844] Serialized 95 byte log entry
0709 12:24:50.417139 (+1562569us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.438071 (+ 20932us) write_op.cc:454] Released schema lock
0709 12:24:50.448029 (+  9958us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:50.500262 (+ 52233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.500291 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1104817,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":443781,"apply.run_cpu_time_us":87885,"apply.run_wall_time_us":2181738,"num_ops":13,"prepare.queue_time_us":235383,"prepare.run_cpu_time_us":74276,"prepare.run_wall_time_us":768911,"raft.queue_time_us":771945,"raft.run_cpu_time_us":18750,"raft.run_wall_time_us":357642,"replication_time_us":1432812,"spinlock_wait_cycles":5555968,"thread_start_us":2296364,"threads_started":5,"wal-append.queue_time_us":1760304,"wal-append.run_cpu_time_us":64308,"wal-append.run_wall_time_us":1863812}]]}
I20260709 12:24:50.971441 30799 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 2 to 4, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 4 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.983878  1317 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:50.997198 30942 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:51.001533 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:51.002167 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:50.984141   981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.023s	sys 0.006s
W20260709 12:24:50.995955 31044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.001s	sys 0.022s
W20260709 12:24:51.019831 31044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.001s	sys 0.022s
W20260709 12:24:50.995477 30864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.010s	sys 0.013s
I20260709 12:24:50.941712  1342 consensus_queue.cc:1059] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:24:50.983520  1336 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.015928 31623 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:50.995771 31042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.007s	sys 0.015s
I20260709 12:24:51.015041 30799 catalog_manager.cc:5697] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 3 to 4, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:24:50.997068  1069 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:50.939248  1303 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.082989  1303 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.020174 30899 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:51.020725 30864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.010s	sys 0.013s
I20260709 12:24:51.084724 30864 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:51.085852 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:51.086199 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 89079.9us
I20260709 12:24:51.021605 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2038) took 1256 ms. Trace:
I20260709 12:24:50.985338  1326 consensus_queue.cc:1059] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:24:50.999883  1332 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:51.025223 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2039) took 1229 ms. Trace:
I20260709 12:24:51.093147 31047 rpcz_store.cc:276] 0709 12:24:49.796094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.796306 (+   212us) service_pool.cc:224] Handling call
0709 12:24:49.796601 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.796829 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:50.667115 (+870286us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.024881 (+357766us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.024943 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:51.024989 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.025052 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.025168 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":825210,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":5227,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":43841,"thread_start_us":1224794,"threads_started":2}
I20260709 12:24:51.014108  1197 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.097199  1197 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.099242  1326 raft_consensus.cc:3055] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:51.099453  1197 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.091495  1288 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.025779 31587 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:51.034592 31623 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
W20260709 12:24:51.021304   981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.023s	sys 0.006s
I20260709 12:24:51.041674 30799 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 2 to 3, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.048712 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.049130 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.049748 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.051934  1374 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:51.053380 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.054409 30897 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:51.055353   969 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.112476   969 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:51.113304   969 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:51.113574  1374 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.114727 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:51.115343 30897 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:51.102490  1257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.024s	sys 0.050s
I20260709 12:24:51.030642  1381 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.069000  1267 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.070937  1295 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:51.073307  1203 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.077582  1195 raft_consensus.cc:3055] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:51.019156  1213 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:50.879642  1354 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:51.021056  1317 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:51.091893  1206 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.117945  1335 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:51.100699 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 74990.4us
I20260709 12:24:51.177618 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:51.035306 31042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.007s	sys 0.016s
I20260709 12:24:51.107491 30900 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:51.087473 31044 rpcz_store.cc:276] 0709 12:24:49.765523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.765638 (+   115us) service_pool.cc:224] Handling call
0709 12:24:49.765959 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.766148 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:50.382034 (+615886us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.021289 (+639255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.021341 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:51.021382 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.021446 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.021554 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18,"prepare.queue_time_us":855709,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":687,"spinlock_wait_cycles":13128576,"thread_start_us":1254416,"threads_started":2}
W20260709 12:24:51.106703 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.109381 30901 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:24:51.179262 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.056559  1370 raft_consensus.cc:2764] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:24:51.059449  1363 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:51.084610  1069 raft_consensus.cc:697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:51.119645 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.122471 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:51.184513 30894 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:51.118377 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:51.185444 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 67161.6us
I20260709 12:24:51.186409 30939 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:51.097785  1342 raft_consensus.cc:3055] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:51.189254 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:51.130538 30897 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:24:51.132736 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.209858 30892 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:51.105264  1326 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:51.102885  1336 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:51.121177  1257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.024s	sys 0.050s
I20260709 12:24:51.098364  1332 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:51.099915 30864 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:51.178299 31618 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:51.180264 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.196810  1384 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.181304 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:51.196615  1376 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:51.183427 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.192147 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:51.134456  1195 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:51.223699 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 123846us
I20260709 12:24:51.224726 30893 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:51.225771 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 44546.9us
I20260709 12:24:51.225986 30893 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:51.195178 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.175832  1206 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.176167  1203 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:51.179031  1374 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.241211 31621 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:51.241654 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:51.183559  1372 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.189568  1342 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:51.194566  1092 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.211935 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:51.181810  1335 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:51.212818 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 262143us
I20260709 12:24:51.213992 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.179883 30900 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:51.129276 30799 catalog_manager.cc:5697] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.228184 30894 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:51.235260 31623 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:51.236804 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.237838 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.237847 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:51.202111 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 173937us
I20260709 12:24:51.245048 31620 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:24:51.254412 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.255434 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.256516 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.261616 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.262341 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.264011 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.218588  1376 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.222436  1329 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.275326 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.255003 31050 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:51.271067  1295 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:51.271229 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.238618  1206 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.279011 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.279670 31619 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:51.237290  1197 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.263118 31622 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:51.281380 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.283948 31048 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:51.240679  1257 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.244418  1352 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:51.287526 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:51.288311 31048 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.290266 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.290867 31616 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:51.298091 31016 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:51.204360  1069 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.272451 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.280047  1092 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:51.306237 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.309059 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.309492 31587 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:51.279559  1376 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.245543  1203 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:51.216311  1317 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:51.314167 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 69107.2us
I20260709 12:24:51.281486  1295 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.320214 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.322440 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:51.324385  1389 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:51.324692  1257 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.326750 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.339429 31048 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:51.255339  1372 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.304719  1267 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:51.375883 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:51.313807  1329 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:51.387763  1387 log.cc:927] Time spent T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 12:24:51.389381  1392 log.cc:927] Time spent T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:24:51.390780  1383 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:24:51.391820 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2062) took 3057 ms. Trace:
I20260709 12:24:51.391904 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.392210 31042 rpcz_store.cc:276] 0709 12:24:48.334104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.703501 (+369397us) service_pool.cc:224] Handling call
0709 12:24:48.703949 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.282100 (+1578151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.288535 (+  6435us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.360042 (+ 71507us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.187252 (+827210us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.194718 (+  7466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.198725 (+  4007us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.391572 (+192847us) raft_consensus.cc:1685] finished
0709 12:24:51.391594 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.391758 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56166,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":71711,"thread_start_us":2318307,"threads_started":2,"wal-append.queue_time_us":806082}
I20260709 12:24:51.395119 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2045) took 1425 ms. Trace:
I20260709 12:24:51.395551 31051 rpcz_store.cc:276] 0709 12:24:49.969368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.734795 (+765427us) service_pool.cc:224] Handling call
0709 12:24:50.735102 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:50.749320 (+ 14218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.749347 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:50.749843 (+   496us) log.cc:844] Serialized 52 byte log entry
0709 12:24:51.134203 (+384360us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:51.134241 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.134325 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.394868 (+260543us) raft_consensus.cc:1685] finished
0709 12:24:51.394890 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.395055 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":383920,"threads_started":1,"wal-append.queue_time_us":463012}
I20260709 12:24:51.405570 31051 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:51.405968 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 501) took 3373 ms. Trace:
I20260709 12:24:51.406411 30899 rpcz_store.cc:276] 0709 12:24:48.032509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.273275 (+240766us) service_pool.cc:224] Handling call
0709 12:24:48.284742 (+ 11467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.083699 (+2798957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.405677 (+321978us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b5400195354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:51.405867 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6290478848}
I20260709 12:24:51.407141  1363 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:51.409068  1203 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:51.411908  1295 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.377177  1257 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.412750  1257 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.413561  1345 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.416836  1335 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:51.339752  1308 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:51.418468  1308 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.420192 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.377599 31617 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.422045  1338 raft_consensus.cc:3055] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.422446  1338 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:51.298146  1342 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.423256  1338 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.424157  1342 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.425241 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.425992 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:51.426440 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.426847 31016 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:51.427902  1230 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:51.428270  1230 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.428613  1230 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.328044  1092 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.430096 31617 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
W20260709 12:24:51.430099  1397 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:24:51.431144 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.431658  1339 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.431921 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 698) took 1059 ms. Trace:
I20260709 12:24:51.432089  1339 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.427448 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.432505  1339 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.433730 31623 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:51.432693 31616 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:51.423141 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.432328 31618 rpcz_store.cc:276] 0709 12:24:50.372455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.373393 (+   938us) service_pool.cc:224] Handling call
0709 12:24:50.394133 (+ 20740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.216371 (+822238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.431705 (+215334us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540063f6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:51.431869 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803007232}
I20260709 12:24:51.436561 31616 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.427649 31016 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:51.420552  1308 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.448413 30896 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:24:51.392656  1385 log.cc:927] Time spent T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:24:51.457054 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 209531us
I20260709 12:24:51.460939 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.461606 30967 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:51.461881 31616 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:51.464689 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.381726  1329 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:51.441633 30942 connection.cc:256] RPC call timeout handler was delayed by -1.1562757069996223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 12:24:51.328231  1370 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:24:51.469573 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.470185 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.471316 30972 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:51.430724  1092 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.381947  1267 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.465034 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:51.474900 30967 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
W20260709 12:24:51.475836 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.477475 31621 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:51.480786 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.479156 30976 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:51.480640 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.464715  1197 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:51.456650  1295 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.481858 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.474805  1329 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.483208 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.483491 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.533584 30972 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:51.484750 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.534718 30969 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:51.482054 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.320747  1326 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.479787  1267 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.494724  1257 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.484972  1352 raft_consensus.cc:697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:51.503391  1092 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:51.504261 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:51.545362  1352 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:51.546824  1391 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
I20260709 12:24:51.547087 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.549047 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:51.549657 31624 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.549831 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.515209 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.550454 30972 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.550729 31051 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:51.515453 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:51.551457 31048 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:51.327292  1195 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:51.518574 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.519909 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.481091  1405 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:51.482570 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.520745 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.555514 30967 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:51.556362 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.530447 30974 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:51.532429 31047 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:51.557689 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.558277 30973 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:51.538983 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.559173 30975 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:51.560341 30865 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:51.561970 30865 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:51.472564  1400 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:51.520876 31049 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:51.553258 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.571512  1265 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.571965  1265 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.572279  1265 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.477077  1308 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:24:51.573263 31048 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:51.574965 30972 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:51.577401 31622 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:51.577780 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.579880 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.583282 31624 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:51.585150 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:51.585508 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:51.586057 30900 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:51.582780 30967 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:51.584935 30899 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:51.592875 30969 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:51.543212  1197 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:51.598548 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:51.604799 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.604948 30967 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:24:51.566241  1092 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.615658 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.607389 31048 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:51.621922 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.622581 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:51.627223 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 251413us
I20260709 12:24:51.573205  1407 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.597512  1339 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.615990  1092 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.649526 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.573575  1405 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:51.634672  1407 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:51.657860  1401 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:51.609738  1400 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.657573  1197 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.648173  1092 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.691905 30976 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:51.712803 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:51.720603 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 91449.1us
I20260709 12:24:51.721555 30867 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:51.733641 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.746294 30976 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:51.771880 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.773196 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.773804 30976 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:51.774817 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:51.771934  1384 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:51.780654  1285 raft_consensus.cc:3055] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:51.781221  1285 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:51.782277  1285 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:51.783883  1408 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:24:51.781164  1384 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.788740  1339 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.690966  1407 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.664307  1404 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:24:51.790387  1384 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:51.792740  1405 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:51.783679  1285 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.795966  1230 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.798063  1230 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.744725  1372 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.745005  1267 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.825814  1267 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:51.826929  1257 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:51.664992  1206 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:51.828354 30895 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:51.829262  1206 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:51.846001 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:51.847023 30976 raft_consensus.cc:2393] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:51.905243 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.880017 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 158563us
I20260709 12:24:51.922345 30867 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:51.787276  1376 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:51.976096 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:52.021001 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.285015 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.012312 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 90060.3us
I20260709 12:24:52.291860 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:52.024482 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 461458us
I20260709 12:24:52.292503 31623 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:52.293465 30976 raft_consensus.cc:2410] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:52.294898 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:52.298544 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:52.298867 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:52.299222 31623 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:52.299536 31618 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:52.300361 31624 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:52.142244  1409 log.cc:927] Time spent T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:24:52.304416 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:51.926051  1401 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:52.304991 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:52.314582 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.309134 30970 raft_consensus.cc:2368] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:24:52.309677 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:52.315214 30892 raft_consensus.cc:2368] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:24:52.310329 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:52.311887 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:52.315973 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:52.315994 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:52.316608 30892 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:52.316982 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:52.317973 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:52.316548 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:52.319272 30899 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:52.313855 30867 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:52.305392 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:52.319543 30865 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:51.880538  1265 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:52.325799 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:52.304195  1285 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.000s
I20260709 12:24:52.005882  1416 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:52.008095  1400 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:52.331903 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.333832 31587 leader_election.cc:400] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:24:52.334158 31587 leader_election.cc:403] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:52.307691  1197 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.337641 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.167147  1407 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:52.339900 30901 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:52.324672  1404 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.324836  1372 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.317389  1336 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:51.957582  1329 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:52.343662 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:52.349186  1336 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:52.350248  1376 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:52.338960  1138 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.351290  1336 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:52.344857  1404 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.352176  1404 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.352778 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:52.352280  1197 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:52.358994 30967 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:52.366916 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.369174 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:52.369366 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.369652 30900 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:52.369791 30969 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:52.338743  1416 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:52.376587  1404 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:52.342715  1285 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:24:52.410949 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.412194 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.421093 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.426417 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.431171 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.432060 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:52.432826 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.434165 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:52.433184 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 109827us
I20260709 12:24:52.435524  1415 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.435700 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 112208us
I20260709 12:24:52.436084  1415 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:52.436682 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 150043us
W20260709 12:24:52.437888  1423 log.cc:927] Time spent T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:24:52.457108 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:52.459872 31014 leader_election.cc:336] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.528s (SENT)
I20260709 12:24:52.466202 30969 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:52.479142 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.482606  1265 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:52.485433  1407 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:52.483965  1416 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:52.487160  1092 consensus_meta.cc:287] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.000s
I20260709 12:24:52.489040  1329 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:52.489490 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.820333 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:52.821960 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.768380 30969 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:52.829524 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1694) took 1131 ms. Trace:
I20260709 12:24:52.829937 30969 rpcz_store.cc:276] 0709 12:24:51.697876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.478642 (+780766us) service_pool.cc:224] Handling call
0709 12:24:52.829453 (+350811us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:52.812278 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 352472us
W20260709 12:24:52.841459 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.846122 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.849913 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1699) took 1054 ms. Trace:
I20260709 12:24:52.813380 31619 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:52.815429  1415 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:52.815935 31623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:58086
I20260709 12:24:52.853268 31623 raft_consensus.cc:606] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:52.850346 30976 rpcz_store.cc:276] 0709 12:24:51.795154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.477204 (+682050us) service_pool.cc:224] Handling call
0709 12:24:52.849848 (+372644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.845069 31588 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:52.805612  1424 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.354s	user 0.000s	sys 0.000s
I20260709 12:24:52.862192 31588 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:52.856611 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.863483 31588 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:24:52.865192 31014 leader_election.cc:336] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.513s (SENT)
I20260709 12:24:52.865895 30969 raft_consensus.cc:2393] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:24:52.872426 31587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.024s	sys 0.012s
W20260709 12:24:52.873473 31587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.025s	sys 0.013s
W20260709 12:24:52.874089 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 553146us
I20260709 12:24:52.874250 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.874897 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:52.875314 30976 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:52.872629 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:52.881110 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.882221 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.868127  1285 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:52.867220  1336 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.886416  1336 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:52.886806  1336 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:52.887156  1336 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:52.816823  1092 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:52.893895  1092 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:52.894743 30896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1725) took 1808 ms (client timeout 1758 ms). Trace:
W20260709 12:24:52.895171 30896 rpcz_store.cc:269] 0709 12:24:51.085831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.094047 (+  8216us) service_pool.cc:224] Handling call
0709 12:24:52.894513 (+1800466us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540009b354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:52.894644 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607899520}
I20260709 12:24:52.895531 30974 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:52.885198 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.899700 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:52.905256 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2022) took 1335 ms. Trace:
I20260709 12:24:52.905340 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1692) took 1215 ms. Trace:
I20260709 12:24:52.906212 30969 rpcz_store.cc:276] 0709 12:24:51.691076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.899074 (+1207998us) service_pool.cc:224] Handling call
0709 12:24:52.905214 (+  6140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:52.905717 30897 rpcz_store.cc:276] 0709 12:24:51.569431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.569553 (+   122us) service_pool.cc:224] Handling call
0709 12:24:51.569888 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.876852 (+306964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.876884 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.877404 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.249146 (+371742us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:52.249185 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.249252 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.905006 (+655754us) raft_consensus.cc:1685] finished
0709 12:24:52.905025 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.905190 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63969,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5565,"thread_start_us":677940,"threads_started":2,"wal-append.queue_time_us":534355}
I20260709 12:24:52.907740 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.905768  1415 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.917039 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.918524 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:52.919409 30976 raft_consensus.cc:2376] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5. Re-sending same reply.
I20260709 12:24:52.919929 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:52.921227 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1680) took 1243 ms. Trace:
I20260709 12:24:52.921542 30969 rpcz_store.cc:276] 0709 12:24:51.677727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.919663 (+1241936us) service_pool.cc:224] Handling call
0709 12:24:52.921168 (+  1505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.048029 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.048961 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1688) took 1369 ms. Trace:
I20260709 12:24:53.049266 30976 rpcz_store.cc:276] 0709 12:24:51.679565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.920045 (+1240480us) service_pool.cc:224] Handling call
0709 12:24:53.048893 (+128848us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:52.914265  1401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.017s
I20260709 12:24:53.059418 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.063103 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.081913 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.082696 30976 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:53.083173 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1707) took 1285 ms. Trace:
I20260709 12:24:53.083465 30976 rpcz_store.cc:276] 0709 12:24:51.797269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.049910 (+1252641us) service_pool.cc:224] Handling call
0709 12:24:53.083110 (+ 33200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:53.060233  1401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.010s	sys 0.017s
I20260709 12:24:53.085670  1401 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:53.086848  1401 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.084847 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.095746 30969 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:52.929754  1415 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:53.097589 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:53.098910 30970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 483) took 1628 ms (client timeout 1751 ms). Trace:
W20260709 12:24:53.099460 30970 rpcz_store.cc:269] 0709 12:24:51.469491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.469604 (+   113us) service_pool.cc:224] Handling call
0709 12:24:53.097302 (+1627698us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400327154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:53.097451 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903313152}
W20260709 12:24:53.081928 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 229708us
I20260709 12:24:53.098933  1436 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:53.114836 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.121675  1436 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.125715  1436 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.123325  1329 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:53.127381  1329 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.130306  1329 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.130963  1329 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.123054  1092 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:53.136449  1092 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:53.139492 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 264667us
W20260709 12:24:53.140162 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 273972us
I20260709 12:24:53.140846 31588 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:53.121912 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.140791 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:53.142369 30976 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.119256 30969 raft_consensus.cc:2410] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:53.150269 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1683) took 1471 ms. Trace:
I20260709 12:24:53.182598 30970 rpcz_store.cc:276] 0709 12:24:51.678450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.112984 (+1434534us) service_pool.cc:224] Handling call
0709 12:24:53.149738 (+ 36754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.149920 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.149945 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.149997 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:53.150031 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.150084 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.150201 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:53.225510 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.233134 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1685) took 1554 ms. Trace:
I20260709 12:24:53.233597 30969 rpcz_store.cc:276] 0709 12:24:51.678922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.232261 (+1553339us) service_pool.cc:224] Handling call
0709 12:24:53.232597 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.232802 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.232833 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.232887 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:53.232924 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.232979 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.233075 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:53.238929 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 98193.3us
W20260709 12:24:53.244740 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:53.247284 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 106495us
I20260709 12:24:53.249188 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1684) took 1570 ms. Trace:
I20260709 12:24:53.257215 30970 rpcz_store.cc:276] 0709 12:24:51.678693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.234703 (+1556010us) service_pool.cc:224] Handling call
0709 12:24:53.248534 (+ 13831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.248714 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.248740 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.248783 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:53.248939 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.249009 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.249127 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.148620  1440 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.263778 30969 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:53.264560 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1686) took 1585 ms. Trace:
I20260709 12:24:53.265321 30976 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:53.266314 30976 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:24:53.266557 30976 pending_rounds.cc:85] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 1
I20260709 12:24:53.266749 30976 pending_rounds.cc:107] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:24:53.266942 30976 raft_consensus.cc:2889] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:53.267369 31014 leader_election.cc:336] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.615s (SENT)
I20260709 12:24:53.264876 30969 rpcz_store.cc:276] 0709 12:24:51.679134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.263204 (+1584070us) service_pool.cc:224] Handling call
0709 12:24:53.263574 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.264295 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.264500 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:53.270619 31014 leader_election.cc:336] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.625s (SENT)
W20260709 12:24:53.271507 31014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.631s (SENT) [suppressed 37 similar messages]
W20260709 12:24:53.272361 31014 leader_election.cc:336] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.684s (SENT)
I20260709 12:24:53.272857 30970 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:53.273705 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1689) took 1593 ms. Trace:
I20260709 12:24:53.274057 30970 rpcz_store.cc:276] 0709 12:24:51.688582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.260962 (+1572380us) service_pool.cc:224] Handling call
0709 12:24:53.272412 (+ 11450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.273355 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.273630 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:53.268509  1434 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:24:53.277689 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1690) took 1588 ms. Trace:
I20260709 12:24:53.278221 30976 rpcz_store.cc:276] 0709 12:24:51.688912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.265857 (+1576945us) service_pool.cc:224] Handling call
0709 12:24:53.266090 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.277414 (+ 11324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.277627 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.251009  1437 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.287667  1443 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.288537  1443 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.290681 31587 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:53.291311  1443 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.152295  1329 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.300223 30970 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:53.301532 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1693) took 1610 ms. Trace:
I20260709 12:24:53.301783 30970 rpcz_store.cc:276] 0709 12:24:51.691589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.274800 (+1583211us) service_pool.cc:224] Handling call
0709 12:24:53.293398 (+ 18598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.301293 (+  7895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.301479 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.303467 30976 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:53.304145 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1697) took 1555 ms. Trace:
I20260709 12:24:53.304387 30976 rpcz_store.cc:276] 0709 12:24:51.748815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.279585 (+1530770us) service_pool.cc:224] Handling call
0709 12:24:53.300892 (+ 21307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.303963 (+  3071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.304106 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:53.292791  1429 log.cc:927] Time spent T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:24:53.306375 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2058) took 1834 ms. Trace:
I20260709 12:24:53.295488  1437 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.276510  1092 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:53.278295 31014 leader_election.cc:336] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.841s (SENT)
I20260709 12:24:53.276715  1447 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:53.313194  1447 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.315093  1447 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.282078  1440 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.315379  1329 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.315943  1329 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.317669 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 515) took 1006 ms. Trace:
I20260709 12:24:53.318020 30901 rpcz_store.cc:276] 0709 12:24:52.311161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.311256 (+    95us) service_pool.cc:224] Handling call
0709 12:24:52.311510 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.340292 (+ 28782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.317449 (+977157us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400208354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:53.317613 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64861056}
I20260709 12:24:53.306708 30968 rpcz_store.cc:276] 0709 12:24:51.472315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.489166 (+ 16851us) service_pool.cc:224] Handling call
0709 12:24:51.489536 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:51.489961 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.489988 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:52.376446 (+886458us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b2c00010828. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032ef26a11 00007f032ef36372 00007f0330668a01 00007f033062d43a 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2
0709 12:24:52.377082 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 12:24:52.815486 (+438404us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:52.815517 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.815597 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.306093 (+490496us) raft_consensus.cc:1685] finished
0709 12:24:53.306112 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.306322 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":60586368,"thread_start_us":438034,"threads_started":1,"wal-append.queue_time_us":654482}
I20260709 12:24:53.320452  1092 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.321417  1092 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.282953  1446 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:53.316385  1329 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:53.322535  1338 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.325909  1437 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.327126  1415 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.334662 30976 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:53.335098 30976 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:53.319701 31014 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:53.337756 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 59508.1us
I20260709 12:24:53.335857 30976 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.342480 30976 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.323974  1447 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.324198  1446 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.311794  1442 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:24:53.342484  1437 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:53.354153 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.341950  1440 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:53.355854  1453 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.356371  1453 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.357095  1329 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.355877  1440 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.343520  1285 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.366698  1452 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.359200  1447 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.361976  1440 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.368445  1447 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.368613  1336 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.370569  1447 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.367605  1329 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:53.371652  1452 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.374980  1452 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.347609  1451 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.380818 30939 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:53.353137  1446 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.376941  1336 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.377776  1449 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.388348 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:53.389317 30976 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:53.396750 30976 pending_rounds.cc:85] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 5
I20260709 12:24:53.397084 30976 pending_rounds.cc:107] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:53.380200  1453 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.380239  1452 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:53.394100   554 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:53.398411 30942 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:53.399140 30976 raft_consensus.cc:2889] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:53.400041 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1720) took 1026 ms. Trace:
I20260709 12:24:53.410128  1453 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:53.410158  1092 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.412321  1453 consensus_queue.cc:1059] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.413206 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 513) took 1102 ms. Trace:
I20260709 12:24:53.410089 30976 rpcz_store.cc:276] 0709 12:24:52.373817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.311663 (+937846us) service_pool.cc:224] Handling call
0709 12:24:53.334558 (+ 22895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.399741 (+ 65183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.399974 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.413584 30894 rpcz_store.cc:276] 0709 12:24:52.310433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.310564 (+   131us) service_pool.cc:224] Handling call
0709 12:24:52.896031 (+585467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.896322 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:52.896349 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:52.896387 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:52.896422 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.896462 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.413027 (+516565us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540009b350. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:53.413144 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125636,"raft.queue_time_us":2438,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":12871,"spinlock_wait_cycles":1330507648}
I20260709 12:24:53.392057  1437 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.398828  1452 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:53.398811   554 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.422518 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.423133 31623 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 3.
I20260709 12:24:53.409299  1336 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:53.426035 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:53.430022 30901 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:53.431319 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:53.419435  1338 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.432142 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:53.419500  1440 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.432873 30894 raft_consensus.cc:2393] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:53.433106 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:53.433658 31619 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.399444  1449 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:53.415705  1447 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:53.439064 31624 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:53.439689 30942 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:53.440016 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.440915 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:53.448185 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:53.445613 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:53.449613 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:53.383702  1451 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.421344   554 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.452628 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:53.459376 30901 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
W20260709 12:24:53.455426 31014 leader_election.cc:336] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.916s (SENT)
I20260709 12:24:53.460536 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:53.456027 30898 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:53.416142  1092 consensus_queue.cc:1059] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:24:53.457261 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.465195 31048 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:53.437245  1416 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.462785 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:53.425324  1435 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:53.470005  1435 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:53.471782  1420 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 1.117s	user 0.010s	sys 0.014s
I20260709 12:24:53.472352  1435 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.456522 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.453747 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.420935  1459 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.432474  1338 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.464430  1213 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:53.453665  1447 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:53.474913 31014 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.093s (SENT)
I20260709 12:24:53.458627 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.420395  1437 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.482821 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.432880  1440 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.472546 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:53.485700 31050 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:53.488854 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.500774 31044 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:53.485195 30897 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:53.437856  1336 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.463358  1455 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:53.531476 31014 leader_election.cc:336] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.799s (SENT)
W20260709 12:24:53.619488 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 88076.3us
W20260709 12:24:53.620240 31014 leader_election.cc:336] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.021s (SENT)
I20260709 12:24:53.620609 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:53.621682 31014 leader_election.cc:336] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.111s (SENT)
I20260709 12:24:53.622092 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:53.640094  1461 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:24:53.685542   554 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.686599  1271 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.499195 31615 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:53.660077  1443 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:53.676174  1379 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:53.712414  1379 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:53.713899 31622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 727) took 2457 ms (client timeout 1796 ms). Trace:
W20260709 12:24:53.714383 31622 rpcz_store.cc:269] 0709 12:24:51.256556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.326509 (+ 69953us) service_pool.cc:224] Handling call
0709 12:24:53.713663 (+2387154us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54006bb554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:53.713800 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459540736}
I20260709 12:24:53.700026 31043 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:53.736732 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.690943  1447 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.693531  1455 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.480196  1452 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:53.743474 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 121816us
W20260709 12:24:53.746817 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 307167us
I20260709 12:24:53.743606 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:53.749516 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.750720 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:53.757588 31621 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:53.749720 31014 leader_election.cc:336] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.152s (SENT)
I20260709 12:24:53.750819 31619 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
W20260709 12:24:53.768124 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.751335 30942 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:53.785394 30786 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8f02e5ab61a44506bdae958f8a275d96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9f38f761eded4f28b9d802f6570ee71e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:53.740582  1435 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:53.749053  1457 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.714754  1379 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.796087 31621 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:53.797734 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.803714 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.787575  1440 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.801017 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.788815 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:53.810247 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.810319 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.791338  1442 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.819383 31615 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.822654  1338 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.810468 31016 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:53.800349  1452 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.812839 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.827183 30976 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:53.813619  1465 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:53.814311 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 63043.5us
I20260709 12:24:53.814604  1446 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.795779  1467 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.816296 31617 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:53.835646   554 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.825318 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.837170  1446 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:53.837226 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.838500 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.839015 30973 raft_consensus.cc:2376] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8. Re-sending same reply.
I20260709 12:24:53.825511 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.802755  1399 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.828266 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.830474 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.844249 30976 raft_consensus.cc:2376] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6. Re-sending same reply.
I20260709 12:24:53.801047  1435 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.847378 31615 raft_consensus.cc:2410] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:53.849093 31615 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:53.830803 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:53.817874 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.834762  1467 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.841524 30972 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:53.851397  1465 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.852257 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:53.854111 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.854795 31619 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:53.856554 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.831564  1338 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.857940 30942 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:53.861393 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:53.865778 30968 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:53.862854 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:53.868536 30942 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:53.869997 30973 raft_consensus.cc:2376] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7. Re-sending same reply.
I20260709 12:24:53.850448  1449 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.856243   554 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.874913 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.872262 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:53.860009  1338 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.819552  1442 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.879913  1465 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.803294  1457 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.871456  1455 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:53.869675  1454 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:53.857820  1471 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:53.883617 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.883383 30972 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:53.885937 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.861774  1451 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:24:53.861220  1437 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.886696  1447 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.891392  1435 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.875890  1336 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:53.893558 31624 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:53.896036  1467 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:53.901464  1195 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.901721  1404 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:53.903445 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.905424  1442 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.853009  1399 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:53.866273  1466 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.945556 31014 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:53.912660 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 71917.1us
I20260709 12:24:53.914928 30968 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:53.949810 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.917980 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:53.874981  1472 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:53.920809 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:53.922086 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.950381 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:53.952064 30976 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:24:53.922003 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.906953  1455 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.891396  1338 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:53.873701  1470 consensus_queue.cc:1059] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:24:53.954896 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.955600 30976 raft_consensus.cc:2368] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:24:53.956298 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.956826 30976 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
W20260709 12:24:53.925220 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.958386 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.959163 31616 raft_consensus.cc:2410] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:53.920846 31615 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:53.927649 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:53.912858   554 consensus_queue.cc:1059] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:24:53.926930  1457 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:53.923408  1437 consensus_queue.cc:1059] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:53.921394  1447 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:53.946853  1466 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:53.960319 31014 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:53.960449 31049 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:24:53.929247  1467 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:24:53.962364 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.983302 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.963873 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:53.985872 30976 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.964936 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.954499  1455 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.974327 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.981019 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 517) took 1669 ms. Trace:
I20260709 12:24:53.988214 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:53.989502 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:53.990841 31044 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:53.991814 31620 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:53.993387 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:53.994407 30894 raft_consensus.cc:2410] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:53.996466 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.004683 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:53.989957 30900 rpcz_store.cc:276] 0709 12:24:52.311656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.325050 (+ 13394us) service_pool.cc:224] Handling call
0709 12:24:52.325307 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.370171 (+ 44864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.980842 (+1610671us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b5400207e54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:53.980971 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101326720}
I20260709 12:24:54.005844 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.006034 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.006580 31620 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:54.008059  1471 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:54.008338  1480 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:54.009486  1471 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.004833 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.012949 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.013999 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.014529 30968 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:54.015280 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.962123  1472 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:54.016342 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.009915 30976 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:54.010957  1264 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:54.018929 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:54.020649 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:54.020807 30864 connection.cc:256] RPC call timeout handler was delayed by -1.0394535390000783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 12:24:54.020977 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:54.021382 30976 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:54.016340 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.023638 31618 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:54.026285 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:54.026211 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.026517 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.027454 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.971999  1405 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.028141 30976 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:54.029479 30900 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:54.030784 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:53.980132  1307 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.982697  1466 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:54.034353 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 79029.4us
I20260709 12:24:54.018060 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.046676 31620 raft_consensus.cc:2410] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:54.045272 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:54.018971 30968 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:54.051240 31016 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:54.051760 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.052488 31044 raft_consensus.cc:2368] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:24:54.027787 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:54.058851 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:54.064851 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 98032.8us
I20260709 12:24:54.062284 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.033653  1342 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.032431  1405 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.064416 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:54.064954 31044 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:54.061769 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:54.065496 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 105268us
I20260709 12:24:54.067277 30865 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.069362 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:54.067633 31014 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.072266 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2018) took 2506 ms. Trace:
I20260709 12:24:54.073040 30865 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:54.047978  1448 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:54.075104 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:54.072691 30895 rpcz_store.cc:276] 0709 12:24:51.565619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.565910 (+   291us) service_pool.cc:224] Handling call
0709 12:24:51.594440 (+ 28530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.828706 (+234266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.072018 (+2243312us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540014a5d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:54.072209 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537436032}
I20260709 12:24:54.077304 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.078581 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.080574 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.081251 30968 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:54.054914  1478 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.055274 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:54.088398 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.057540  1269 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:54.090536 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.092206 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.097846 30942 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.099196 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.088429 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.070854  1342 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.068404  1405 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.094971 31588 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.102085 31588 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.103121 31588 leader_election.cc:400] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:24:54.048249  1307 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.104952 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:54.075528 31043 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.110496 31014 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.111568 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.103996 31588 leader_election.cc:403] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:54.122884 31588 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.123528 31044 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:54.126667 31588 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.102285 30942 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.137840 31621 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:54.163630 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.170343 31588 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.171357 31588 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.173107 31588 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:54.174129 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 77887.9us
I20260709 12:24:54.163384 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:54.175762 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.178668 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.094673  1478 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:54.100898  1401 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:54.181653 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 71248.2us
I20260709 12:24:54.105986  1342 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.183089 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:54.105796  1457 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:54.108537  1442 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:54.105515  1448 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:54.182389 30865 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:54.107079  1338 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:54.189734 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.108143  1467 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.193464 31044 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:54.211338 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.212975 31044 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:54.175046  1471 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:54.120472  1483 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:54.184307  1474 log.cc:927] Time spent T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 12:24:54.213076 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 139147us
I20260709 12:24:54.169261  1336 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:24:54.212466  1338 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:54.104158  1269 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:54.184616 31615 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:54.163961  1399 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:54.188613  1388 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:54.221287 30865 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.182070  1435 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:54.174889  1354 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:54.266767  1354 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:54.267216  1354 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.224601  1483 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:54.268188  1483 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.265594  1435 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:54.225533 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:54.269438 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.270355 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.271425 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.190469  1451 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:54.271845 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:54.271914  1481 consensus_queue.cc:1059] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:54.272701 30973 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:54.264741  1388 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:54.273214  1388 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.273530 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.273144  1455 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.230813 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:54.231688 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58639.5us
I20260709 12:24:54.249435 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 493) took 2709 ms. Trace:
I20260709 12:24:54.252728 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.185539  1478 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.276171 30967 rpcz_store.cc:276] 0709 12:24:51.540314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.650529 (+110215us) service_pool.cc:224] Handling call
0709 12:24:51.691701 (+ 41172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.359398 (+667697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.249089 (+1889691us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540016bcd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:54.249338 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534226816}
I20260709 12:24:54.229386  1404 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.194916  1442 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.194372  1446 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.289088 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.272607  1435 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.213346  1486 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:54.265401 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44211us
I20260709 12:24:54.275272 30976 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:54.255312 30942 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.272081 30968 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:54.106109  1472 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.309195 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:54.309782 31620 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:54.309870 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 169922us
I20260709 12:24:54.225086  1488 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:54.264024  1475 log.cc:927] Time spent T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.304s	user 0.001s	sys 0.001s
I20260709 12:24:54.260150  1457 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:54.288184 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.217976  1471 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.257513  1401 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:54.257841  1338 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.289764 31616 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
W20260709 12:24:54.303898 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48691.9us
I20260709 12:24:54.304682 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.310590 30864 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.272703  1481 consensus_queue.cc:1243] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer f868402d5ae640e7b362b9fddacbaf44 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:54.277252  1303 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:54.330425 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 99675.7us
I20260709 12:24:54.277601  1451 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:54.386754 31623 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:54.289903  1442 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.390120 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 490) took 2860 ms. Trace:
I20260709 12:24:54.385615  1326 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:54.287443  1404 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.289374  1446 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.390843  1486 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:54.357396 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 77200.5us
I20260709 12:24:54.330152 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.290198  1415 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:54.417299 31620 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
W20260709 12:24:54.418339 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 383505us
W20260709 12:24:54.392503  1487 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:24:54.297151  1447 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:54.432013 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.377815  1437 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:24:54.554251 31622 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:24:54.554795 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 244263us
I20260709 12:24:54.290110  1336 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.308856  1399 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:54.369699  1482 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.435071 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 244871us
I20260709 12:24:54.430272  1323 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:24:54.452204  1459 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.450434  1388 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.460980  1448 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.529223 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.556851 30974 rpcz_store.cc:276] 0709 12:24:51.529926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.628758 (+ 98832us) service_pool.cc:224] Handling call
0709 12:24:51.644333 (+ 15575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:52.895945 (+1251612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.389898 (+1493953us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540040f1d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:54.390065 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877060352}
W20260709 12:24:54.558350 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 253739us
I20260709 12:24:54.556351 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.596292 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.596880 31616 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:54.598796 31050 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:54.600435 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:54.603817  1448 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.559482 30864 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:54.609591 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 50197.6us
I20260709 12:24:54.610325 30864 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.561371 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:54.561859  1446 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.569295 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:54.570140 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 267115us
I20260709 12:24:54.561388  1307 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:54.573745  1303 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:54.574180  1335 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.574581  1451 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.573066  1336 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.571071  1467 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:24:54.492416  1469 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.650s	user 0.000s	sys 0.007s
I20260709 12:24:54.453418 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:54.456424  1477 raft_consensus.cc:3055] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:54.569571  1466 consensus_meta.cc:287] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.006s
I20260709 12:24:54.605336  1323 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:54.569366  1401 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:54.611460 31620 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:54.562099  1404 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.559412  1478 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:54.567308 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:54.612644 30942 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.620796  1471 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.621199  1457 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:54.432717  1455 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:54.647181 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:54.647403 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.648008 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:54.572175 31615 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
W20260709 12:24:54.653645 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 81207.3us
I20260709 12:24:54.650122 31624 raft_consensus.cc:2376] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5. Re-sending same reply.
W20260709 12:24:54.655887 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 55544.1us
I20260709 12:24:54.587335  1269 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:54.569736  1415 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:54.622256  1303 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:54.671603 31616 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:54.674008 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 61520us
I20260709 12:24:54.695168 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.696316 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:54.697376 30942 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.651053  1307 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:24:54.679076  1457 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:54.679060 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 122276us
W20260709 12:24:54.662890  1195 consensus_meta.cc:287] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.001s
I20260709 12:24:54.656548  1477 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:54.687842 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:54.691650 31050 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:54.664882  1267 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:54.671707  1462 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:54.672880 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 105674us
I20260709 12:24:54.720603 30900 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:54.660513  1437 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:24:54.700728 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 142370us
I20260709 12:24:54.674713  1501 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:54.676383 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 122362us
I20260709 12:24:54.650754  1335 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.708786 31014 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.708750 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:54.716326  1504 consensus_queue.cc:1059] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:24:54.686983  1498 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.739463 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:54.611116  1459 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:54.676892  1467 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:54.696986  1303 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.726065 30898 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:54.688661  1502 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:54.726701 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 130349us
I20260709 12:24:54.698343  1455 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.731992 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.698802  1506 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.735100 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2082) took 1308 ms. Trace:
I20260709 12:24:54.737066 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.706735  1449 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.727247  1462 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:54.713500  1456 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.726477  1339 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:54.730134  1195 consensus_queue.cc:1059] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:24:54.746007 30972 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:54.587925  1482 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.776609  1506 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.753094 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:54.766287 30974 raft_consensus.cc:2410] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:54.766499 30968 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:54.720360  1480 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:24:54.767926  1496 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:54.720609  1267 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:54.730751  1448 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:54.742316 31045 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:54.691859  1486 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:24:54.676203  1483 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:54.710213  1354 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.662736  1466 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.791137  1510 raft_consensus.cc:3055] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:54.786900  1485 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:24:54.801689  1401 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:54.769857 31047 rpcz_store.cc:276] 0709 12:24:53.426629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.426754 (+   125us) service_pool.cc:224] Handling call
0709 12:24:53.427093 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:53.439714 (+ 12621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.439765 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:53.452207 (+ 12442us) log.cc:844] Serialized 52 byte log entry
0709 12:24:53.755017 (+302810us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:53.912230 (+157213us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.912458 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.912539 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.458876 (+546337us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:54.727417 (+268541us) raft_consensus.cc:1685] finished
0709 12:24:54.734885 (+  7468us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.735033 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172066,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":447,"raft.queue_time_us":61076,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":42791,"spinlock_wait_cycles":2941696,"thread_start_us":392928,"threads_started":2,"wal-append.queue_time_us":358441}
I20260709 12:24:54.835009 31047 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:54.804623 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:54.805938  1506 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:54.790429  1342 consensus_meta.cc:287] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.576s	user 0.004s	sys 0.003s
I20260709 12:24:54.735170  1323 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:54.790429 31043 consensus_meta.cc:287] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.615s	user 0.002s	sys 0.010s
I20260709 12:24:54.738909  1440 consensus_queue.cc:1059] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 12:24:54.837553 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 100586us
I20260709 12:24:54.789813  1459 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:54.800993  1456 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.810220  1267 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:54.839751 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 229458us
I20260709 12:24:54.886425 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:54.842841 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 110896us
I20260709 12:24:54.753995  1435 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:54.859277 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 160875us
W20260709 12:24:54.866354 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 136962us
I20260709 12:24:54.887604 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:54.827922  1496 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:54.831547  1510 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:54.835397  1307 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.887895 31014 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:54.893616 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 137614us
I20260709 12:24:54.839699  1388 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:54.884598 31013 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.847787  1472 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.739091  1501 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.848160 31043 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:54.902791 31014 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.889734  1456 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:54.908833 30867 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:54.893260  1496 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.907564 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:54.848137  1342 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.895551  1459 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:54.895370 31042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2083) took 1467 ms (client timeout 1783 ms). Trace:
I20260709 12:24:54.926601 30867 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:54.928162  1505 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.929193  1505 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:54.892784  1506 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:24:54.852360  1428 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.196s
I20260709 12:24:54.913441  1317 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.895848  1307 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.915786  1480 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.929713  1505 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:54.943825 30975 raft_consensus.cc:2368] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:54.920460  1478 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:54.933775  1269 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:54.946992 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:54.947678 30969 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.899319  1472 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.930342  1490 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.946619  1505 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:54.972100 30971 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:54.952836  1480 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:54.955188  1503 log.cc:927] Time spent T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:24:54.946574  1510 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:54.967926  1513 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.922878 31042 rpcz_store.cc:269] 0709 12:24:53.427680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.434699 (+  7019us) service_pool.cc:224] Handling call
0709 12:24:54.804462 (+1369763us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:54.892561 (+ 88099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12709120}
I20260709 12:24:54.952832  1269 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:54.985309 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 250806us
I20260709 12:24:54.989461  1307 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:54.991029 31046 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:54.896191  1462 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:54.968160  1466 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:54.985015  1480 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:55.012866 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:54.968195  1497 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.982975  1482 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.023511 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.024031 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:55.032209 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 105682us
W20260709 12:24:55.035094 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 101820us
I20260709 12:24:55.036892 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.038794  1527 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:54.989993  1513 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:55.040347  1518 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
I20260709 12:24:55.015158  1455 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:55.016993  1269 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.041731 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:55.044612 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.040966  1455 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.046011 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.055074  1483 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.055163 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:55.017164  1525 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:55.047178  1405 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.932s	user 0.006s	sys 0.003s
I20260709 12:24:55.062124  1513 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:55.062747  1521 log.cc:927] Time spent T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:24:55.019347  1510 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.053920  1401 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:55.062996  1491 raft_consensus.cc:3055] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:55.063300  1401 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:55.063699  1401 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.065182 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.066264 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.067202 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:55.016896  1441 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.022814  1480 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.059196 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:55.068526 30899 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.068094  1441 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:55.069214 30971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 2049) took 3610 ms (client timeout 1726 ms). Trace:
W20260709 12:24:55.069628 30971 rpcz_store.cc:269] 0709 12:24:51.458861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.458978 (+   117us) service_pool.cc:224] Handling call
0709 12:24:55.069024 (+3610046us) spinlock_profiling.cc:243] Waited 3.25 s on lock 0x7b54001e5ad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:55.069119 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7479841024}
I20260709 12:24:55.070699 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:55.071195 30971 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.059401 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.071913  1335 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.072063 31051 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:55.074427  1447 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:55.074812  1447 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:55.067451  1456 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.075673  1447 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.077222 30971 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:55.078004 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 783) took 1100 ms. Trace:
I20260709 12:24:55.078204 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.046629  1446 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.079990 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.080169  1388 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.080668  1388 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.081022 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.068195  1460 raft_consensus.cc:3055] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:55.081791 30971 raft_consensus.cc:2410] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:55.060138 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.082347 30900 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:55.083109  1388 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.083381  1460 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:55.084337  1460 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.085592 31619 rpcz_store.cc:276] 0709 12:24:53.977080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.077254 (+1100174us) service_pool.cc:224] Handling call
0709 12:24:55.077543 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.077704 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.077727 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.077769 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:55.077805 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.077852 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.077941 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.083159 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.047286 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.079870  1506 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.087874 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.088177  1506 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.088539  1452 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:55.088963  1452 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:55.090023  1506 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.089726  1452 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.090692  1452 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.092962 30899 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:24:55.077526  1456 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.078145  1480 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.093778 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.097113 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.017648  1307 consensus_queue.cc:1059] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:24:55.080859  1446 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:55.121073 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.125047 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.080804   969 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:55.128392 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 69626.6us
I20260709 12:24:55.060626  1462 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.077275  1447 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.092183  1435 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:55.060827  1459 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:55.090668  1491 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:55.146576  1499 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.134290 30969 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:55.144742 30865 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:55.127635  1441 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:55.159888  1514 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:24:55.161191  1431 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.172698 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 265158us
I20260709 12:24:55.096295  1405 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:55.152282  1338 consensus_meta.cc:287] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.004s
I20260709 12:24:55.149482  1342 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:55.183588 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.164470 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:24:55.188158 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.161806  1431 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.204043 30973 raft_consensus.cc:2368] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:55.178411  1472 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.179524  1480 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:55.207259 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.208535  1323 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:24:55.211779  1517 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
W20260709 12:24:55.221436 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44489.8us
I20260709 12:24:55.184975  1338 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.227787  1532 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:55.247350  1529 log.cc:927] Time spent T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:24:55.221508  1491 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.229687  1532 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:55.258291 31623 raft_consensus.cc:1240] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.262167  1491 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.264778  1338 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.272472 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1701) took 3476 ms. Trace:
I20260709 12:24:55.222384  1323 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.272877 30970 rpcz_store.cc:276] 0709 12:24:51.795687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.302262 (+1506575us) service_pool.cc:224] Handling call
0709 12:24:53.313506 (+ 11244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.324543 (+ 11037us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:53.379707 (+ 55164us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.688984 (+309277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.689036 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:53.689081 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.272248 (+1583167us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b540008b454. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:55.272293 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.272413 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48508,"prepare.queue_time_us":90789,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":290450,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":23019,"spinlock_wait_cycles":12923264,"thread_start_us":319690,"threads_started":3,"wal-append.queue_time_us":95990,"wal-append.run_cpu_time_us":2098,"wal-append.run_wall_time_us":1220693}
W20260709 12:24:55.270524  1404 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.587s	user 0.002s	sys 0.008s
I20260709 12:24:55.272419  1532 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.287125  1455 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.280892  1505 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.288511  1323 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.290328  1415 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:55.292331  1442 consensus_meta.cc:287] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.713s	user 0.007s	sys 0.005s
I20260709 12:24:55.292512  1505 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.292866  1416 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.293358  1534 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:24:55.294561  1457 consensus_meta.cc:287] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 12:24:55.298960  1496 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.299216  1267 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.306532  1442 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.309371  1267 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.300540  1405 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.301920  1401 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.305384  1520 raft_consensus.cc:3055] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:55.305990  1303 consensus_meta.cc:287] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 12:24:55.305398  1416 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.282400  1404 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.324486  1525 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:55.310563  1457 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.326990  1457 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:55.327628  1303 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.330340  1401 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.341789  1501 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:55.306684  1471 consensus_meta.cc:287] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.001s
I20260709 12:24:55.343215  1471 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.321462  1520 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:55.346071  1520 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.361536  1496 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:55.363940  1471 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.431951 30896 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:55.444993 30969 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
W20260709 12:24:55.456056 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 281861us
I20260709 12:24:55.457118 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2092) took 1997 ms. Trace:
I20260709 12:24:55.457674 31048 rpcz_store.cc:276] 0709 12:24:53.459048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.490705 (+ 31657us) service_pool.cc:224] Handling call
0709 12:24:53.497300 (+  6595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.497716 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.497746 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.498288 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.968642 (+1470354us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b18003ad020. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:24:55.052299 (+ 83657us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:55.052333 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.052520 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.456239 (+403719us) raft_consensus.cc:1685] finished
0709 12:24:55.456289 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.456807 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9291,"raft.queue_time_us":119,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":138915,"spinlock_wait_cycles":4529920,"thread_start_us":83481,"threads_started":1,"wal-append.queue_time_us":1664906}
W20260709 12:24:55.477520 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.479324 31621 raft_consensus.cc:1240] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.488078  1431 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.489166  1303 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.488096  1285 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.491125  1442 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.492026  1285 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.491972  1404 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.508797  1285 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.513407  1520 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.521597  1230 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 12:24:55.538866 30976 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 2085) took 1510 ms (client timeout 1862 ms). Trace:
I20260709 12:24:55.539359  1544 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:55.540473  1544 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:55.530961  1443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.650s	user 0.006s	sys 0.013s
W20260709 12:24:55.542853  1443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.689s	user 0.007s	sys 0.014s
I20260709 12:24:55.539211 30864 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:55.530200  1197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.025s	sys 0.061s
W20260709 12:24:55.539397 30976 rpcz_store.cc:269] 0709 12:24:54.028548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.054586 (+ 26038us) service_pool.cc:224] Handling call
0709 12:24:55.538402 (+1483816us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540008c354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:55.538644 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480959232}
I20260709 12:24:55.548569  1544 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.550383 31013 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:55.551196  1197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.025s	sys 0.061s
I20260709 12:24:55.551704  1230 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:55.552275  1230 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.552714  1230 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:55.552951 31046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 2056) took 4034 ms (client timeout 1837 ms). Trace:
W20260709 12:24:55.553488 31046 rpcz_store.cc:269] 0709 12:24:51.518136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.518332 (+   196us) service_pool.cc:224] Handling call
0709 12:24:55.552432 (+4034100us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b5400159ad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:55.552660 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7908521344}
I20260709 12:24:55.557464 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2072) took 1286 ms. Trace:
I20260709 12:24:55.557888 31050 rpcz_store.cc:276] 0709 12:24:54.270802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.602848 (+332046us) service_pool.cc:224] Handling call
0709 12:24:54.603077 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.717758 (+114681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.556975 (+839217us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b54003d4d54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:55.557269 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203223936}
I20260709 12:24:55.563694 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:55.565038 30864 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:55.566113  1547 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:55.566665 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.566831 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.566983  1230 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.568084  1547 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:55.568588  1547 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:55.569020  1547 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.569677  1230 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.570079 31618 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:55.570688 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 941) took 1261 ms. Trace:
I20260709 12:24:55.570962 31618 rpcz_store.cc:276] 0709 12:24:54.309484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.309620 (+   136us) service_pool.cc:224] Handling call
0709 12:24:55.569202 (+1259582us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:55.569534 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.570473 (+   939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.570630 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5507328}
I20260709 12:24:55.572306  1501 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:55.573124  1501 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.574010  1374 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.575332  1501 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.579104  1354 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.568024 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 757) took 1172 ms. Trace:
I20260709 12:24:55.581244 31616 rpcz_store.cc:276] 0709 12:24:54.395361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.597598 (+202237us) service_pool.cc:224] Handling call
0709 12:24:54.597926 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.694292 (+ 96366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.567538 (+873246us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b54007616d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:55.567828 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168724352}
I20260709 12:24:55.584969 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 939) took 1286 ms. Trace:
I20260709 12:24:55.585424 31621 rpcz_store.cc:276] 0709 12:24:54.298328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.298574 (+   246us) service_pool.cc:224] Handling call
0709 12:24:54.298876 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.479975 (+1181099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.584645 (+104670us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005e29d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:55.584890 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713177856}
I20260709 12:24:55.586623 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.587509 31050 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:55.585988 31049 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:55.589788 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.591077 31049 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:55.587435  1499 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:55.590790  1477 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.598088 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.595050  1499 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:55.601286 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 54357.2us
I20260709 12:24:55.606123  1374 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.606575 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:55.607020 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:55.607913 31046 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.607410 31048 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.612840  1329 raft_consensus.cc:3055] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:55.613309  1329 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:55.626698 31615 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:55.628199 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:55.628398 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:55.629230 31620 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:55.630331 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:55.630949 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.631268 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:55.630992 31620 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.632382 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:55.637090 30975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1733) took 1591 ms (client timeout 1510 ms). Trace:
W20260709 12:24:55.637544 30975 rpcz_store.cc:269] 0709 12:24:54.045584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.054964 (+  9380us) service_pool.cc:224] Handling call
0709 12:24:55.636650 (+1581686us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54000217d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:55.636856 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012836736}
I20260709 12:24:55.639470 31618 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.614758  1329 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.632350 31615 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:55.657851 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:55.660018 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:55.660578 31617 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.660706 31622 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:55.663864 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 72918us
I20260709 12:24:55.665340 30975 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:55.665522  1416 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.666253 30864 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:55.667060 30968 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:55.667547  1379 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:55.668037  1379 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.668416  1379 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.671217  1436 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:55.673264  1483 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:55.673693  1483 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:55.673748  1471 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:55.674535  1471 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:55.675678 31048 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:55.640964  1329 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.678212 31046 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:55.674890  1483 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.675192  1538 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:24:55.679001 30864 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:55.690393 31013 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:55.689756 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:55.691974 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:55.692127 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:55.698350 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.699633 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.679324  1416 consensus_queue.cc:1059] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:24:55.698596 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.701226 31618 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.701050  1407 consensus_queue.cc:1059] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:24:55.701927  1544 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.704303 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:55.706319  1471 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:55.706849  1496 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:55.707386 31016 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:55.708894  1352 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:55.710059 30867 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:55.716813  1449 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.717264  1483 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.717489 31013 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:55.739646 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:55.740595 30901 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:55.741801 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.742039 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:55.742630 30897 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:55.716872 31615 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.717574 30968 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:55.720546 31616 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:24:55.721434 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.722036 30975 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:55.722688 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 54964.8us
I20260709 12:24:55.724083 31624 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.724547 31049 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.724887 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:55.699587  1197 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:55.726094 31620 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:55.736366 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2037) took 1089 ms. Trace:
I20260709 12:24:55.738611 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.750511  1520 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.760170 31050 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:55.749749  1471 raft_consensus.cc:2764] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:55.762014  1303 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:55.762416 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:55.766115  1554 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:55.771361  1336 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.771252 30894 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:55.767521 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.766893 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:55.761929  1525 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:55.779774  1525 raft_consensus.cc:697] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:55.749290 30895 rpcz_store.cc:276] 0709 12:24:54.647218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.647342 (+   124us) service_pool.cc:224] Handling call
0709 12:24:54.664182 (+ 16840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.689834 (+ 25652us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:54.690084 (+   250us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.817099 (+127015us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.817148 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:54.817196 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.735985 (+918789us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b54003ec6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:55.736037 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.736204 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8716,"prepare.queue_time_us":4199,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":1574,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":5291,"spinlock_wait_cycles":46633344,"thread_start_us":126027,"threads_started":1,"wal-append.queue_time_us":219417}
I20260709 12:24:55.787786 30975 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
W20260709 12:24:55.789013 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 99766.7us
I20260709 12:24:55.774489  1449 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:55.791894 30973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1740) took 1706 ms (client timeout 2225 ms). Trace:
W20260709 12:24:55.792281 30973 rpcz_store.cc:269] 0709 12:24:54.085066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.273287 (+188221us) service_pool.cc:224] Handling call
0709 12:24:55.791513 (+1518226us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400021f54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:55.791713 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131633408}
I20260709 12:24:55.792876  1264 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:55.802958 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 93119.3us
I20260709 12:24:55.802469 30864 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:55.814289 30864 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:55.817092  1482 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:55.801240  1230 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:55.783424  1547 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.797537  1520 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.834129  1230 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:55.882565 31016 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:55.876577  1285 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.825562 31588 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:55.892395 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 119303us
W20260709 12:24:55.895218 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 81001us
I20260709 12:24:55.883159  1230 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:55.897161 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 99747.2us
I20260709 12:24:55.829329  1449 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.857175  1443 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.901806  1401 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:55.781960  1525 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.904909 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:55.902810  1482 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:55.910810 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 88797.6us
W20260709 12:24:55.913988 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 104397us
I20260709 12:24:55.906903  1374 consensus_queue.cc:1059] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:24:55.926714 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:55.927387 31050 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:55.901306  1336 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:55.913363  1407 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:55.937770  1504 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.927084  1401 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:55.938436  1504 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.939442  1401 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.912984  1501 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.941028  1504 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:55.942124  1520 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.932828 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:55.955327 30864 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:55.937711  1407 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:55.957100  1407 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:55.953168 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 53484.3us
I20260709 12:24:55.960379 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:55.961122  1416 raft_consensus.cc:3055] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:55.961555  1416 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:55.962620  1416 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.962627  1399 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:55.964295  1399 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.964677  1399 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.967085  1354 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.967712  1354 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.970464  1354 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:55.972878 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:55.973625 30894 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:55.974035  1460 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:55.961027 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.976106 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.977619 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.978498 30971 raft_consensus.cc:2410] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:55.979951 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:55.981273  1524 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:55.981720  1524 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.982056  1524 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.983369 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:55.984019 30968 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.985472  1269 raft_consensus.cc:3055] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:55.985893  1269 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:55.986833  1269 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:55.947635  1556 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:24:55.998680 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52798.2us
I20260709 12:24:56.012336 30968 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:24:56.012296 31615 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:24:56.014209 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 58963.5us
I20260709 12:24:56.014673 30939 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:56.013295 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58858.8us
I20260709 12:24:56.020373 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.020979 31049 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:55.928172  1285 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.023048 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:55.941069  1501 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:55.991914  1336 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:56.007905  1544 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.032179 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:24:56.027477 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 72449.1us
I20260709 12:24:56.031322 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.016214  1520 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:56.037763 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.020257  1329 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:56.038543 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:56.023283  1354 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:56.019439  1269 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.020704  1416 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.043007 31046 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:56.043198 30970 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.029613 31617 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:24:56.047441 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 124333us
I20260709 12:24:56.029155  1499 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.049758 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2068) took 2045 ms. Trace:
I20260709 12:24:56.051927  1453 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:56.052064  1482 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.052590  1453 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.053146 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:56.054075 30976 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:56.054670 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2048) took 1043 ms. Trace:
I20260709 12:24:56.055518  1329 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.056984  1453 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.057744  1329 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.058120 31588 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:56.058602  1477 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.059021  1504 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:56.055300 31050 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.055227 30896 rpcz_store.cc:276] 0709 12:24:55.011515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.011634 (+   119us) service_pool.cc:224] Handling call
0709 12:24:56.035878 (+1024244us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400195854. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:56.054600 (+ 18722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936750464}
W20260709 12:24:56.063915 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.010076  1379 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.065375 30867 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:56.031587  1486 consensus_queue.cc:1059] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:56.050155 31044 rpcz_store.cc:276] 0709 12:24:54.004214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.213624 (+209410us) service_pool.cc:224] Handling call
0709 12:24:54.217620 (+  3996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.391371 (+173751us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:54.391680 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.555694 (+164014us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.648454 (+ 92760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.648508 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.648555 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.049319 (+1400764us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000ae6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:56.049388 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.049605 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149364,"prepare.queue_time_us":8810,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":279774,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7723,"spinlock_wait_cycles":399070976,"thread_start_us":44961,"threads_started":1,"wal-append.queue_time_us":265893,"wal-append.run_cpu_time_us":3651,"wal-append.run_wall_time_us":1370341}
I20260709 12:24:56.059010 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:56.040131  1520 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.043004  1354 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.065582 30968 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.055332 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 756) took 1660 ms. Trace:
I20260709 12:24:56.059373 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:56.034303  1544 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:56.079187 30976 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:56.076903 31623 rpcz_store.cc:276] 0709 12:24:54.394907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.568827 (+173920us) service_pool.cc:224] Handling call
0709 12:24:54.571524 (+  2697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.261235 (+689711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.054899 (+793664us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54004d0154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:56.055164 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575260032}
I20260709 12:24:56.000171  1443 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.059830  1504 raft_consensus.cc:697] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:56.079154  1404 raft_consensus.cc:3055] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:56.091878  1404 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:56.082468 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.086055 31042 raft_consensus.cc:1240] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:56.075142 30967 raft_consensus.cc:2410] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:24:56.092514 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.074043  1271 consensus_queue.cc:1059] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:24:56.076560  1520 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.081749  1354 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.084908  1544 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.085042  1329 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:56.124229 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.095274  1547 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.128891 31048 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:56.130945  1515 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:56.131081 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.132862 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.140131 31047 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:56.148207 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:56.151609 30896 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:56.163007 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 55471.6us
I20260709 12:24:56.164026 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.164770 31045 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:56.170797 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:56.172876 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.134198  1436 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:24:56.151325  1303 consensus_queue.cc:1059] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:24:56.172216 31049 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:56.151482  1329 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.169323  1453 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:56.139816  1404 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.194833 30865 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:56.184681  1532 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.198630 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:56.203890 31049 raft_consensus.cc:3055] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:56.204329 31049 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:56.205147 31049 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.206027 31049 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.207188 31046 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:24:56.208084 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.208406 30973 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:56.149672  1336 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.220335 31047 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:56.189967  1453 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:56.230161 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.232707 31045 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:56.242460 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.243188 31047 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:56.248246  1557 log.cc:927] Time spent T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:24:56.251749 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:56.252631 30973 raft_consensus.cc:1240] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:56.253695 31047 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
W20260709 12:24:56.254402 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 59660.8us
I20260709 12:24:56.255038 30864 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:56.232263 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:56.222478  1501 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.264671 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:56.265400 30968 raft_consensus.cc:2368] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:56.182075  1504 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.231963  1303 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:56.267477 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 154831us
W20260709 12:24:56.177662 30786 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8f02e5ab61a44506bdae958f8a275d96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9f38f761eded4f28b9d802f6570ee71e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:24:56.241729  1453 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.228367  1379 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.255265  1515 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:56.272231 31050 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:24:56.272959 30867 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:24:56.279597 31618 consensus_meta.cc:287] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.004s
I20260709 12:24:56.279945 31618 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:56.257777  1499 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:56.281898 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:56.258224  1449 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.284052 31622 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:56.271576  1436 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:56.267858  1303 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:24:56.285600  1558 log.cc:927] Time spent T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.216s	user 0.001s	sys 0.001s
I20260709 12:24:56.287389 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2090) took 1466 ms. Trace:
I20260709 12:24:56.275089  1501 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.290601 30969 raft_consensus.cc:2393] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:56.292066  1373 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:24:56.293179  1373 raft_consensus.cc:3055] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:56.293534  1373 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:56.293800  1264 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:56.294204  1264 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:56.288204 31588 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:56.273784 30786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 102283us
W20260709 12:24:56.289149  1483 consensus_meta.cc:287] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 12:24:56.288720  1443 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.297875 31042 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:56.290277 30972 rpcz_store.cc:276] 0709 12:24:54.723265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.794297 (+ 71032us) service_pool.cc:224] Handling call
0709 12:24:55.539663 (+745366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.540560 (+   897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.540592 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.541417 (+   825us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.595035 (+ 53618us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:55.595076 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.598872 (+  3796us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.719956 (+121084us) raft_consensus.cc:1685] finished
0709 12:24:55.719974 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.185513 (+465539us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540008be50. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:56.189969 (+  4456us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":270,"spinlock_wait_cycles":1713146240,"thread_start_us":53171,"threads_started":1,"wal-append.queue_time_us":99606}
I20260709 12:24:56.307111  1303 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.308529  1303 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.309381  1285 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.310058  1285 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:56.310494  1285 raft_consensus.cc:697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:56.211896  1538 consensus_queue.cc:1175] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1a7b44e2d0ed440985e5f643a5a54587" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:56.311832  1449 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.313959  1449 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.317310 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.318778 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.279523  1374 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:24:56.321434 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.322129  1499 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:56.322790 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.322659  1499 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.324072  1264 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.324836  1499 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:56.326830  1399 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:56.329223 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.330612 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.335134 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.337508 31049 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:56.338922 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:56.347584 31618 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:56.348686 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.350759 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.350993  1354 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.351379 31620 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:24:56.294468  1373 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.311396  1285 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.352591  1373 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.351415 31618 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:56.357640  1520 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.359561  1407 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.342119 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.343266 31016 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:56.377211 30968 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [4.2-5.3]
I20260709 12:24:56.384784  1532 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:56.387636  1544 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.389729  1544 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.391274 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:56.392699 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:56.393430  1486 consensus_queue.cc:1059] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:56.394431  1486 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:56.394903  1486 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:56.395879  1471 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:56.396701  1481 raft_consensus.cc:3055] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:56.397050  1481 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:56.397567  1567 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.397689  1477 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:56.365489  1449 consensus_queue.cc:1175] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9f38f761eded4f28b9d802f6570ee71e" responder_term: 4 status { last_received { term: 4 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 4 index: 7 } }
I20260709 12:24:56.397881  1499 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.392483  1524 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.419539  1499 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.422420  1499 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.422644  1197 raft_consensus.cc:3055] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:56.423017  1197 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:56.423817  1524 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.428119 30970 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:56.402251  1481 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.398329  1567 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.302028  1501 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.366822  1520 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:56.416008 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 135080us
W20260709 12:24:56.373920 31014 leader_election.cc:336] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.510s (SENT)
I20260709 12:24:56.429116 30974 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:24:56.430738 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 95045.6us
I20260709 12:24:56.432385 31621 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:56.415083  1477 raft_consensus.cc:697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:56.436371  1339 raft_consensus.cc:3055] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:56.454689 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 92862.7us
I20260709 12:24:56.484315 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:56.502242 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:56.502399 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.502990 31620 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.429692  1329 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:56.519562 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.521611 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.522186 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.525172 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:24:56.525720 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.443035  1339 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:24:56.525874 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 157370us
I20260709 12:24:56.532160 30976 raft_consensus.cc:1217] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Deduplicated request from leader. Original: 2.2->[5.3-5.3]   Dedup: 5.3->[]
I20260709 12:24:56.532258 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:56.527102 31588 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:56.536074 30976 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:56.537135 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.538112 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.532934 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.537732 31618 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:24:56.550884 31624 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:56.423841  1197 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.557794 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.428699  1486 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.562052 31621 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:56.564347 30896 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:56.546672  1271 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:56.565645  1271 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.567881  1470 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:56.546821 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.568466  1470 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.550457 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.570353 31617 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:56.571295 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.572499 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.573514 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.574472 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.575049 31617 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:56.576977 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.578087  1354 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.578231 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.579850 31624 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:56.580883 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.503656  1477 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.519599  1443 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:24:56.584498 31621 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:56.550735  1481 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:56.589619 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.591364  1404 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.555780  1285 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:56.605324  1285 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:56.606303  1285 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.612142  1407 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:56.615938 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.617079  1567 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:56.618896 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:56.619527 30976 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:56.620592 31042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:56.620820 31588 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:56.621316 31042 raft_consensus.cc:606] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:56.623587 31620 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:56.604839  1339 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.624687 31016 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:56.625262  1339 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.619565  1443 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:56.628895  1443 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:56.630106  1443 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:56.632018  1230 consensus_meta.cc:287] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.001s
I20260709 12:24:56.632493  1230 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.633780 31047 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:56.634824  1230 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:56.631705  1443 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.621619  1567 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:56.647702  1567 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.650159  1567 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.650688  1501 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.656946 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:56.657660 30976 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:24:56.658310  1515 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:56.658851 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 363520us
W20260709 12:24:56.659981  1575 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 12:24:56.659914  1532 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:56.659516 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 321084us
W20260709 12:24:56.658401 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 385463us
I20260709 12:24:56.664582 30867 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:56.665020 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.665177  1460 consensus_meta.cc:287] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.691s	user 0.002s	sys 0.009s
I20260709 12:24:56.659031  1515 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:56.665578  1489 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.666064 30971 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:56.666718  1374 raft_consensus.cc:3055] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:56.667104  1374 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:56.658677  1436 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:56.667984  1374 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.668751  1436 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.670149  1538 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.671007  1576 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:24:56.670740  1538 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.669173  1374 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:56.673291 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48681.5us
I20260709 12:24:56.587096  1470 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.584854  1399 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:56.710810 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.587762  1271 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:56.703970 31014 leader_election.cc:400] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
W20260709 12:24:56.714560 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.713903 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.646849  1471 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.715950 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.647418  1568 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:56.729354 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.729974 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.676745  1354 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.711663  1443 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:56.734071 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.736085 31050 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:24:56.676131  1564 consensus_queue.cc:1175] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f868402d5ae640e7b362b9fddacbaf44" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 12:24:56.645427  1499 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.726723  1454 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.746759  1354 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.747289  1520 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:24:56.747545 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.747993  1520 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.755532  1454 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.759536 31619 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:56.760396  1354 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.741626  1443 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:56.767350 30896 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:24:56.765136 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:56.770345 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 181794us
I20260709 12:24:56.773953 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.775147 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:56.776494 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 102535us
I20260709 12:24:56.755834  1197 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.732463  1471 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.764721  1520 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.765908  1416 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.798638 31014 leader_election.cc:400] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:56.799784 31014 leader_election.cc:403] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:24:56.761456  1568 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.803530 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:56.810758 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.814168 31050 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:56.817073  1416 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.818673  1264 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.819336  1416 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.820509 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.821328 31620 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:56.822249 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.823470 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:56.824190  1583 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:24:56.824709 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.817054 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.802950 31042 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:56.776695  1515 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.832017  1524 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:56.833115 30895 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:56.833364  1527 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.863822  1527 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.866616  1527 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.833746  1489 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.867594  1489 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.869618  1489 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.861851 30942 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:56.861775 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:56.888682 30894 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:56.841888 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:56.836056  1582 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:24:56.847290  1453 consensus_meta.cc:287] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.000s
W20260709 12:24:56.892040 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 59422.8us
W20260709 12:24:56.893707 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 90220.7us
I20260709 12:24:56.842486  1538 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.860571  1568 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.892907  1354 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:56.897847  1399 consensus_queue.cc:1059] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:24:56.901705 30942 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:56.902573 30895 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:56.837462  1471 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.896847 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.905453 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.835309  1454 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:56.843456  1567 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.907210 31049 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:56.894623 31587 connection.cc:256] RPC call timeout handler was delayed by -1.8050743299995702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 12:24:56.910234 31587 connection.cc:256] RPC call timeout handler was delayed by -1.7894935359995543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:24:56.910902 31587 connection.cc:256] RPC call timeout handler was delayed by -1.6769935359993724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
I20260709 12:24:56.909538 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:56.895434  1329 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:56.913949 31587 connection.cc:256] RPC call timeout handler was delayed by -1.5893262479994519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 12:24:56.914398 31587 connection.cc:256] RPC call timeout handler was delayed by -1.5893262479994519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 12:24:56.914744 31587 connection.cc:256] RPC call timeout handler was delayed by -1.587744998999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 12:24:56.915788 31620 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:56.918922 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.922106 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:56.923029 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.923924  1354 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.855930  1443 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:56.929873  1578 raft_consensus.cc:3055] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:56.933521 30892 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:56.931047 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.936175 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.933516 31624 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:24:56.937253  1570 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
I20260709 12:24:56.896572  1453 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:56.949903 30967 raft_consensus.cc:2368] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:56.909013  1568 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:24:56.939699  1453 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:56.917425  1329 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:56.963208  1329 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.940802  1460 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:56.951511 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 49890us
I20260709 12:24:56.965847 31049 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:24:56.966326 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:56.955941  1581 log.cc:927] Time spent T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:24:56.956339 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.957129 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.958480 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.959189 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.959609 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.960109 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.960732  1567 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:56.960884 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.960901 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.961573 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.977448 31048 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:56.962419 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:56.972568 30895 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
W20260709 12:24:56.974424 31587 connection.cc:256] RPC call timeout handler was delayed by -1.4635084419996929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:24:56.974000 30898 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:24:56.974884 31050 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:56.976279 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:56.997342  1471 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.997152 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.998736 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:56.997869 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:57.017675 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 110722us
I20260709 12:24:57.018115 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.004142 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.004837 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.006052 30901 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:57.005400 30897 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.019901 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.020219 30867 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:56.978349 31587 connection.cc:256] RPC call timeout handler was delayed by -1.4615262479997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:24:57.021037 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:57.048318 31587 connection.cc:256] RPC call timeout handler was delayed by -1.4615262479997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:24:57.023334 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:57.025014 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:57.048708 31587 connection.cc:256] RPC call timeout handler was delayed by -1.4539320139997471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 12:24:57.033330 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.934839  1578 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:57.036000 31043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b078c36427749489d90f67c6504ea82"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:57.036624 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.040652 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.041338 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:56.986848  1453 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:57.059374 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.055768 30899 raft_consensus.cc:2410] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:57.055848 31623 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:57.056802 31051 raft_consensus.cc:2393] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:57.060412 30942 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.053536 31624 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:24:57.059690 31045 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:24:57.031157  1329 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.022173 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:57.049130 31587 connection.cc:256] RPC call timeout handler was delayed by -1.4157293939997544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 12:24:57.063829 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.053840 30898 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:57.054236 31044 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:57.055342 30896 raft_consensus.cc:2368] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:57.059283 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.070283 30893 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:56.977626 31046 raft_consensus.cc:2410] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:24:57.055621  1489 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.062101  1486 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.063899  1449 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.084076  1449 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.084561  1578 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.085803  1578 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.086410  1449 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.063855 31049 raft_consensus.cc:2376] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6. Re-sending same reply.
I20260709 12:24:57.064011  1527 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:57.060086  1453 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:57.088115  1453 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.066268 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.089717 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.090296 30892 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.076969 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:57.067193 31587 connection.cc:256] RPC call timeout handler was delayed by -1.3973494679994474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:24:57.093523 31587 connection.cc:256] RPC call timeout handler was delayed by -1.3895262479995836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 12:24:57.093897 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2852865639997617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:24:57.094206 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2849247569997715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:24:57.094470 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2006778959998883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 12:24:57.094732 31587 connection.cc:256] RPC call timeout handler was delayed by -1.0799957629997152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 12:24:57.095484 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.096760 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.099525 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.100183 31050 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:57.098871 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.096673 31587 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.101389 31048 raft_consensus.cc:2410] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:57.102463 31587 leader_election.cc:400] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:24:57.049484 30894 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:57.068943 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.104323 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.104564 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.105059 30892 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:57.104856 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.093698 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:24:57.105692 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.106822 30899 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:57.071583 31620 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:57.107290 31587 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.107635 31620 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:57.108050  1501 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.108484 31620 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.108897  1501 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.109441 31620 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.108508 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:57.111595 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.112489  1431 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:57.112936 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:57.113108 31587 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.113353  1454 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.113629 31619 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.113965  1567 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.115411  1567 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:57.117265 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:57.075117 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 55372.5us
I20260709 12:24:57.071429 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:24:57.123854 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52472.7us
I20260709 12:24:57.066447 31043 raft_consensus.cc:606] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:57.125131 31043 raft_consensus.cc:614] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:57.065662  1471 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.081190  1568 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.146966 31620 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:24:57.147423 31620 pending_rounds.cc:85] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 7
I20260709 12:24:57.081933 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.067238 31618 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:57.105296 30901 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:57.120461 31619 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:24:57.148775 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.123375 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.079385 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.077471 30942 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.131146 30895 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:24:57.113760 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:57.139928 30900 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:57.108053 30899 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:57.150233 31622 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.152668 31045 raft_consensus.cc:2410] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:57.153564 31049 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:57.153630 30893 raft_consensus.cc:2410] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:57.157230 30864 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:24:57.161140 30897 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:57.147655 31620 pending_rounds.cc:107] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:24:57.162240 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:57.162441 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:57.162874 31619 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:57.163152 31050 raft_consensus.cc:2393] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:57.156450  1527 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:57.164460 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:57.164999 31047 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.165724  1471 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:57.169239  1329 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.138103  1504 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.171327 31620 raft_consensus.cc:2889] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:57.171969 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.172582 31044 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:57.173525 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.174144 31048 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:57.175436 31051 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:57.181979 31047 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:57.123788  1499 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.113016  1431 raft_consensus.cc:697] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:57.184747 30895 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:57.160786 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:57.163986 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.194346  1470 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.194993  1470 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.197072  1470 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.197768 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.198194 30976 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:57.198505 30972 raft_consensus.cc:2393] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:57.199241 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.199448 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.199863 30976 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:57.200279  1471 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:57.194339 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:57.201226 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.200299 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.200723 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.200052 30971 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:24:57.200994 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 123611us
I20260709 12:24:57.194886 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.202240 30973 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.199012 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:57.157080  1501 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.205039 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.183969  1477 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:57.209626 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 86374.3us
I20260709 12:24:57.210422 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.205968 30976 raft_consensus.cc:2410] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:57.209391 30975 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.222930 30970 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:57.226631 30865 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.152681  1354 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:24:57.183070  1454 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:57.210289 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 53140.8us
W20260709 12:24:57.204272  1577 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.621s	user 0.000s	sys 0.004s
I20260709 12:24:57.152287  1399 consensus_queue.cc:1059] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:57.227988 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.230746 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.200812  1471 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:57.233057 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:57.233434  1499 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:57.233656 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.236788 31051 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:57.239802 30864 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:57.229732  1547 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:57.260555 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.238849  1416 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.240080  1567 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.243795  1373 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.229784  1329 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:24:57.231238  1404 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 12:24:57.273219 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 47448.3us
I20260709 12:24:57.260180  1515 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.235435  1520 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:24:57.282135 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.267582  1532 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:57.283672 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:57.288450 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:57.284317 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 226630us
W20260709 12:24:57.284634 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.271447  1285 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:57.291256 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.290884  1454 consensus_queue.cc:1059] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:57.277860  1481 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.298593  1373 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:57.295996  1354 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.300385  1354 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.300710  1354 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.302728 30973 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:57.303825  1448 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.304203  1448 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.304546  1448 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.238752  1583 consensus_queue.cc:1059] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:24:57.264695  1401 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:57.272414  1567 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:57.296598 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56539.6us
W20260709 12:24:57.296828 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 113523us
I20260709 12:24:57.261987  1453 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:57.295445 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.282008  1449 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.287708  1532 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.321975  1567 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:57.334779 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 73637us
I20260709 12:24:57.340570 30864 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:24:57.334697  1596 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:24:57.330338  1532 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.308679  1285 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.362219 31587 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.329092  1442 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:57.372228  1599 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:57.376883  1460 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.379189  1285 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:57.344916  1449 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:57.380170  1449 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.382068  1449 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.366029  1374 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:57.382876  1374 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:57.383219  1374 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.293080  1431 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.383817  1454 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:57.394728 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 70655.2us
W20260709 12:24:57.405916 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 43748.2us
I20260709 12:24:57.410516 31046 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:57.413646 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.416081 30898 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.420020 31013 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:57.338407  1329 consensus_queue.cc:1059] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:24:57.425295 30897 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.430363 31013 leader_election.cc:400] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:57.430708 31013 leader_election.cc:403] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:57.398736  1454 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:57.433684 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.435364 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.446625 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.447232 30894 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.412629  1285 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.412140  1399 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.449402 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.451326 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.455801 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.456367 31051 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:57.456415 30893 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:57.460522 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:57.462663 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.464708  1486 raft_consensus.cc:3055] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:57.465227  1486 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:57.466116  1486 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.397738  1442 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:57.445761  1598 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:24:57.470964 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.472070  1607 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.478506 31587 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.481845  1532 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.484663 31587 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:57.485404  1603 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:24:57.488416  1600 log.cc:927] Time spent T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:57.444794  1477 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.489559  1477 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.490006  1477 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.490936  1607 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.492408 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:57.497170 31587 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:57.524359 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 290756us
I20260709 12:24:57.525146 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.525394 31587 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:57.525863 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 74647.3us
I20260709 12:24:57.526989 31013 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.503756 31622 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:24:57.528237 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 793) took 1013 ms. Trace:
I20260709 12:24:57.467490  1486 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.528553 31622 rpcz_store.cc:276] 0709 12:24:56.514828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.516874 (+  2046us) service_pool.cc:224] Handling call
0709 12:24:57.113626 (+596752us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:24:57.528176 (+414550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11199744}
I20260709 12:24:57.531126 30898 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:57.444468  1481 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
W20260709 12:24:57.533128 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 243143us
I20260709 12:24:57.456733  1583 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.555449 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.335106  1471 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.548416 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.524261  1339 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.543495 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.544662  1568 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.523612  1578 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.471347  1442 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:57.531097  1504 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.523546  1547 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:57.530689  1285 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:57.554157  1608 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:57.539214  1607 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.572450 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.584649 30901 raft_consensus.cc:2393] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:24:57.585142 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 60072.1us
I20260709 12:24:57.585875 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.588943  1354 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.459205  1399 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.590276  1547 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:24:57.591866 30799 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53558 (request call id 355) took 19910 ms (client timeout 15000 ms). Trace:
I20260709 12:24:57.583053 30972 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:57.570231  1443 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:57.570181  1563 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:57.630162 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 47841.4us
I20260709 12:24:57.569322 30894 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:57.570286  1373 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:24:57.600605 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 75278.3us
I20260709 12:24:57.633773 30971 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:57.576843  1532 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.603034 30975 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.632212 30973 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:57.553964  1454 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.636770  1618 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:24:57.637820  1618 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:57.638144  1618 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:57.638978  1618 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.563093  1610 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:24:57.579284  1578 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.640203 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.640481 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.668504 30974 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 4: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:57.582680  1431 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.641760  1354 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:57.679585 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.681636 31587 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.678555 30939 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.580442  1285 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.583129  1453 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.690925 31013 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:57.651564  1477 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.694705  1605 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.696789 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.698573 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.699308 30975 raft_consensus.cc:2368] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7.
I20260709 12:24:57.700532 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.630604  1608 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:24:57.668987  1197 consensus_meta.cc:287] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.870s	user 0.011s	sys 0.000s
I20260709 12:24:57.639511  1538 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:24:57.580418  1614 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:57.711612 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:57.645264  1568 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:57.718293 30894 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.718657  1568 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.720713  1568 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:57.721526 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:57.724013 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.724596 30976 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:24:57.725075 30894 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:57.718266  1614 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.727870  1614 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.728276 30970 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:24:57.728669 30970 pending_rounds.cc:85] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 4
I20260709 12:24:57.728896 30970 pending_rounds.cc:107] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:24:57.729099 30970 raft_consensus.cc:2889] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:57.730039 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.731029 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:57.731680 30970 raft_consensus.cc:2368] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:57.636799  1616 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.691540  1285 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.736874 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:57.734568 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56126.2us
I20260709 12:24:57.755749 31014 leader_election.cc:400] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7.
I20260709 12:24:57.756063 31014 leader_election.cc:403] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:57.756311 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.695333  1605 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.663991  1481 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:24:57.710973  1524 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.709815  1443 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:57.638988  1567 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:57.754199 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 170471us
W20260709 12:24:57.740455 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 58948us
I20260709 12:24:57.757092 30894 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:57.734280  1504 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.760803 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:24:57.765053 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.779412  1630 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.779856  1631 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.782743 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.780840 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.791712 30892 raft_consensus.cc:2393] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:57.752318  1460 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:57.781864 30865 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.757078  1401 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.757623  1563 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.800477 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:57.744663  1442 consensus_queue.cc:1059] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:24:57.790791  1453 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:57.794533  1339 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.773437  1572 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:24:57.796034  1416 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.819571 31014 leader_election.cc:400] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:24:57.824894 30970 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:24:57.827843 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 88872us
I20260709 12:24:57.806766  1610 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.811031  1460 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:57.831452  1442 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:57.833299 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:57.834736 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.835843 31616 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.836205  1578 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.801497  1401 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.837034 31617 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:57.793686  1373 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.840384  1399 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.829675  1453 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:57.894590  1453 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.808118  1608 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.822659  1524 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:57.896704  1524 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.811606  1538 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.823663  1504 raft_consensus.cc:3055] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:57.598417 30799 rpcz_store.cc:269] 0709 12:24:37.639907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.642775 (+  2868us) service_pool.cc:224] Handling call
0709 12:24:57.534834 (+19892059us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:51.557366 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:51.679913 (+122547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:51.679947 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:24:51.679964 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:51.680930 (+   966us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:51.681004 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:51.681032 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:24:51.681782 (+   750us) tablet.cc:701] Row locks acquired
0709 12:24:51.681799 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:24:51.681945 (+   146us) write_op.cc:270] Start()
0709 12:24:51.682056 (+   111us) write_op.cc:276] Timestamp: P: 1783599891681897 usec, L: 0
0709 12:24:51.682077 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:51.682711 (+   634us) log.cc:844] Serialized 4303 byte log entry
0709 12:24:53.470681 (+1787970us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:53.827394 (+356713us) op_driver.cc:464] REPLICATION: finished
0709 12:24:54.016086 (+188692us) write_op.cc:301] APPLY: starting
0709 12:24:54.020053 (+  3967us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:54.020296 (+   243us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:54.026126 (+  5830us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:54.178202 (+152076us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:54.178472 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:24:54.178522 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:54.178848 (+   326us) log.cc:844] Serialized 83 byte log entry
0709 12:24:54.179082 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:54.179226 (+   144us) write_op.cc:454] Released schema lock
0709 12:24:54.179276 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:54.179697 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:54.179789 (+    92us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":76386,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":136443,"apply.run_cpu_time_us":3996,"apply.run_wall_time_us":190379,"num_ops":11,"prepare.queue_time_us":209016,"prepare.run_cpu_time_us":16416,"prepare.run_wall_time_us":566239,"raft.queue_time_us":316138,"raft.run_cpu_time_us":17752,"raft.run_wall_time_us":158491,"replication_time_us":2127383,"spinlock_wait_cycles":15600512,"thread_start_us":736919,"threads_started":4,"wal-append.queue_time_us":654014,"wal-append.run_cpu_time_us":37128,"wal-append.run_wall_time_us":2838876}]]}
W20260709 12:24:57.844108  1448 consensus_meta.cc:287] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 12:24:57.846642  1631 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7.
I20260709 12:24:57.799930  1374 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:57.854305 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.828470  1416 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:57.860404 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 67034.7us
I20260709 12:24:57.861696  1443 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:57.864441  1589 raft_consensus.cc:993] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:57.867985  1477 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:57.873698  1567 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:57.874369 30901 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:57.874786  1605 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:57.878491  1613 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.234s	user 0.003s	sys 0.000s
I20260709 12:24:57.806174  1563 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:57.880275 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:57.881347 31619 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.890919 30892 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:57.897038 30973 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:58.166673 30900 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:57.901585 30970 raft_consensus.cc:1240] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:58.209664 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 389260us
I20260709 12:24:58.214793 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:58.219223 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb8d20fced0547649402e6668241468c"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:58.215550 30973 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:24:58.220849 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:24:58.221398 30973 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.221871 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:58.223326 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:58.228350 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:58.237505 30896 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:58.237919 30896 pending_rounds.cc:85] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 5
I20260709 12:24:58.238137 30896 pending_rounds.cc:107] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:58.238376 30896 raft_consensus.cc:2889] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:58.238897 30899 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
W20260709 12:24:58.239270 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.208938  1486 raft_consensus.cc:1081] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:24:57.828612  1630 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.391s
I20260709 12:24:58.163903  1504 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:58.167820  1527 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.220441  1481 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.261422 31619 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:24:58.251379 30973 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:58.253451  1631 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:58.289898 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 68103.9us
I20260709 12:24:58.247002  1401 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.209178  1564 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:24:57.996325  1460 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.255658  1527 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.223186  1605 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:58.220105  1448 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:58.327172 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 93856.2us
I20260709 12:24:58.330782 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2115) took 1135 ms. Trace:
I20260709 12:24:58.289249  1625 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:58.269109  1481 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.338754 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:58.340029 30967 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:58.332917  1625 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.341863  1625 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.342533  1524 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:58.333863  1285 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.565s	user 0.004s	sys 0.004s
I20260709 12:24:58.328087  1401 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:58.331156 30969 rpcz_store.cc:276] 0709 12:24:57.194923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.206197 (+ 11274us) service_pool.cc:224] Handling call
0709 12:24:57.236352 (+ 30155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.281659 (+ 45307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.281689 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.296529 (+ 14840us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.494667 (+198138us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:57.494710 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.494796 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.877811 (+383015us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:58.328176 (+450365us) raft_consensus.cc:1685] finished
0709 12:24:58.328197 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.330717 (+  2520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24963,"raft.queue_time_us":36429,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7417,"spinlock_wait_cycles":24364288,"thread_start_us":155760,"threads_started":1,"wal-append.queue_time_us":316726}
I20260709 12:24:58.272593  1636 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 12:24:58.399688 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 61015.5us
W20260709 12:24:58.403362  1640 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:58.404626  1416 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.335397  1605 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:58.405720  1642 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:58.407222  1605 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:58.340504  1504 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.416247  1504 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.420892  1448 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.423326 31587 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:58.424382  1563 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.424592 31587 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:58.426388  1628 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:24:58.431344  1633 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:58.432049  1633 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.343218  1285 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.436707  1285 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:58.434111 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:58.444485  1637 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:58.444959  1374 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.388543  1401 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:58.447391  1401 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:58.448019  1603 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:58.397080  1501 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.448810  1501 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.391155  1373 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.461588 30969 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:58.396476  1572 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.464483 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:58.453187  1605 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.523877  1501 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:58.526398  1470 raft_consensus.cc:3055] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:58.526892  1470 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:58.465613  1373 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:58.497462  1197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.015s	sys 0.004s
I20260709 12:24:58.494623  1572 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.531432 31587 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:24:58.531971  1197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.015s	sys 0.004s
I20260709 12:24:58.554461  1501 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:58.555126  1501 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:58.556113  1501 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.557181  1373 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:58.559424 30942 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.699s (SENT)
I20260709 12:24:58.559917 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:58.563032  1481 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.528126  1470 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:58.569716  1470 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:58.576508 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 45153.7us
I20260709 12:24:58.577289 31587 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:58.578393 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:58.579463 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:24:58.582994 31617 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:58.584875 31619 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:58.591823 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:58.595788 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:58.599080 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:58.599639 31619 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.604416 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:58.598536 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:24:58.607779 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48399.9us
I20260709 12:24:58.609458 31618 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:58.619930 31048 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:58.587952  1649 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:58.583619  1605 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:58.735653 30942 leader_election.cc:336] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.710s (SENT)
I20260709 12:24:58.736280 30942 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:58.646698 31619 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
W20260709 12:24:58.737736 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.689384 31043 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:24:58.730888 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 132452us
I20260709 12:24:58.641775 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:58.597034  1373 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.583803  1572 raft_consensus.cc:2764] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:58.758831 30942 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:58.588181  1608 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:58.737139  1639 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:58.752370 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.741884 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.761938 31622 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:24:58.753228 31047 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:58.755621  1524 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:58.690199  1527 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.764036 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:58.764618 31623 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.765045 31044 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:58.765326  1663 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:58.765545  1471 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:58.765959  1623 raft_consensus.cc:3055] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:58.765872  1663 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.766362  1623 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:24:58.767187  1623 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.768204  1572 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:58.768537 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:58.771183 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:58.771752 31049 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.765224  1646 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:24:58.772218  1524 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.771337 31047 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:58.773872 31050 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:24:58.772524 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:58.774298 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 154996us
I20260709 12:24:58.763443 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.774220 31050 pending_rounds.cc:85] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 5
I20260709 12:24:58.775991 31050 pending_rounds.cc:107] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:24:58.776245 31050 raft_consensus.cc:2889] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:58.776891 31045 raft_consensus.cc:606] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:24:58.780340 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:58.780988 31621 raft_consensus.cc:2376] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8. Re-sending same reply.
W20260709 12:24:58.782312 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.621094  1401 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:58.739585  1501 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.773272  1625 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.761601  1453 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.789949 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.791112 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.801740 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.802536 31621 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:58.803251 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:58.797605 31043 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:58.803957 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:58.801888 31623 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:58.804555 31044 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:58.806572 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.779246  1572 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.806762 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.808482 31620 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:24:58.808802 31623 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:24:58.809480 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:58.809682 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.810212 31620 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:58.809701 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:58.811342 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.811712 31623 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:58.811342 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:58.815045 31049 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:24:58.803283  1470 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.816262  1470 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.817682  1572 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:58.818823  1470 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.819427 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:58.819598 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:58.820020 31044 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.784806  1636 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:24:58.789167  1608 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:58.821343 31621 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:58.804543  1524 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.825685 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:58.827972 31623 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:58.832794  1611 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:58.833271  1611 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:24:58.833834  1625 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.834125  1611 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.835269  1611 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.823777  1481 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.852589 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 769) took 2522 ms. Trace:
I20260709 12:24:58.852996 31615 rpcz_store.cc:276] 0709 12:24:56.329643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.329771 (+   128us) service_pool.cc:224] Handling call
0709 12:24:56.341966 (+ 12195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.366481 (+ 24515us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:56.534548 (+168067us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.901272 (+366724us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18003d5040. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d4bac0a 00007f0336bfa219 00007f032d542a40 00007f032d53d4e4 00007f032d53d455 00007f03340253c7 00007f03306379a7 00007f03306470bf 00007f0330647038
0709 12:24:57.202476 (+301204us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.207785 (+  5309us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.328815 (+121030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.328865 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:57.328910 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.482037 (+153127us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b480021c9d8. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0335556aa1 00007f033554db37 00007f033554d9ca 00007f033564526f 00007f0335644f37 00007f033565955c 00007f0335659508 00007f0335659488 00007f0335659443 00007f03356586ec 00007f0334582a96
0709 12:24:58.852280 (+1370243us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b540071cad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:58.852328 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.852499 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59102,"prepare.queue_time_us":448564,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":5460,"raft.queue_time_us":67083,"raft.run_cpu_time_us":2680,"raft.run_wall_time_us":267709,"spinlock_wait_cycles":18726400,"thread_start_us":706400,"threads_started":4,"wal-append.queue_time_us":223115,"wal-append.run_cpu_time_us":3065,"wal-append.run_wall_time_us":1550391}
I20260709 12:24:58.835932  1646 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:24:58.856689  1470 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:58.856933 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 2126) took 1659 ms. Trace:
I20260709 12:24:58.857326 30972 rpcz_store.cc:276] 0709 12:24:57.197954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.199215 (+  1261us) service_pool.cc:224] Handling call
0709 12:24:58.856785 (+1657570us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400246154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:58.856881 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880776960}
I20260709 12:24:58.857301  1470 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.860090 31616 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:58.861533  1470 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.807791  1401 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.874130 30974 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.849172  1636 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.850175  1481 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:58.883795 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:24:58.887562 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.881729  1525 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:24:58.874864  1524 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:58.885080 30972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:41634
I20260709 12:24:58.897761 30972 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.898146 30972 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.885133  1481 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.929571 31044 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:24:58.888396  1486 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:24:58.895542  1608 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.942022  1527 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.936535  1620 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.942569 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:58.942731  1620 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:58.938030 30942 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.989s (SENT) [suppressed 22 similar messages]
I20260709 12:24:58.948732  1567 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:58.950263 31048 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:58.884739  1636 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:58.900388  1524 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.946027  1453 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.950188  1567 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:58.971877  1401 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:58.973649  1527 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:58.958592  1501 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:24:58.991695  1453 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.001788  1572 consensus_queue.cc:1059] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 12:24:58.998533 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 46666us
W20260709 12:24:59.008587 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 70586.6us
I20260709 12:24:59.029968  1611 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.030174  1639 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.030370 30942 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.030650  1639 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.031270  1634 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.031805  1634 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.032835 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.030525  1611 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.001294  1660 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:24:59.032835  1401 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:24:59.036899  1373 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:59.048861  1373 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:59.049364  1373 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.007911  1481 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.058936 30972 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.038925  1608 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:59.038158 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:59.040916 30942 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.041929  1663 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.042831  1329 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.000788  1527 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.037981 31042 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:59.082839 30974 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:59.096931 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 58846.9us
I20260709 12:24:59.105705 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:59.046307  1477 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:59.111347 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 44609.7us
I20260709 12:24:59.108726 30972 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.110366 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:59.064500  1620 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.045360  1303 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:24:59.139164 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2117) took 1772 ms. Trace:
W20260709 12:24:59.139525  1671 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:24:59.166625 31042 rpcz_store.cc:276] 0709 12:24:57.366432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.385802 (+ 19370us) service_pool.cc:224] Handling call
0709 12:24:59.037463 (+1651661us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:24:59.037663 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.105054 (+ 67391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.139084 (+ 34030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7452928}
I20260709 12:24:59.168164 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2132) took 1362 ms. Trace:
I20260709 12:24:59.070323  1486 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.104952  1501 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:59.102041  1401 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.101636  1436 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.112336  1481 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.161164 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:24:59.120934 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.168540 30970 rpcz_store.cc:276] 0709 12:24:57.805580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.220233 (+414653us) service_pool.cc:224] Handling call
0709 12:24:58.220978 (+   745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.228576 (+  7598us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:58.255488 (+ 26912us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.862474 (+606986us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b18001cfea0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd23a 00007f0330637a2a
0709 12:24:58.915000 (+ 52526us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.930199 (+ 15199us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.930371 (+   172us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:58.930407 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.930490 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.167889 (+237399us) raft_consensus.cc:1685] finished
0709 12:24:59.167986 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.168109 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11932,"prepare.queue_time_us":26962,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1840,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":29023,"spinlock_wait_cycles":14071808,"thread_start_us":52253,"threads_started":1,"wal-append.queue_time_us":658049}
W20260709 12:24:59.177285  1678 log.cc:927] Time spent T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:24:59.179456  1641 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.850s	user 0.003s	sys 0.003s
I20260709 12:24:59.170763 31051 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:59.113668  1662 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:59.172474  1501 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.161266 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:59.132616  1660 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:24:59.159840  1639 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.179912  1634 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.172233  1618 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.193812 31047 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:59.194296  1676 log.cc:927] Time spent T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:59.194892 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:59.172827  1486 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.133853  1477 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.192420 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2128) took 1527 ms. Trace:
I20260709 12:24:59.191035 31049 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:59.169638 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 128758us
I20260709 12:24:59.198742  1501 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.203253 31051 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.179939  1636 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:24:59.171213 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 284584us
I20260709 12:24:59.175755  1401 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.211337 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1765) took 1485 ms. Trace:
I20260709 12:24:59.196892  1662 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:59.208325 30971 rpcz_store.cc:276] 0709 12:24:57.665346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.670098 (+  4752us) service_pool.cc:224] Handling call
0709 12:24:57.670403 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.783213 (+112810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.783242 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.783715 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.881738 (+ 98023us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:57.881775 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.188140 (+1306365us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b540008c354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:24:59.188188 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.188230 (+    42us) raft_consensus.cc:1685] finished
0709 12:24:59.188244 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.192360 (+  4116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30635,"raft.queue_time_us":31852,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":188080896,"thread_start_us":97676,"threads_started":1,"wal-append.queue_time_us":511797}
I20260709 12:24:59.210408 30942 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.220364  1589 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.220642  1691 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:59.234618  1691 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:59.223374 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42986 (request call id 26) took 1004 ms. Trace:
I20260709 12:24:59.184615  1436 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.234103  1629 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:59.226137  1527 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.236176 31045 rpcz_store.cc:276] 0709 12:24:58.218982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.219104 (+   122us) service_pool.cc:224] Handling call
0709 12:24:58.935901 (+716797us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b4c004d8500. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032e8f9a20 00007f032e90aa29 00007f032e8d0644 00007f032e8f7f2d 00007f032e8f7b93 00007f0330627c92 00007f033062784a 00007f03355f560a 00007f032eb7b7d4 00007f032eb7b762 00007f032eb7b691
0709 12:24:59.223217 (+287316us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54003d4d54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f0330627853 00007f03355f560a 00007f032eb7b7d4 00007f032eb7b762 00007f032eb7b691 00007f032eb7b60c 00007f032eb7a8c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:59.223294 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301878912}
I20260709 12:24:59.235481  1691 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.209326 31042 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.241784  1607 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.211778  1689 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:59.257582 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.242219  1686 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.242921  1589 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.206704  1567 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:59.249202 31014 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.217167 30976 rpcz_store.cc:276] 0709 12:24:57.725869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.726383 (+   514us) service_pool.cc:224] Handling call
0709 12:24:57.726933 (+   550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.775108 (+ 48175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.775141 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.775639 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.054875 (+279236us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:58.054919 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.054991 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.178826 (+1123835us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:24:59.208506 (+ 29680us) raft_consensus.cc:1685] finished
0709 12:24:59.208528 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.211268 (+  2740us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34150,"raft.queue_time_us":48506,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":6592128,"thread_start_us":278774,"threads_started":1,"wal-append.queue_time_us":470823}
I20260709 12:24:59.252738 31046 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:59.252825 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.205050  1663 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:59.275588 31045 raft_consensus.cc:2393] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:59.255190 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:59.266316 31049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:24:59.253422  1691 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.267109  1689 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.274295  1611 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.280256  1689 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.269178  1607 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.282456  1607 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.271919  1687 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:59.274623  1686 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.285730  1686 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:59.287784  1690 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:24:59.288152  1547 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:59.288686  1547 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.289994  1662 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.290678  1547 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.251400  1471 consensus_queue.cc:1059] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:24:59.294965  1373 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.301980  1471 raft_consensus.cc:3055] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:59.279263 31051 raft_consensus.cc:2368] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
I20260709 12:24:59.283643  1629 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:59.256889  1486 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:59.254401  1453 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.305513 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.308017  1620 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.270301 30942 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.317368 31045 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
W20260709 12:24:59.320456 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 50234.3us
I20260709 12:24:59.320919 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:59.322623 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:59.325062 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:59.300988 31042 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:24:59.325783 31619 raft_consensus.cc:2393] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:59.303112  1303 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:59.329228 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 200550us
I20260709 12:24:59.302228  1589 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.330835 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:59.308434  1471 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:59.327397  1660 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.324066  1693 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:59.326968  1453 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.356148 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.357975 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:59.358846  1436 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.359552  1373 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.366037  1689 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.372195  1524 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:59.373805 30899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2072) took 1940 ms (client timeout 1989 ms). Trace:
I20260709 12:24:59.393577  1547 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:59.451975  1547 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.452584  1689 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.454190  1547 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:24:59.431566 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.456722 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:59.457988 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:59.459285 30969 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:59.441671  1693 raft_consensus.cc:697] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:24:59.460068 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:59.470749 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:59.471398 30896 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.447856 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:59.472606 31615 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:59.448727  1471 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.450157  1477 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.483261 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:59.483935 30971 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
W20260709 12:24:59.486826 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.461815 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:59.487380 31623 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:24:59.451205 30899 rpcz_store.cc:269] 0709 12:24:57.433366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.433463 (+    97us) service_pool.cc:224] Handling call
0709 12:24:59.373634 (+1940171us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b5400097c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:59.373729 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828949376}
I20260709 12:24:59.478790 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.480422 31051 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:59.488917 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.481978 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.489882 30894 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:59.490101 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:59.328018  1686 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:24:59.472883 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:59.318604  1629 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.491890 30975 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:24:59.497450 30975 pending_rounds.cc:85] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 8
I20260709 12:24:59.497689 30975 pending_rounds.cc:107] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:24:59.497905 30975 raft_consensus.cc:2889] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:59.492048 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.498193 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:59.498567 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.498901 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:24:59.326553  1620 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.429948  1660 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.495999 30901 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:59.500336 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.500659 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:24:59.510433 31619 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:24:59.430423  1690 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.504323 30894 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:59.496964 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.347291  1303 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.524570  1677 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:59.525110  1677 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:24:59.525797  1303 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.526752 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.528079 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.528851 31047 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:59.528743  1690 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.529861 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:59.530982  1690 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:24:59.532924 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.536186 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.537076  1629 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.537355 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.537927 31048 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:59.538714 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.539194 31048 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:24:59.539533  1547 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.540064  1547 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.542272 31043 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:59.542716  1547 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:24:59.508530 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.509172 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.508585 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:59.514847 30897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2075) took 2005 ms (client timeout 1765 ms). Trace:
I20260709 12:24:59.515476 30892 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:59.517066  1627 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:59.545229 30897 rpcz_store.cc:269] 0709 12:24:57.500230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.500390 (+   160us) service_pool.cc:224] Handling call
0709 12:24:59.504601 (+2004211us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400195854. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:59.504740 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589884672}
I20260709 12:24:59.554817 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:24:59.556514 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56277.2us
I20260709 12:24:59.557294 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.558537 30939 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.559978  1401 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.543674  1660 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.563548 30939 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.564296 31047 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:24:59.576133 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.577061 31047 raft_consensus.cc:2393] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:24:59.490724  1578 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:24:59.569787 31615 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:24:59.598675 30967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 537) took 1996 ms (client timeout 2238 ms). Trace:
I20260709 12:24:59.580971 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.582301  1623 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.583232  1627 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:59.585171 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.602876 30900 raft_consensus.cc:2368] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9.
I20260709 12:24:59.602999 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.587280  1453 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:59.588565 31043 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:59.562493  1629 raft_consensus.cc:2764] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:59.589860  1622 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:59.571153  1471 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:59.604038  1329 consensus_meta.cc:287] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.002s
I20260709 12:24:59.499933  1624 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:24:59.623648 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 109226us
I20260709 12:24:59.624404 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.591648 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:24:59.571537  1449 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:59.544426  1670 log.cc:927] Time spent T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:59.573251  1690 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:59.599109 30967 rpcz_store.cc:269] 0709 12:24:57.602014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.603912 (+  1898us) service_pool.cc:224] Handling call
0709 12:24:59.598509 (+1994597us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540040f1d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:24:59.598623 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550898944}
W20260709 12:24:59.604377 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.554708  1373 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:59.612993 30896 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:24:59.604725  1578 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.646329 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:24:59.625828 31623 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:59.644567 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1762) took 1770 ms. Trace:
I20260709 12:24:59.669109 30898 rpcz_store.cc:276] 0709 12:24:57.873820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.880731 (+  6911us) service_pool.cc:224] Handling call
0709 12:24:57.892535 (+ 11804us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:57.894190 (+  1655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.894219 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:57.894748 (+   529us) log.cc:844] Serialized 52 byte log entry
0709 12:24:58.246643 (+351895us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:58.269910 (+ 23267us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.753937 (+484027us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b1800413320. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:24:59.367495 (+613558us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b1800413320. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f03301d54bc 00007f032d52348b 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f0330625060 00007f0330637716 00007f0330648287
0709 12:24:59.644020 (+276525us) log.cc:844] Serialized 14 byte log entry
0709 12:24:59.644267 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.644340 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.644379 (+    39us) raft_consensus.cc:1685] finished
0709 12:24:59.644390 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.644516 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1273,"prepare.queue_time_us":18079,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2376,"raft.queue_time_us":27763,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":8441,"spinlock_wait_cycles":63723520,"thread_start_us":653638,"threads_started":3,"wal-append.queue_time_us":429990}
I20260709 12:24:59.622061  1477 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.671281  1477 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.673549  1477 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:59.659885 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:24:59.660552 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 68974us
I20260709 12:24:59.625525 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:24:59.674809 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:59.675377 30896 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.680609 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:59.629094  1329 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:59.683434 30968 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:59.681519 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.692844 30896 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:24:59.628731  1449 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.606856  1401 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:24:59.695158 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.696053 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:59.643899  1690 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:59.726538 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 80294.2us
I20260709 12:24:59.730069 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:59.528111  1693 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.656082  1538 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:59.682206  1622 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:59.736224 30939 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.657198  1697 consensus_queue.cc:1059] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:24:59.747179 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.747624 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.748725 30896 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:24:59.693742  1629 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.694952  1691 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.643371  1501 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.750543 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.755846 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.756611 30898 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:24:59.757400 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.757948 30898 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:59.758746 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.759289 30898 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:24:59.733371  1690 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.694551  1634 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.689716  1616 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:24:59.725808  1684 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:59.753223 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.744309  1399 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.728669  1449 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.747608 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.645561  1624 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:59.763038 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 75644.5us
I20260709 12:24:59.747674  1486 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:59.768024 30896 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
W20260709 12:24:59.752730 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 261912us
I20260709 12:24:59.769881 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.778434 30900 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:24:59.753325  1608 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.760625  1525 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.696142  1524 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:24:59.780238 30939 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.771440 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.782074 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.782315 31043 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:24:59.782667 30896 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:24:59.750087  1611 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:59.772135 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.784271 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.784703 31050 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:24:59.696220  1688 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:24:59.753517  1691 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.782111 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:24:59.749629  1538 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.806376 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.807478 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:59.808753 30898 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.810541 30939 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:24:59.807241 31044 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:24:59.767529  1634 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.751032  1687 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:59.777676  1486 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:24:59.814957 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:24:59.814992 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.819927 30900 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:24:59.762074  1629 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.788771  1453 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.805473  1691 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.815766 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.773098  1616 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.808404  1470 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.781332  1399 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.832743  1547 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:24:59.843008 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.848798 30898 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:24:59.773401  1685 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:24:59.784040  1477 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.815045  1622 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.791312  1608 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:24:59.819705  1486 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.832289  1620 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:24:59.786588  1525 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.836429  1453 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.816813  1611 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:24:59.890447 30900 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:59.891824 30898 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:59.855402  1373 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:59.865020  1622 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:59.932318 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 151095us
I20260709 12:24:59.937430  1525 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:24:59.940747 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:24:59.941530 30974 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:24:59.855225  1618 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:24:59.942808 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:24:59.876267 30896 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:59.873029  1477 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:24:59.819389  1401 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:24:59.959033 30898 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:59.911362  1453 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.968329 30900 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:59.922194  1661 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.927774  1329 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:59.902376  1712 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:24:59.932739  1622 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.874843  1547 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:59.978359 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 321050us
I20260709 12:24:59.986320  1702 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.986864  1702 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:24:59.992650  1703 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:24:59.995429  1702 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:00.000628  1708 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:00.014477  1700 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 12:25:00.015281  1709 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:24:59.974305  1583 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.966926  1578 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:00.017252  1616 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.280646 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.277769 31016 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:00.284806 30974 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:00.285094 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 447728us
W20260709 12:25:00.287232 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.287642 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:00.289039 30971 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:59.972088  1499 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:59.971745  1501 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:00.301508 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 314845us
W20260709 12:25:00.290575 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.014s	sys 0.067s
W20260709 12:25:00.307500 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.014s	sys 0.067s
I20260709 12:25:00.294648 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:00.298004 31042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.006s	sys 0.012s
I20260709 12:25:00.288146 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:00.201299  1471 consensus_meta.cc:287] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.003s
W20260709 12:25:00.290743  1449 consensus_meta.cc:287] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.505s	user 0.026s	sys 0.015s
W20260709 12:25:00.293371 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.018999  1629 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:00.287570 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.295924  1499 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.025857  1624 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:00.024302  1477 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:00.325853  1477 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:00.326301  1477 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:00.327193  1477 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.328071 30894 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:00.328457  1702 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:00.329171 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:00.314122 31042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.007s	sys 0.012s
I20260709 12:25:00.318588  1449 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:00.289541  1583 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.331749  1677 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.332720  1677 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.084476  1608 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:00.332954  1449 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.333379  1583 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:00.031437  1611 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.334722  1611 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:00.288218  1373 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:00.092978 30798 catalog_manager.cc:5697] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:00.316963 30974 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:25:00.336233 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:00.025506  1399 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.200563  1486 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.300958  1685 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.323042 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:00.324038 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.324549  1471 consensus_queue.cc:1059] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:00.335765 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:24:59.983357  1661 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.341116 30971 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:00.028178  1660 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.346120 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.093945  1622 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:00.237917  1690 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.326216  1436 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:00.083273  1712 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:00.499788 30968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1775) took 1626 ms (client timeout 2085 ms). Trace:
I20260709 12:25:00.547582 30900 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:00.548972 30967 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:00.510385 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:00.406116 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 59969.4us
I20260709 12:25:00.413821 30798 catalog_manager.cc:5697] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:00.352221 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.506167 30895 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:00.511534 30898 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:25:00.553570 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.554297 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.554950 30976 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:00.558105 30942 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:00.551306 30970 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:00.349377 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:00.547977 30968 rpcz_store.cc:269] 0709 12:24:58.872914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.873361 (+   447us) service_pool.cc:224] Handling call
0709 12:25:00.499597 (+1626236us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54001e55d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:00.499702 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837359488}
I20260709 12:25:00.584695 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.586655 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:00.586205 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.567586  1470 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:25:00.426990  1623 consensus_meta.cc:287] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.000s
I20260709 12:25:00.626284 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:00.627033 31048 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.488487  1634 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.481841  1399 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:00.548707  1436 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:00.348875  1504 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:00.631054 30969 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.351262  1608 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:00.585456 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:00.587248 30971 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:00.584057  1454 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.321216  1499 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:00.559293 30942 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:00.568395  1700 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:25:00.489987  1682 raft_consensus.cc:3055] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:00.623484 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.587482 30974 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:00.628579 31617 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:00.637056  1661 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.638525  1712 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.584264  1631 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.588095 30864 leader_election.cc:400] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
I20260709 12:25:00.633550  1627 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.639956 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:00.644321 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:00.425148  1401 consensus_queue.cc:1059] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.201s
I20260709 12:25:00.647835 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:00.630580  1708 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:25:00.647639 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 88417.4us
I20260709 12:25:00.684894 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.650318 30971 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:00.634302 30970 raft_consensus.cc:2368] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
I20260709 12:25:00.659842 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:00.634375  1691 consensus_meta.cc:287] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.768s	user 0.007s	sys 0.003s
I20260709 12:25:00.627589  1633 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:00.567680  1620 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:25:00.370285  1718 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.275s
I20260709 12:25:00.663594 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.669796 30864 leader_election.cc:403] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:00.670868 31048 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:00.686213 30976 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:00.696933 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.687228 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:00.697707 30971 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:00.688058 30894 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:00.691161 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:00.662356  1470 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:00.658222  1682 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:00.664338 30798 catalog_manager.cc:5697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 3 to 6, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:00.698050 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 558) took 1392 ms. Trace:
I20260709 12:25:00.698345 30900 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.640447  1504 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.697503 30970 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:00.699505 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.711506 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:00.721997 30898 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
W20260709 12:25:00.698657 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 147766us
I20260709 12:25:00.722923 30864 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:00.715549 31046 rpcz_store.cc:276] 0709 12:24:59.305443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.305567 (+   124us) service_pool.cc:224] Handling call
0709 12:24:59.313929 (+  8362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:59.319327 (+  5398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.319362 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:59.356731 (+ 37369us) log.cc:844] Serialized 52 byte log entry
0709 12:24:59.643228 (+286497us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:59.660794 (+ 17566us) log.cc:844] Serialized 14 byte log entry
0709 12:24:59.726261 (+ 65467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.726344 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.697841 (+971497us) raft_consensus.cc:1685] finished
0709 12:25:00.697862 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.697989 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106456,"prepare.queue_time_us":17648,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":78508,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":7887,"thread_start_us":285235,"threads_started":1,"wal-append.queue_time_us":448663}
W20260709 12:25:00.686587  1692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.412s	user 0.007s	sys 0.007s
I20260709 12:25:00.647110  1608 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:00.717483 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 422866us
I20260709 12:25:00.645078  1399 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:00.730011 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 435813us
I20260709 12:25:00.634758  1373 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:00.734853 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.742945 31620 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:00.736967 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.744093 31618 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 4.
I20260709 12:25:00.738164 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.739148 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:00.741537 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:00.745311 31619 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:00.715826  1725 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.755762 31621 raft_consensus.cc:2368] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
W20260709 12:25:00.731490  1692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.460s	user 0.007s	sys 0.007s
I20260709 12:25:00.752897 31616 raft_consensus.cc:2410] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:00.733419 30798 catalog_manager.cc:5697] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.754648 31618 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:00.760162 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 474712us
I20260709 12:25:00.757385 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.750797 30900 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:00.758977 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:00.746425 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:00.714915 31587 leader_election.cc:400] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9.
I20260709 12:25:00.762120 31587 leader_election.cc:403] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:00.690028  1691 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:00.765110 31049 raft_consensus.cc:606] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:00.769404 30976 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:00.731274  1611 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.719323  1470 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:25:00.780869 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 66086.9us
I20260709 12:25:00.733779  1401 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:00.773698 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.779924 31619 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:00.780946 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:00.773294 30798 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:00.788517 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 480608us
I20260709 12:25:00.784179 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.789417 31616 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:00.792596 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.793195 31620 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:00.796234 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.801124 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.800487 30798 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:00.800493 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 215091us
I20260709 12:25:00.803584 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.804423 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.805153 31619 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:00.804973 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.841656 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.788774  1661 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9.
I20260709 12:25:00.809109 30798 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 7 to 8, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 8 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:00.852768 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.848515 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:00.787009  1303 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:00.860646 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 54812.7us
W20260709 12:25:00.861135 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52441.2us
I20260709 12:25:00.794160  1538 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:00.865965 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:00.868175 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 224829us
I20260709 12:25:00.872452 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.874102 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:00.801529  1622 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:00.844693  1646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.011s	sys 0.018s
I20260709 12:25:00.878095 31618 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:00.842769  1660 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.843541  1718 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:00.887586 30798 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 3 to 6, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 6 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:00.861593  1453 consensus_meta.cc:287] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.883s	user 0.007s	sys 0.006s
W20260709 12:25:00.907538 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44031.6us
I20260709 12:25:00.909111 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:00.863328  1303 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.911608  1303 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.912314  1399 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:00.889885 30867 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:00.913765  1739 log.cc:927] Time spent T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:00.915159 30867 leader_election.cc:400] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
I20260709 12:25:00.915782 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:00.919167 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:00.887852  1646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.011s	sys 0.019s
I20260709 12:25:00.920421 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:00.922636 30867 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:00.685508  1631 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.698319  1633 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.904567  1271 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.939275  1504 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:00.885852  1470 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.940438  1633 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:00.942591  1631 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:00.942791  1720 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:25:00.943344 31051 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:00.914232  1538 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:00.689200  1627 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.914659  1486 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:00.957598 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 48570.5us
I20260709 12:25:00.921216  1718 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.923869  1734 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.923664  1702 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:00.917584  1453 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:00.922092  1620 consensus_queue.cc:1059] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:25:00.939278  1271 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:00.967418 30798 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 5 to 6, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 6 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.989935 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.995061 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:00.944751  1717 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:01.043361 30970 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:00.947762  1401 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:00.962805  1729 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:25:00.886698  1719 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:25:00.966919  1623 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:01.057044  1623 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:01.057474  1623 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:01.050513 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 269611us
I20260709 12:25:00.967762  1688 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:01.058820  1688 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:01.059198  1688 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:00.987155  1730 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:25:00.947522  1738 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:00.963435  1538 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.966775 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2134) took 1590 ms. Trace:
I20260709 12:25:01.009171  1608 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:01.050853 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:00.980355  1718 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.968250  1748 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:01.062496 30974 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:01.044579  1611 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.987758  1634 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:00.965047  1303 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.064324 30798 catalog_manager.cc:5697] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 3 to 5, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 5 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:01.063634  1691 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:01.068868  1538 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.078878 31013 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:01.089007 30975 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:01.085264 30798 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 4 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 5 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:01.088398 30976 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:01.087602 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:01.090941 31588 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:00.996170  1734 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.071208 31042 rpcz_store.cc:276] 0709 12:24:59.376768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.431256 (+ 54488us) service_pool.cc:224] Handling call
0709 12:24:59.507775 (+ 76519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.596247 (+ 88472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.596288 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.596881 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.331541 (+734660us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:00.331585 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.331652 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.944478 (+612826us) raft_consensus.cc:1685] finished
0709 12:25:00.947265 (+  2787us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.964253 (+ 16988us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63246,"raft.queue_time_us":8558,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":15064,"thread_start_us":733731,"threads_started":1,"wal-append.queue_time_us":1042648}
I20260709 12:25:01.092305 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:01.095202 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:01.095438 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:01.095983 30900 raft_consensus.cc:2393] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:01.096998 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:01.076872  1620 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.105036 30976 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:01.082432  1748 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:01.086606  1608 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.107003 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:01.115784 31588 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:01.116532 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:01.092867  1633 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:01.098555  1689 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.069049  1738 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.101300  1692 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:01.127349 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1789) took 1311 ms. Trace:
I20260709 12:25:01.127805 30972 rpcz_store.cc:276] 0709 12:24:59.815888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.816037 (+   149us) service_pool.cc:224] Handling call
0709 12:24:59.841054 (+ 25017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.228276 (+387222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.228310 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.228821 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.662389 (+433568us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:00.873870 (+211481us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.915235 (+ 41365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.915317 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.127152 (+211835us) raft_consensus.cc:1685] finished
0709 12:25:01.127170 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.127293 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66564,"prepare.queue_time_us":324636,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":126908,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":16298,"thread_start_us":925782,"threads_started":3,"wal-append.queue_time_us":520244}
I20260709 12:25:01.081561  1611 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.123713 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:01.101390  1583 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:01.123267 30798 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 3 to 5, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.118242 31588 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:01.122404  1470 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:01.119678  1504 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:01.084300  1634 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.147091 30972 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:01.135953 30867 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:01.122133  1660 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:01.121215  1733 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.109184  1443 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:01.110409  1620 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.139998 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:01.140455 31623 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:01.147666  1740 log.cc:927] Time spent T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:25:01.141527  1633 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:01.141242  1748 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:01.142015 30786 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8f02e5ab61a44506bdae958f8a275d96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9f38f761eded4f28b9d802f6570ee71e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:01.142335  1744 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:25:01.142541  1661 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:01.143091  1749 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:01.143237  1741 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:01.144635 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:01.126745  1692 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.150792 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:01.114634  1401 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.152405  1734 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:01.145987 30798 catalog_manager.cc:5697] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 4 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 7 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.160722 31616 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:01.118777  1608 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.123360  1689 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.122535  1646 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:25:01.167032 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:01.163797  1753 log.cc:927] Time spent T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:25:01.165189  1743 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:25:01.158094  1750 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:01.157505  1504 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:01.159605  1733 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:01.208647  1730 log.cc:927] Time spent T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:01.208240  1757 log.cc:927] Time spent T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:25:01.204578  1633 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:01.238767 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:01.238803  1633 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.239614 30972 raft_consensus.cc:2410] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:25:01.240430 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:01.241052 30972 raft_consensus.cc:2393] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:01.242126 30972 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:01.243106 30972 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.236743  1733 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.252521  1691 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:01.252992  1691 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:01.253803  1691 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.258617  1608 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:01.226145 30798 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 3, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 3 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.173058  1453 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:01.216575  1692 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:01.211092 30786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 69135.6us
I20260709 12:25:01.235615 31619 raft_consensus.cc:2410] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:25:01.236393 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 71964.4us
I20260709 12:25:01.264107 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:01.215451  1661 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.266376 30900 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:01.259609  1303 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:01.273876 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:01.275655 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:01.277035 30798 catalog_manager.cc:5697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 6, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 6 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.280440  1631 raft_consensus.cc:993] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:25:01.280889  1631 raft_consensus.cc:1081] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:25:01.281451  1633 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:01.282436  1677 consensus_meta.cc:287] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.001s
I20260709 12:25:01.282991 31620 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
W20260709 12:25:01.283253  1499 consensus_meta.cc:287] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.004s
I20260709 12:25:01.283674  1499 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.284179  1661 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:25:01.273674 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:01.288000 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.270131  1763 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:01.337055  1499 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:01.335934  1538 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.340032  1763 consensus_queue.cc:1243] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 9f38f761eded4f28b9d802f6570ee71e log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:01.337055  1738 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:01.343369 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1771) took 1787 ms. Trace:
I20260709 12:25:01.333616 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:01.345124 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1787) took 1658 ms. Trace:
I20260709 12:25:01.293147  1634 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:01.298688 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:01.352077 30894 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.274170  1611 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:01.340761  1725 consensus_meta.cc:287] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.577s	user 0.002s	sys 0.007s
I20260709 12:25:01.345513 30973 rpcz_store.cc:276] 0709 12:24:59.687074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.687515 (+   441us) service_pool.cc:224] Handling call
0709 12:24:59.692477 (+  4962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.770429 (+ 77952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.770457 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.770864 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.290850 (+519986us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:00.290916 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.314517 (+1023601us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54001e64d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:01.314576 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.314625 (+    49us) raft_consensus.cc:1685] finished
0709 12:25:01.314638 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.345059 (+ 30421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1483,"raft.queue_time_us":625,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5800,"spinlock_wait_cycles":178526080,"thread_start_us":475588,"threads_started":1,"wal-append.queue_time_us":758288}
I20260709 12:25:01.348553 30798 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 4 to 5, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.343766 30892 rpcz_store.cc:276] 0709 12:24:59.568472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.942161 (+373689us) service_pool.cc:224] Handling call
0709 12:24:59.974093 (+ 31932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.003839 (+ 29746us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:00.004093 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.582624 (+578531us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b18001b1120. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd23a 00007f0330637a2a
0709 12:25:00.795642 (+213018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.795691 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:00.795763 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.343134 (+547371us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54000325d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:01.343180 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.343311 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21740,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":52678,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":14387,"spinlock_wait_cycles":132421120,"thread_start_us":211113,"threads_started":1,"wal-append.queue_time_us":1013075}
I20260709 12:25:01.284914  1504 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.346585 30899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:25:01.376806 30899 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.377238 30899 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.273062  1761 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:01.287606  1633 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:01.350979  1646 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:01.380152 30798 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:01.427265 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 306214us
I20260709 12:25:01.274253  1706 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 12:25:01.438369  1736 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.470s	user 0.001s	sys 0.001s
I20260709 12:25:01.426599 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 549) took 1126 ms. Trace:
I20260709 12:25:01.420656  1547 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:01.420686  1763 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:01.442377  1763 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.450417 30894 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:01.381563  1725 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
I20260709 12:25:01.482074 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.482380 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.482805 31050 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:01.483942 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.444697  1763 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:01.487457 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:01.489809 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:01.493177 31043 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:01.419996  1620 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:01.497442 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:01.499822 31043 raft_consensus.cc:2393] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:01.501814 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.502594 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.506145 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:01.464526  1538 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:01.503870 31013 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:01.506840 31624 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:01.501966 30798 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 4 to 5, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.507360 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.510838 31016 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:01.513895  1712 raft_consensus.cc:3055] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:01.514300  1712 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:01.515793  1443 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:01.516397  1443 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:01.517295  1443 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:01.519331  1768 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.051s	user 0.003s	sys 0.007s
I20260709 12:25:01.515846  1477 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:01.506546  1733 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.524049  1733 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:01.493000  1738 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.527391 31616 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:01.528885 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:01.529697 30798 catalog_manager.cc:5697] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 5 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 7 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.550362 30900 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.529064 30899 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.574566  1677 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:01.575188  1677 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.577199  1677 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:01.446169  1718 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.419680  1688 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.578593  1633 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:01.608296  1731 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:01.618513 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:01.616019 30898 raft_consensus.cc:2368] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:25:01.614056 31050 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
W20260709 12:25:01.629431  1623 consensus_meta.cc:287] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.572s	user 0.001s	sys 0.008s
I20260709 12:25:01.629873  1623 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.630199 30900 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:01.596436  1738 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.616935  1633 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.637061 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:01.637723 30900 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:01.636473 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:01.652552  1732 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:01.608927  1731 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.027383 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.115037 31621 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.698500 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.981518 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2155) took 1473 ms. Trace:
I20260709 12:25:01.699156 31047 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:02.006701 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:01.439576 30970 rpcz_store.cc:276] 0709 12:25:00.299896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.055897 (+756001us) service_pool.cc:224] Handling call
0709 12:25:01.056227 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.056454 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:01.070588 (+ 14134us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.120527 (+ 49939us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.426042 (+305515us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18003a8220. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d4bac0a 00007f0336bfa219 00007f032d542a40 00007f032d53d4e4 00007f032d53d455 00007f0330625060 00007f0330637716 00007f0330648287 00007f0330648208
0709 12:25:01.426206 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.426257 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:01.426306 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.426378 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.426526 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":297399,"prepare.queue_time_us":24072,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":63,"raft.queue_time_us":310052,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":9683,"spinlock_wait_cycles":22849152,"thread_start_us":47075,"threads_started":1,"wal-append.queue_time_us":82289}
I20260709 12:25:02.000694 31618 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:01.927465 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1009) took 1083 ms. Trace:
I20260709 12:25:01.726620 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:01.932621 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.980729 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2150) took 1545 ms. Trace:
I20260709 12:25:01.715409 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2156) took 1207 ms. Trace:
I20260709 12:25:02.120630 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:01.942253 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42986 (request call id 27) took 2676 ms. Trace:
I20260709 12:25:02.056679 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:02.127038 31615 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.684376 30798 catalog_manager.cc:5697] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 6, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
W20260709 12:25:01.694741 30975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1794) took 1414 ms (client timeout 1721 ms). Trace:
W20260709 12:25:02.128379 30975 rpcz_store.cc:269] 0709 12:25:00.280277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.280391 (+   114us) service_pool.cc:224] Handling call
0709 12:25:01.694557 (+1414166us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540040fbd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:01.694678 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854107008}
I20260709 12:25:02.051247 31619 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.004516 31013 leader_election.cc:400] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:25:01.705178 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2138) took 1413 ms. Trace:
I20260709 12:25:02.001111 30894 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:01.702076 31617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 797) took 2992 ms (client timeout 1931 ms). Trace:
W20260709 12:25:01.820621 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.131567 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 127208us
I20260709 12:25:01.653163  1732 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:02.122622 30973 rpcz_store.cc:276] 0709 12:25:00.508068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.381779 (+873711us) service_pool.cc:224] Handling call
0709 12:25:01.382124 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.382341 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:01.382615 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.981219 (+598604us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.981267 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:01.981312 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.981367 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.981467 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":381631,"prepare.queue_time_us":979,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":382191,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":216599,"threads_started":1}
I20260709 12:25:01.713184 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 545) took 1425 ms. Trace:
W20260709 12:25:01.979166 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 548281us
I20260709 12:25:02.132997 30969 rpcz_store.cc:276] 0709 12:25:00.287518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.287865 (+   347us) service_pool.cc:224] Handling call
0709 12:25:00.302644 (+ 14779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.631463 (+328819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.712952 (+1081489us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540011a3d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:01.713118 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754870656}
I20260709 12:25:02.133490 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:02.006186 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:02.117408 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 110796us
I20260709 12:25:02.012698 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2157) took 1504 ms. Trace:
I20260709 12:25:02.136145 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:01.703586 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 562) took 1118 ms. Trace:
I20260709 12:25:02.119648 30972 rpcz_store.cc:276] 0709 12:25:00.435119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.243664 (+808545us) service_pool.cc:224] Handling call
0709 12:25:01.261101 (+ 17437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.261325 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:01.268070 (+  6745us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.980374 (+712304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.980427 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:01.980469 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.980536 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.980658 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":534893,"prepare.queue_time_us":6588,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":535524,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":177024,"threads_started":1,"wal-append.queue_time_us":199704}
W20260709 12:25:01.930330  1724 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 1.342s	user 0.004s	sys 0.000s
I20260709 12:25:02.130540 30974 rpcz_store.cc:276] 0709 12:25:00.291977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.719011 (+427034us) service_pool.cc:224] Handling call
0709 12:25:00.719329 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.077018 (+357689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.704939 (+627921us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54001ba3d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:01.705117 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788652416}
W20260709 12:25:02.131122 31617 rpcz_store.cc:269] 0709 12:24:58.709422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.710145 (+   723us) service_pool.cc:224] Handling call
0709 12:24:59.472736 (+762591us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:25:01.701815 (+2229079us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400107054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:01.701957 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572408960}
I20260709 12:25:02.118731 31620 rpcz_store.cc:276] 0709 12:25:00.844023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.873917 (+ 29894us) service_pool.cc:224] Handling call
0709 12:25:01.927236 (+1053319us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b540063f6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:01.927373 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939105664}
I20260709 12:25:02.042215 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.127071 31049 rpcz_store.cc:276] 0709 12:24:59.266037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.266193 (+   156us) service_pool.cc:224] Handling call
0709 12:25:01.942080 (+2675887us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400159ad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f0330627853 00007f03355f560a 00007f032eb7b7d4 00007f032eb7b762 00007f032eb7b691 00007f032eb7b60c 00007f032eb7a8c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:01.942162 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3424011136}
I20260709 12:25:02.143290 30942 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:01.613801  1688 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:02.008448  1329 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:02.203505  1329 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.203960 31624 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:01.978106  1470 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.205150  1470 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.205735  1329 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:01.944453  1454 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.262s
I20260709 12:25:02.206346  1329 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.207094  1470 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:01.698064  1499 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:01.978312  1634 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:02.145758 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.138363 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:02.143625 30798 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 3 to 5, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:02.202862 31615 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
W20260709 12:25:02.225970 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 87668.6us
I20260709 12:25:02.140925 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:01.930830  1690 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.145740 30898 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:02.227095 30798 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:02.134469 30968 rpcz_store.cc:276] 0709 12:25:00.508342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.714551 (+1206209us) service_pool.cc:224] Handling call
0709 12:25:01.714935 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.715113 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.715138 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.715179 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:01.715210 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.715260 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.715353 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:01.973320  1303 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.677331  1627 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.255122 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.255822 30898 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:02.256593 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.259455 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.141561 30967 rpcz_store.cc:276] 0709 12:25:00.508731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.720113 (+1211382us) service_pool.cc:224] Handling call
0709 12:25:01.720455 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.720647 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:01.720933 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.012348 (+291415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.012400 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:02.012447 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.012516 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.012632 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11328,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":111,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":290806,"threads_started":1,"wal-append.queue_time_us":292057}
I20260709 12:25:01.695523  1767 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.978514  1721 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.670832  1689 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:01.693889  1547 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:01.697628  1471 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.600826  1692 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.143597 31051 rpcz_store.cc:276] 0709 12:25:00.584779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.584892 (+   113us) service_pool.cc:224] Handling call
0709 12:25:00.630588 (+ 45696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.943683 (+313095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.703338 (+759655us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54002a5654. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:01.703525 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718495616}
I20260709 12:25:02.138644 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:02.294266 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 169581us
I20260709 12:25:02.145440 31619 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:01.695699  1733 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:02.224457 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:02.120455  1373 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:01.651041  1633 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:01.698812  1477 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:02.208683 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:02.290490  1738 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.141255  1723 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:02.228650  1771 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.149258  1618 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:25:02.135783  1611 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:02.247150 30798 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 3 to 4, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 4 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:02.136572  1691 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.211985  1271 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.289108 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:02.375159 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 559) took 3043 ms. Trace:
I20260709 12:25:02.337211 31049 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
W20260709 12:25:02.303246 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 253076us
I20260709 12:25:02.337339 31014 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:02.343192 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1017) took 1201 ms. Trace:
I20260709 12:25:02.251166  1470 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.346977 31048 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:25:02.243657  1499 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:01.925163  1436 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.345796  1661 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.226650 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:02.354647 31050 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:02.249166  1634 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.290246  1547 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:02.356724  1477 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:01.716579  1682 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.361712  1771 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.300123  1471 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.353384  1373 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.361299  1748 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:02.376587 31618 rpcz_store.cc:276] 0709 12:25:01.142218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.142322 (+   104us) service_pool.cc:224] Handling call
0709 12:25:02.000479 (+858157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.117986 (+117507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.342983 (+224997us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400107050. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:02.343123 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286395648}
I20260709 12:25:02.352767 31047 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:02.381167 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 51477.5us
I20260709 12:25:02.380676 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:02.379496 30798 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 2 to 6, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:02.392419 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 165842us
I20260709 12:25:02.380419  1470 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.394248 31050 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:02.400898 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 103212us
I20260709 12:25:02.477110 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:02.378576  1723 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:02.295468  1721 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.340646  1733 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.375941  1646 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.375641 31045 rpcz_store.cc:276] 0709 12:24:59.315444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.321770 (+  6326us) service_pool.cc:224] Handling call
0709 12:24:59.327143 (+  5373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.362846 (+ 35703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.362880 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.363392 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.621715 (+258323us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18002acbe0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:25:00.113465 (+491750us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:00.113513 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.113595 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.929762 (+1816167us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:02.358188 (+428426us) raft_consensus.cc:1685] finished
0709 12:25:02.358210 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.358331 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3133,"raft.queue_time_us":23850,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":58754,"spinlock_wait_cycles":35169792,"thread_start_us":491507,"threads_started":1,"wal-append.queue_time_us":989503}
I20260709 12:25:02.373086  1611 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:02.390204  1271 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.476403 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:02.519338 30894 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.259392 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:02.520057 31624 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:02.511653 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.401787  1759 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:02.464249  1764 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.469103 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:02.328918  1767 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.506270 31043 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:02.261209  1303 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.510851 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.267920 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:02.526245 31042 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.468118  1436 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.464249  1454 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.480643  1470 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.541735 30894 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:02.528168 30892 raft_consensus.cc:2393] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:02.543193 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.543800 30892 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:02.544662 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.545647 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.546311 30892 raft_consensus.cc:2393] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:02.547338 30892 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.400606  1661 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:02.525560 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 45566.1us
I20260709 12:25:02.548475 30864 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:02.549299  1661 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:02.522894  1646 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.568881  1499 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.381217  1732 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.570189  1618 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:02.570483  1477 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:02.572491  1733 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:02.573926  1471 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:02.575335  1373 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.575897  1373 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.576362  1373 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.578287  1373 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.580739 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:02.582357  1783 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:02.584311  1712 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.585350  1712 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.598403 31042 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:02.520244  1611 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.601801  1499 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:02.534026  1764 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:02.604943  1789 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:02.635751 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 491514us
I20260709 12:25:02.636343 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.638648 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.639709 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.640004 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:02.602749  1618 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.600143  1454 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.678596 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:02.678745 30897 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:02.661433 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:02.679520 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 322703us
I20260709 12:25:02.681874 30976 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.679167 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.682614 30968 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:02.677569 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.678227 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.683498 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.683513 30973 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:02.684208 30970 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:02.689234 30972 raft_consensus.cc:2368] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
I20260709 12:25:02.693125 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:02.693267 30942 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:02.693807 30967 raft_consensus.cc:2376] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9. Re-sending same reply.
I20260709 12:25:02.694804 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.593175  1547 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.697332 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:02.646376  1373 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.699194 30975 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:02.700127 30970 raft_consensus.cc:2410] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:02.646145  1399 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:02.704213 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 235151us
W20260709 12:25:02.703481 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 199311us
W20260709 12:25:02.716176 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 210664us
I20260709 12:25:02.684386  1781 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.611816  1791 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:02.739179 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:02.720435 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 339821us
I20260709 12:25:02.737735 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:02.741029 30969 raft_consensus.cc:2368] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8.
I20260709 12:25:02.631497  1692 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:02.719257  1329 consensus_meta.cc:287] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 12:25:02.631655  1731 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:02.757164 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.757706 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.757826 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 207903us
I20260709 12:25:02.644491  1499 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.726303  1547 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:02.763880 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 256325us
I20260709 12:25:02.764900 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:02.699008  1788 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 12:25:02.766011 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 66693.5us
W20260709 12:25:02.765885 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 48771.9us
W20260709 12:25:02.726944  1748 consensus_queue.cc:1175] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1a7b44e2d0ed440985e5f643a5a54587" responder_term: 6 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: [5.7-5.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:02.634351  1723 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.725634  1399 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.719018  1373 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.762353  1329 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.787869  1303 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:02.784898 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 101837us
I20260709 12:25:02.765532  1731 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:02.678278  1789 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.761731  1787 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:02.764284  1634 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:02.765591  1794 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.765690  1799 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.779563  1771 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:02.764382  1786 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:02.794236 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:02.797676 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:02.798032 31619 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.798169  1738 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:02.798640 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:02.799928 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:02.803186 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:02.821350 31618 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:25:02.739166  1781 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.783241 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:02.807502 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 100762us
W20260709 12:25:02.802348  1770 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:25:02.809741 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:02.813149 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:02.816206 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:02.801069  1808 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.801826  1767 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:02.823668 31624 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:02.824668 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:02.759778  1791 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.854558 30897 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:02.855145 30969 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.858769 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:02.813102  1271 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:02.861202 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 78189.4us
I20260709 12:25:02.861543 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:02.862329 31050 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.891851  1618 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.893582  1618 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.895130  1618 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:02.895898  1618 raft_consensus.cc:697] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:02.825577  1764 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:02.832177  1329 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.921268  1329 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.921743  1453 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:02.922206  1453 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.923334  1329 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.825801  1738 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.925406  1738 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.926178  1781 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.861289  1454 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.860409  1808 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.916800  1821 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:02.919165  1789 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:02.817723  1787 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.938455  1787 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.832273  1634 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:02.920169  1812 log.cc:927] Time spent T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:02.939661  1781 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:02.920675  1764 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:02.885457  1794 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.941089  1764 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:02.941396  1794 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.885150  1721 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.943037  1764 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.934299 31050 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:02.920709  1810 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:02.948437  1810 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.935794  1453 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.936650  1808 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.944258  1794 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.952116  1373 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:02.940814 31016 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:02.959928  1794 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.961103  1688 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:02.963392  1777 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.602s	user 0.001s	sys 0.001s
I20260709 12:25:02.909344  1788 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:25:02.920755  1790 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:25:02.968611 31013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.000s	sys 0.018s
I20260709 12:25:02.885619  1271 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:02.892098  1793 consensus_queue.cc:1059] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:25:02.965291 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2143) took 1268 ms. Trace:
W20260709 12:25:02.969993 31013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.001s	sys 0.018s
W20260709 12:25:02.972937 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 840466us
I20260709 12:25:02.972491 31046 rpcz_store.cc:276] 0709 12:25:01.697247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.697757 (+   510us) service_pool.cc:224] Handling call
0709 12:25:02.050628 (+352871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.375131 (+324503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.375161 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.385288 (+ 10127us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.734024 (+348736us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:02.734061 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.734133 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.965093 (+230960us) raft_consensus.cc:1685] finished
0709 12:25:02.965110 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.965233 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91035,"raft.queue_time_us":154518,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":461745,"threads_started":2,"wal-append.queue_time_us":467393}
I20260709 12:25:03.006485 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:03.007136 31046 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.010049 30893 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
W20260709 12:25:03.016944 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 207625us
I20260709 12:25:02.966791  1791 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:02.970105  1688 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.969475  1623 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.021875 30899 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:03.023576 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 228672us
I20260709 12:25:02.972666  1789 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:02.976491  1499 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.013193  1627 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.016455  1373 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:03.063627 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 44926.8us
I20260709 12:25:03.064817 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49788 (request call id 1797) took 1735 ms. Trace:
I20260709 12:25:03.062429 30976 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:25:03.016367  1810 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:03.025303  1688 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.014534  1470 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:03.031822  1759 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:03.062558  1789 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.064333 30867 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:03.140494 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2152) took 2633 ms. Trace:
I20260709 12:25:03.142809 31046 raft_consensus.cc:2410] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:03.005111  1618 consensus_queue.cc:237] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:03.020987  1471 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:03.013188  1525 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:03.016285  1504 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:25:03.145118 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:03.147941 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 240490us
W20260709 12:25:03.185595  1611 consensus_meta.cc:287] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 12:25:03.189251 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:03.151460 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 324221us
I20260709 12:25:03.152237 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.189601  1611 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.153173 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.144129 30899 rpcz_store.cc:276] 0709 12:25:01.296481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.296597 (+   116us) service_pool.cc:224] Handling call
0709 12:25:03.019800 (+1723203us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b4c003ce340. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032e8f9a20 00007f032e90aa29 00007f032e90b13f 00007f032e8cf2ab 00007f032e8fcf3c 00007f032e8fd3fe 00007f032eb8a88b 00007f0330589495 00007f03305da30f 00007f0330624a55 00007f03355f4cd0
0709 12:25:03.025268 (+  5468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101232384}
I20260709 12:25:03.154102 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.155042 30969 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:03.184798 30971 rpcz_store.cc:276] 0709 12:25:00.507273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.255686 (+748413us) service_pool.cc:224] Handling call
0709 12:25:01.256033 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.977895 (+721862us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:02.208299 (+230404us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.769724 (+561425us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.770207 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.770358 (+   151us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:02.770392 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.770456 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.140290 (+369834us) raft_consensus.cc:1685] finished
0709 12:25:03.140309 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.140431 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":861225,"prepare.queue_time_us":241139,"prepare.run_cpu_time_us":543,"prepare.run_wall_time_us":13136,"raft.queue_time_us":800153,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":4350,"thread_start_us":479353,"threads_started":2,"wal-append.queue_time_us":449876}
I20260709 12:25:03.068246  1627 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:03.179818  1691 consensus_meta.cc:287] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.000s
W20260709 12:25:03.179244  1817 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.108s	user 0.002s	sys 0.000s
I20260709 12:25:03.183452 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.152390  1786 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:03.149897  1453 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:03.194625 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:03.195313 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:03.200157 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 135893us
I20260709 12:25:03.217940 30899 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:03.218246 30971 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:25:03.201246 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 189449us
I20260709 12:25:03.204344 30970 raft_consensus.cc:2368] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8.
I20260709 12:25:03.143496  1788 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:03.192742 30894 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:03.149537  1794 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.182996  1454 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.193460 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.214763 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2147) took 1516 ms. Trace:
I20260709 12:25:03.216415 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:03.228075 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44703.9us
I20260709 12:25:03.179404  1731 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:03.193641 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2152) took 1712 ms. Trace:
I20260709 12:25:03.217680 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:03.219009 31587 connection.cc:256] RPC call timeout handler was delayed by -1.7222661920000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260709 12:25:03.221897 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:03.247478 30895 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.246277 31044 rpcz_store.cc:276] 0709 12:25:01.481473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.481576 (+   103us) service_pool.cc:224] Handling call
0709 12:25:01.502101 (+ 20525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.527811 (+ 25710us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:25:01.527844 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.528280 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.874345 (+346065us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:01.874391 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.874469 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.962761 (+1088292us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:03.179909 (+217148us) raft_consensus.cc:1685] finished
0709 12:25:03.179935 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.193581 (+ 13646us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1659,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":25651,"spinlock_wait_cycles":25626368,"thread_start_us":324659,"threads_started":1,"wal-append.queue_time_us":811300}
I20260709 12:25:03.223791 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.224740  1830 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.222510  1453 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.225528  1271 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.246691 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.246866 31042 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:03.191702  1611 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.197556  1785 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:03.180800  1373 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.250185 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.227770 31051 rpcz_store.cc:276] 0709 12:25:01.698339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.303346 (+605007us) service_pool.cc:224] Handling call
0709 12:25:02.353756 (+ 50410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.659287 (+305531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.659317 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.659996 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.795269 (+135273us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:02.795297 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.202084 (+406787us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54002fbcd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:03.202135 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.202181 (+    46us) raft_consensus.cc:1685] finished
0709 12:25:03.202194 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.214693 (+ 12499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54028,"raft.queue_time_us":70987,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5305,"spinlock_wait_cycles":581546368,"thread_start_us":68403,"threads_started":1,"wal-append.queue_time_us":120896}
I20260709 12:25:03.205917  1767 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.283854 30971 raft_consensus.cc:2368] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:03.249197 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.259796 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:03.265807 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 47181.6us
I20260709 12:25:03.266110 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.267540 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:03.196379  1759 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:03.267704 30976 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:25:03.220423  1399 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.268989 30939 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:03.198151  1471 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:03.196673  1810 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:25:03.303474 31046 raft_consensus.cc:3055] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:03.312819 31046 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:03.314042 30895 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:03.307179 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.308969 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:03.250222  1454 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.220422  1786 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:03.280114  1802 consensus_queue.cc:1059] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:25:03.313583 31046 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.315305 30969 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
W20260709 12:25:03.306389 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 125521us
I20260709 12:25:03.311537 30867 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:03.321461 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:03.246253  1788 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.323184  1813 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:03.352837 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.353229 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.354127 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.355149 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.271534  1611 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:25:03.328528 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 80039.8us
I20260709 12:25:03.357515 30969 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:03.357797 30865 leader_election.cc:400] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7.
I20260709 12:25:03.359282 30865 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:03.360663 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 49205.4us
I20260709 12:25:03.365296 31618 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.366475 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.366762 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:03.367367 31622 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.366497 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:03.323638  1728 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:03.376925 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.327920  1634 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.327316  1399 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:03.377000 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.310395  1767 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.381928 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:03.389091 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.389322 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:03.389961 31617 raft_consensus.cc:2410] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:03.270133  1785 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:03.394956 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.394529 31624 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:03.394629 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:03.395395 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.396894 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.323786  1771 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:25:03.395881  1819 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.408866  1771 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:03.409282  1771 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:03.410029  1771 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.412037 31587 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.404458  1829 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:03.412662 30865 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.412782  1829 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.404888  1827 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:03.405260  1822 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:25:03.406555  1807 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.407003  1823 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.407886  1802 raft_consensus.cc:3055] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:03.408128  1373 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.412233  1824 raft_consensus.cc:2764] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:03.401378  1750 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.388296  1808 raft_consensus.cc:2764] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:03.396590  1789 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:03.416157 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.418964 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:03.382853  1634 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.420814 31587 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.413761 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:03.397156  1712 consensus_meta.cc:287] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.006s
I20260709 12:25:03.422657 30899 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:03.388118  1813 raft_consensus.cc:697] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:03.452638 31051 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:03.451278 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.412118  1471 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:03.408810  1454 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.480378 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.413705  1785 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:03.411206  1771 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.486001 31622 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
W20260709 12:25:03.540254 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 126545us
I20260709 12:25:03.417843  1504 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:03.557271 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.557688 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 136933us
I20260709 12:25:03.559281 30865 leader_election.cc:400] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8.
I20260709 12:25:03.363555  1731 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.420030  1823 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:03.424820  1776 log.cc:927] Time spent T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 1.062s	user 0.014s	sys 0.000s
I20260709 12:25:03.559402 31587 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:03.565253 31587 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.566366 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:03.481758  1547 consensus_meta.cc:287] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.005s
I20260709 12:25:03.420199  1802 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:03.413770  1623 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:03.480243  1634 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.423448  1728 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:03.396126  1399 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:03.556473 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.445111  1750 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:03.448235  1453 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.586536 31051 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:03.588181 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.559655 30865 leader_election.cc:403] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:03.549539  1794 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.549232  1702 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.574349  1837 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:03.541165  1824 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:25:03.578642  1838 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:03.580499 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.425967  1825 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 12:25:03.573537  1791 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.590713 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:03.604741  1837 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.592259 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.609928  1825 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.422278  1827 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.610957 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.611536 30899 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:03.600857 30897 raft_consensus.cc:2410] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:03.612913 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.613682 30897 raft_consensus.cc:2410] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:03.568018  1504 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.614365 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.592587  1728 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.616484  1827 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:03.615424  1504 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:03.540149  1789 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:25:03.615408 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:03.600672 30865 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.604209 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.620707 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.603533 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.621336 31620 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:03.607334 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.608726 31618 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:03.622023 31618 pending_rounds.cc:85] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 7
I20260709 12:25:03.622255 31618 pending_rounds.cc:107] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:03.622473 31618 raft_consensus.cc:2889] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.609701 31044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:03.418185  1819 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.564306  1823 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.610587  1825 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.606294  1682 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.620136 30897 raft_consensus.cc:2376] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9. Re-sending same reply.
I20260709 12:25:03.629359 31616 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:03.629488 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.627826 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.626137 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.626401 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:03.628448 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.628796 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.630515 31618 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:03.631999 31621 raft_consensus.cc:2393] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:03.601155  1623 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8.
I20260709 12:25:03.617828  1728 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:03.630263 31620 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:03.630936 31619 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:03.591795  1794 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.638900 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.719615 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.720135 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.720305 30968 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:03.721604 31621 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:03.719049 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.722039 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.630021 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.637852 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:03.716168 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.722846 30968 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:25:03.724013 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.722863 30897 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:03.752347 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.635279 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.627436 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:03.775592 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:03.776602 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 2173) took 1099 ms. Trace:
I20260709 12:25:03.777004 30968 rpcz_store.cc:276] 0709 12:25:02.677282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.775252 (+1097970us) service_pool.cc:224] Handling call
0709 12:25:03.776533 (+  1281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:03.808318 31618 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:03.808672 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:03.809723 30865 leader_election.cc:336] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.864s (SENT)
I20260709 12:25:03.810194 30865 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.808107 31616 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:03.815146 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:03.627022  1702 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.624819  1791 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:03.626940  1841 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:03.856472 30865 leader_election.cc:336] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.114s (SENT)
I20260709 12:25:03.856983 30865 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.865017 30968 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:03.868278 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:03.813692  1728 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.908241 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.909686 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.910425 30899 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:03.911231 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:03.916991  1738 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.864599  1791 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.864871  1623 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.934806 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:03.627842  1802 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.954553 31616 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:03.880582  1786 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:03.963617 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:03.629532  1813 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:03.929992  1738 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:03.954655  1845 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:25:03.977437 31044 raft_consensus.cc:606] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:03.988500 31044 raft_consensus.cc:614] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:03.983151 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.934367  1819 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:04.070797 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:03.989118  1631 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:04.091002  1732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.009s	sys 0.018s
W20260709 12:25:04.091420  1732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.009s	sys 0.018s
W20260709 12:25:04.092576 30939 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.506s (SENT) [suppressed 43 similar messages]
W20260709 12:25:04.098132 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2513450149999699s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 12:25:04.099184 30897 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:04.099875 30899 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:04.080727  1843 log.cc:927] Time spent T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 12:25:04.106436 31587 connection.cc:256] RPC call timeout handler was delayed by -1.2036450149998927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
I20260709 12:25:04.075222  1837 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:04.086032  1399 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:04.122689 30899 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:04.122643 31587 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.129290 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:04.133657 31587 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:04.127662 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2151) took 2646 ms. Trace:
I20260709 12:25:04.136680 31048 rpcz_store.cc:276] 0709 12:25:01.481209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.481322 (+   113us) service_pool.cc:224] Handling call
0709 12:25:01.481700 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.378495 (+896795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.127361 (+1748866us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b5400162e54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:04.127593 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989404928}
I20260709 12:25:04.137585 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:04.138440 31618 raft_consensus.cc:2410] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:04.139083 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:04.139497 30975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 2167) took 1463 ms (client timeout 1864 ms). Trace:
I20260709 12:25:04.139801 31616 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:04.105191  1631 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.140407 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:04.140918 30975 rpcz_store.cc:269] 0709 12:25:02.675716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.677281 (+  1565us) service_pool.cc:224] Handling call
0709 12:25:04.139372 (+1462091us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b54002733d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.139452 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36569984}
I20260709 12:25:04.149102 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.149362 31623 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:25:04.149977 30975 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:04.151178 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.152312 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.155771 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 568) took 1129 ms. Trace:
W20260709 12:25:04.152568 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 60130.5us
I20260709 12:25:04.134518  1731 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:04.156256 31048 rpcz_store.cc:276] 0709 12:25:03.026333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.148129 (+1121796us) service_pool.cc:224] Handling call
0709 12:25:04.155247 (+  7118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.155435 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.155460 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.155505 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:04.155536 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.155587 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.155689 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.108946  1738 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.149538  1825 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.125720  1837 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:25:04.161005  1718 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:04.162835 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1806) took 1456 ms. Trace:
I20260709 12:25:04.166312 30968 rpcz_store.cc:276] 0709 12:25:02.706049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.814876 (+1108827us) service_pool.cc:224] Handling call
0709 12:25:04.162657 (+347781us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b540016bcd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.162776 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112850688}
I20260709 12:25:04.134450  1849 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:04.158262 30975 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:04.167344 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:04.169879 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.170455 30968 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:04.171186 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.171263 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.171693 30968 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:04.173048 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.171880 30972 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:04.157893  1731 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:04.175088 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.175665 30972 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:04.176323 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:04.164387  1825 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.178238 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.168295  1738 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.182107 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:04.182940 30968 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.168928  1849 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.185226 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.179190  1731 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.188692 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.178977  1794 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.181282  1825 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.190742 30975 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:04.191128 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:04.192317 31623 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:25:04.193104 31623 pending_rounds.cc:85] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 7
I20260709 12:25:04.193455 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:04.194020 31623 pending_rounds.cc:107] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:04.194952 31623 raft_consensus.cc:2889] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:04.195361 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.187886  1849 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:04.197736 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:04.195444 30942 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.200794 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.200927 30942 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:04.206785 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.208314 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.208325 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.215581 30975 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:04.216535 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.217047 30975 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:04.217825 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.218437 30975 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
W20260709 12:25:04.219004 31043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 2153) took 2475 ms (client timeout 1759 ms). Trace:
W20260709 12:25:04.219401 31043 rpcz_store.cc:269] 0709 12:25:01.743471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.135865 (+392394us) service_pool.cc:224] Handling call
0709 12:25:04.218848 (+2082983us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54001c9154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.218942 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838324992}
I20260709 12:25:04.220625 31043 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:04.221050 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2160) took 1081 ms. Trace:
I20260709 12:25:04.221275 31043 rpcz_store.cc:276] 0709 12:25:03.139613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.220312 (+1080699us) service_pool.cc:224] Handling call
0709 12:25:04.220513 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.220900 (+   387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.221014 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.222097 31043 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:04.222536 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2161) took 1079 ms. Trace:
I20260709 12:25:04.222797 31043 rpcz_store.cc:276] 0709 12:25:03.143052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.221771 (+1078719us) service_pool.cc:224] Handling call
0709 12:25:04.221987 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.222348 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.222502 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:04.218484  1835 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.895s	user 0.000s	sys 0.001s
I20260709 12:25:04.225936 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2160) took 1411 ms. Trace:
I20260709 12:25:04.226274 31045 rpcz_store.cc:276] 0709 12:25:02.814834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.815109 (+   275us) service_pool.cc:224] Handling call
0709 12:25:02.826597 (+ 11488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:03.014797 (+188200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.014832 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:03.031644 (+ 16812us) log.cc:844] Serialized 52 byte log entry
0709 12:25:03.260356 (+228712us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:03.260394 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.260461 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.217971 (+957510us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:04.225660 (+  7689us) raft_consensus.cc:1685] finished
0709 12:25:04.225681 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.225883 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6694,"raft.queue_time_us":64211,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":5685504,"thread_start_us":254740,"threads_started":2,"wal-append.queue_time_us":248860}
I20260709 12:25:04.227998 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2114) took 1599 ms. Trace:
I20260709 12:25:04.229065 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2162) took 1085 ms. Trace:
I20260709 12:25:04.229410 31043 rpcz_store.cc:276] 0709 12:25:03.143317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.223291 (+1079974us) service_pool.cc:224] Handling call
0709 12:25:04.223473 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.223590 (+   117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.223604 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.223631 (+    27us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:04.223652 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.223682 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.229017 (+  5335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.230665 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 570) took 1034 ms. Trace:
I20260709 12:25:04.231173 31043 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:04.231813 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2166) took 1045 ms. Trace:
I20260709 12:25:04.219323 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:04.232190 30970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1804) took 1526 ms (client timeout 1575 ms). Trace:
W20260709 12:25:04.232539 30970 rpcz_store.cc:269] 0709 12:25:02.705536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.737444 (+ 31908us) service_pool.cc:224] Handling call
0709 12:25:04.232023 (+1494579us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001e55d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.232138 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064742656}
I20260709 12:25:04.232856 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.233480 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.233999 31043 rpcz_store.cc:276] 0709 12:25:03.186114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.230606 (+1044492us) service_pool.cc:224] Handling call
0709 12:25:04.230875 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.231574 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.231763 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.207472  1399 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.231014 30969 rpcz_store.cc:276] 0709 12:25:03.196025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.326781 (+130756us) service_pool.cc:224] Handling call
0709 12:25:04.230500 (+903719us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b540016add4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.230596 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7952768}
I20260709 12:25:04.237740 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1800) took 1541 ms. Trace:
I20260709 12:25:04.238035 30969 rpcz_store.cc:276] 0709 12:25:02.696460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.237029 (+1540569us) service_pool.cc:224] Handling call
0709 12:25:04.237295 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.237455 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.237479 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.237516 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:04.237548 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.237593 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.237680 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.240901 30968 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:04.241456 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1803) took 1536 ms. Trace:
I20260709 12:25:04.241767 30968 rpcz_store.cc:276] 0709 12:25:02.705005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.181699 (+1476694us) service_pool.cc:224] Handling call
0709 12:25:04.241397 (+ 59698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.242197  1841 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.242647  1841 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.242982 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1805) took 1537 ms. Trace:
I20260709 12:25:04.243359 30968 rpcz_store.cc:276] 0709 12:25:02.705813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.242357 (+1536544us) service_pool.cc:224] Handling call
0709 12:25:04.242590 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.242724 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.242747 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.242783 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:04.242810 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.242853 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.242937 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.244752 30968 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:04.245190 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1807) took 1538 ms. Trace:
I20260709 12:25:04.245457 30968 rpcz_store.cc:276] 0709 12:25:02.706291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.244225 (+1537934us) service_pool.cc:224] Handling call
0709 12:25:04.244480 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.245009 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.245149 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.196158  1794 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:25:04.248603  1794 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.248987  1794 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.249313  1794 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.250510 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.253561 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.254187 31043 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:04.256156 31043 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:04.260133 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.261142 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.262126 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:04.262630 31043 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:04.264029  1688 consensus_meta.cc:287] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.070s	user 0.011s	sys 0.000s
I20260709 12:25:04.264479  1688 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.266400  1688 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.266983  1732 consensus_queue.cc:1059] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:04.214838  1771 consensus_meta.cc:287] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 12:25:04.235574  1399 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:04.268323  1399 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.269340 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2149) took 2526 ms. Trace:
I20260709 12:25:04.269735 31049 rpcz_store.cc:276] 0709 12:25:01.742546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.376024 (+633478us) service_pool.cc:224] Handling call
0709 12:25:02.395846 (+ 19822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.532469 (+136623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.532503 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.532543 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:02.532572 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.269140 (+1736568us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000ae6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:04.269179 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.269287 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313736576}
I20260709 12:25:04.270991 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.272094 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.273051 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.273237 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42986 (request call id 28) took 1094 ms. Trace:
I20260709 12:25:04.215190  1618 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:04.274026 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.274509  1618 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:04.274928  1618 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.213819  1783 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.275655  1783 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.276780  1788 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:04.277663  1783 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.278071 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:04.278808  1783 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:04.280678  1852 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:25:04.281929  1850 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:25:04.283178  1848 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:25:04.284898 31043 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:04.285871 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.292201 31050 raft_consensus.cc:1240] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:04.267062 31051 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:04.273633 31044 rpcz_store.cc:276] 0709 12:25:03.180258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.609564 (+429306us) service_pool.cc:224] Handling call
0709 12:25:04.273086 (+663522us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540015b8d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f0330627853 00007f03355f560a 00007f032eb7b7d4 00007f032eb7b762 00007f032eb7b691 00007f032eb7b60c 00007f032eb7a8c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.273182 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812833664}
I20260709 12:25:04.234239 30970 raft_consensus.cc:2410] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:04.228375 30892 rpcz_store.cc:276] 0709 12:25:02.628923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.630568 (+  1645us) service_pool.cc:224] Handling call
0709 12:25:02.630893 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.748346 (+117453us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:25:02.786100 (+ 37754us) log.cc:844] Serialized 14 byte log entry
0709 12:25:03.143504 (+357404us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.143971 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.144221 (+   250us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:03.144256 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.227622 (+1083366us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b54002314d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:04.227666 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.227756 (+    90us) raft_consensus.cc:1685] finished
0709 12:25:04.227830 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.227945 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216411,"prepare.queue_time_us":74128,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":224807,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":40519,"spinlock_wait_cycles":139922176,"thread_start_us":337275,"threads_started":3,"wal-append.queue_time_us":522467}
I20260709 12:25:04.239583 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1801) took 1541 ms. Trace:
I20260709 12:25:04.301479 30969 rpcz_store.cc:276] 0709 12:25:02.700045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.238943 (+1538898us) service_pool.cc:224] Handling call
0709 12:25:04.239189 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.239324 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.239346 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.239381 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:04.239409 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.239454 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.239539 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:04.294329 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.275101 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.213886  1831 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:04.199066  1723 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 12:25:04.318012 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.324873 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 570) took 1284 ms. Trace:
I20260709 12:25:04.328655 31016 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:04.325522 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 117268us
W20260709 12:25:04.334793 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.335667 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.338056 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.339061 31044 raft_consensus.cc:2410] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:04.338054 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2163) took 1179 ms. Trace:
I20260709 12:25:04.339807 31045 rpcz_store.cc:276] 0709 12:25:03.158671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.227751 (+1069080us) service_pool.cc:224] Handling call
0709 12:25:04.228028 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.228226 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:04.228503 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.337746 (+109243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.337794 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:04.337835 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.337895 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.338002 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270,"prepare.queue_time_us":442,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":34,"raft.queue_time_us":442,"thread_start_us":108533,"threads_started":1}
I20260709 12:25:04.343564  1858 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:04.343986  1858 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:04.344398  1858 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:04.349967  1823 consensus_meta.cc:287] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.002s
I20260709 12:25:04.350425  1823 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.332226  1732 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:04.359597  1823 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.360399  1618 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.364143 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.409425 31044 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:04.368785  1858 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.369987 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:04.371986  1844 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.500s	user 0.003s	sys 0.000s
I20260709 12:25:04.335222  1857 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:04.410646 31045 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:25:04.411686 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 84011.6us
W20260709 12:25:04.364281  1851 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:25:04.419052  1775 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 2.067s	user 0.000s	sys 0.012s
I20260709 12:25:04.414800 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.420677  1857 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:04.422935  1791 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.423395 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.425736 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:04.420522 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.428037 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.429148  1859 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.429921 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:04.430579 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.430986 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.431548 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.433096  1399 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.434135  1732 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:04.434607  1732 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.435093  1399 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.435312  1784 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:04.435822  1784 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.457820 30968 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:04.458974 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.420480  1401 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:04.460210 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:04.462188 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.504086 31615 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
W20260709 12:25:04.469228 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.507368 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.476991 31014 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:04.461236  1859 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.386821  1825 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.517643 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1799) took 3207 ms. Trace:
I20260709 12:25:04.500357  1857 consensus_queue.cc:1059] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:25:04.518054 31046 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.518811 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.519165 30892 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:04.518015 30896 rpcz_store.cc:276] 0709 12:25:01.305519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.333071 (+ 27552us) service_pool.cc:224] Handling call
0709 12:25:01.357990 (+ 24919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.358330 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.358357 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.445646 (+ 87289us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.693245 (+247599us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:01.693288 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.693366 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.410023 (+2716657us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:04.509796 (+ 99773us) raft_consensus.cc:1685] finished
0709 12:25:04.509816 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.512898 (+  3082us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20851,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":46806,"spinlock_wait_cycles":9271808,"thread_start_us":178271,"threads_started":1,"wal-append.queue_time_us":736112}
I20260709 12:25:04.515465 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:04.502803  1399 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.503131  1738 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:04.461001  1783 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.541429 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.542085 30895 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:04.543010 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.543231 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:04.543596 30892 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:25:04.544366 30867 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:04.545351 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.463444  1796 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.500950  1688 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:25:04.505745  1401 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:04.551890 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.552606 31044 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:04.515774  1685 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:04.591974 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.593210 30967 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:04.593250 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 257898us
I20260709 12:25:04.502705  1731 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.595211 30942 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:04.611482 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.463224  1786 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:25:04.645661 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:04.648361 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 53244us
I20260709 12:25:04.656302 30942 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:04.687640 30942 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.507462  1841 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.536351  1399 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:04.690254 30973 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:04.694471 30973 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:04.691094 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.549464  1785 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.696460  1618 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.696722 30967 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:04.694801 30942 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.553359  1816 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.698027 30973 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:04.698868 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 154528us
I20260709 12:25:04.706224  1689 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:04.611764  1685 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.711916  1689 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:04.712816 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.595854  1858 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.704406  1690 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:04.718009  1690 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:04.718367  1690 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:04.718698 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.719389 30896 raft_consensus.cc:2393] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:04.712179  1685 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:04.722520 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.722893 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.720732 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.724466 31046 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:04.739641 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.741504 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.743008 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:04.744225 31046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 2156) took 1661 ms (client timeout 1810 ms). Trace:
W20260709 12:25:04.744599 31046 rpcz_store.cc:269] 0709 12:25:03.064419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.259529 (+195110us) service_pool.cc:224] Handling call
0709 12:25:04.517654 (+1258125us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b58005defd0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305890aa 00007f033060b447 00007f0330623fe7 00007f03306257de 00007f033063127c 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c
0709 12:25:04.725309 (+207655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231898880}
I20260709 12:25:04.745512 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:04.748670 30892 raft_consensus.cc:2393] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:04.697410  1399 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.706774  1857 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.578075  1783 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.750921 31046 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:04.712387  1303 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:04.712469  1689 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.708108  1816 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.755035 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.759555 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:04.782593 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:04.777273 30897 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:04.712492  1631 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:04.766167 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 250764us
I20260709 12:25:04.787685 31014 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.789356  1631 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.774812  1732 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.777976  1816 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.772796 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:04.764915  1857 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:04.770133 30976 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 564) took 2015 ms (client timeout 1662 ms). Trace:
W20260709 12:25:04.795240 30976 rpcz_store.cc:269] 0709 12:25:02.754449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.144858 (+390409us) service_pool.cc:224] Handling call
0709 12:25:04.769930 (+1625072us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b540008a554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.770052 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181911424}
I20260709 12:25:04.780525  1303 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:04.800534 30899 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:25:04.793051  1794 consensus_meta.cc:287] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.005s
I20260709 12:25:04.763361 30892 raft_consensus.cc:1240] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:04.742233  1401 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:04.789374 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:04.792914  1634 consensus_meta.cc:287] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 1.200s	user 0.006s	sys 0.007s
I20260709 12:25:04.795461  1682 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:04.806031 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 111300us
I20260709 12:25:04.792496  1791 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:04.792289  1631 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:04.797999  1857 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:04.817116 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 209637us
W20260709 12:25:04.817963 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.800032  1784 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.827992 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:04.799312  1646 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.811993  1732 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:04.810847  1682 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:04.828899  1866 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:25:04.816984  1631 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.827500  1401 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.804723  1794 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.812541  1634 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.839805  1825 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:04.840667  1732 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:04.848623  1682 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.850324  1731 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:04.859184  1863 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:25:04.834237  1862 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:04.916638 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:04.896754  1856 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 12:25:04.920285 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 132666us
I20260709 12:25:04.898151  1732 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.896404  1859 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.895354  1841 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:04.928238 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 112002us
I20260709 12:25:04.928452 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.932672 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.933661  1784 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:04.937296 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 571) took 1741 ms. Trace:
I20260709 12:25:04.937670 30969 rpcz_store.cc:276] 0709 12:25:03.196351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.302379 (+1106028us) service_pool.cc:224] Handling call
0709 12:25:04.326549 (+ 24170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.326858 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.326886 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:04.332406 (+  5520us) log.cc:844] Serialized 26 byte log entry
0709 12:25:04.411332 (+ 78926us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:04.868558 (+457226us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.896138 (+ 27580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.896237 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.937083 (+ 40846us) raft_consensus.cc:1685] finished
0709 12:25:04.937102 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.937238 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27319,"prepare.queue_time_us":340711,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":5665,"raft.queue_time_us":55632,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":9954,"thread_start_us":509491,"threads_started":2,"wal-append.queue_time_us":163521}
I20260709 12:25:04.939519 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.940084 30969 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:04.940927 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:04.941546 30969 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:04.942739  1685 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.943070  1689 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.947999 30975 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:04.948768 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 568) took 1754 ms. Trace:
I20260709 12:25:04.948892  1689 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.945403  1685 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.945966  1783 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.946544  1690 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.949133 30970 rpcz_store.cc:276] 0709 12:25:03.194507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.298014 (+1103507us) service_pool.cc:224] Handling call
0709 12:25:04.298262 (+   248us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:04.323715 (+ 25453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.323762 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:04.325166 (+  1404us) log.cc:844] Serialized 52 byte log entry
0709 12:25:04.540452 (+215286us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:04.857488 (+317036us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.895756 (+ 38268us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.904994 (+  9238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.905067 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.948571 (+ 43504us) raft_consensus.cc:1685] finished
0709 12:25:04.948589 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.948719 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17119,"prepare.queue_time_us":275706,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":64,"raft.queue_time_us":105710,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":23747,"spinlock_wait_cycles":13744256,"thread_start_us":507870,"threads_started":3,"wal-append.queue_time_us":414616}
I20260709 12:25:04.950763 30976 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:04.951258 30974 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:04.936532  1784 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:04.952263  1784 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.938611 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.954487 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:04.955086  1685 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:04.958323  1685 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:04.958756  1685 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.957360  1690 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.964321  1783 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:04.964825  1783 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:04.965169  1783 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.967275  1864 raft_consensus.cc:3055] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:04.967680  1864 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:04.968792 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 841) took 1365 ms. Trace:
I20260709 12:25:04.968513  1864 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:04.969256 30967 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:04.969477  1864 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:04.969911 30893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1786) took 4002 ms (client timeout 1681 ms). Trace:
W20260709 12:25:04.970306 30893 rpcz_store.cc:269] 0709 12:25:00.967097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.967243 (+   146us) service_pool.cc:224] Handling call
0709 12:25:04.969718 (+4002475us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400231ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.969817 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4522005248}
I20260709 12:25:04.971493 30900 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:04.972256  1783 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.974335  1783 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.975405 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:04.858564  1303 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:04.979002  1794 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.980907  1634 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:04.969138 31615 rpcz_store.cc:276] 0709 12:25:03.603797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.603967 (+   170us) service_pool.cc:224] Handling call
0709 12:25:04.968655 (+1364688us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54006f5254. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.968743 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030452992}
W20260709 12:25:04.983230  1849 consensus_meta.cc:287] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.001s
W20260709 12:25:04.968700 30971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59150 (request call id 2170) took 2292 ms (client timeout 2114 ms). Trace:
W20260709 12:25:04.984586 30971 rpcz_store.cc:269] 0709 12:25:02.676598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.223552 (+546954us) service_pool.cc:224] Handling call
0709 12:25:04.968459 (+1744907us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b540008c854. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:04.968627 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78116736}
I20260709 12:25:04.987409 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2190) took 1086 ms. Trace:
I20260709 12:25:04.987850 30973 rpcz_store.cc:276] 0709 12:25:03.901375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.699782 (+798407us) service_pool.cc:224] Handling call
0709 12:25:04.700029 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.700218 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:04.799668 (+ 99450us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.987079 (+187411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.987134 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:04.987183 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.987252 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.987355 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64192,"prepare.queue_time_us":105309,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":9671,"thread_start_us":226691,"threads_started":2}
I20260709 12:25:04.992656 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.992650 30970 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:04.994973 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:04.997116 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:04.996300  1884 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:05.001246 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.001925 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.002545  1783 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:05.002967  1783 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:05.003310  1783 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.004421 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:05.005079 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.006438 30967 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:05.010085 30939 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:05.011585 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.011829 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:05.012928 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.013389 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:04.983942  1685 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.016816  1685 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.019097 30939 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:05.019490 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.023622 30970 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:05.025281 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:05.025420 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.017455  1785 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:05.026340  1785 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.028688  1829 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:04.328042 31048 rpcz_store.cc:276] 0709 12:25:03.040397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.157438 (+1117041us) service_pool.cc:224] Handling call
0709 12:25:04.160733 (+  3295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.160933 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:04.216207 (+ 55274us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.324551 (+108344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.324598 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:04.324643 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.324704 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.324818 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55262,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":82,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1945,"thread_start_us":162979,"threads_started":2}
W20260709 12:25:05.013677  1795 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.094s	user 0.004s	sys 0.012s
W20260709 12:25:05.032276  1795 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.112s	user 0.004s	sys 0.012s
I20260709 12:25:04.991132  1849 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.034513 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 837) took 1432 ms. Trace:
I20260709 12:25:05.036950  1849 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.038827  1857 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.040458  1689 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.040903 30939 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:05.041654  1689 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.042064 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:05.042744  1689 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:05.043298  1690 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:05.043655 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.044435  1661 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.044932  1661 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:05.045872 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 795384us
I20260709 12:25:05.046026 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.046983  1661 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.048764 30969 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 7. Ops: []
I20260709 12:25:05.049441  1788 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.050294 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:05.050443 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:05.045187 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:05.051498 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:05.052026 30897 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.041581 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.004973  1627 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.048851 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.055740 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.053314 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.053871 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:05.047453  1661 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:05.042374 31043 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:05.057068 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58240.2us
I20260709 12:25:05.096809 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.097101 31014 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:05.097122 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 57440us
I20260709 12:25:05.098038 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:05.034924 31622 rpcz_store.cc:276] 0709 12:25:03.601610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.601748 (+   138us) service_pool.cc:224] Handling call
0709 12:25:03.602013 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.679490 (+ 77477us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:03.724547 (+ 45057us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.168541 (+443994us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.032962 (+864421us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b180006a060. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d4bac0a 00007f0336bfa219 00007f032d542a40 00007f032d53d4e4 00007f032d53d455 00007f0330625060 00007f0330637716 00007f0330648287 00007f0330648208
0709 12:25:05.033088 (+   126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:05.033132 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:05.033193 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.034317 (+  1124us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b540054e554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:05.034355 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.034462 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4355,"prepare.queue_time_us":48455,"prepare.run_cpu_time_us":5690,"prepare.run_wall_time_us":29152,"raft.queue_time_us":868152,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":174,"spinlock_wait_cycles":180719744,"thread_start_us":359420,"threads_started":1,"wal-append.queue_time_us":392973}
I20260709 12:25:05.089025 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.017789  1723 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:05.100306 31045 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:05.100378 31014 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:05.103619 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.113492 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.114912 31043 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.058212 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:05.111042 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.057722 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.113813 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.116582 31044 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:05.115243 31048 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:05.048702  1633 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:05.054785  1634 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.017951  1401 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.115175 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:05.127956 30899 raft_consensus.cc:2368] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:25:05.012853  1862 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.124898 31616 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:05.125262 31621 raft_consensus.cc:1240] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:05.100737  1738 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:05.139094 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 93976.7us
I20260709 12:25:05.146670 31588 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:05.112985  1748 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:05.163626 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.112778  1880 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:05.168651 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 68352.6us
W20260709 12:25:05.154441 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.160989 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:05.120182  1627 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:05.144973 31043 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:05.173425 31014 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:05.174244 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.126339  1633 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.178443 31588 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:05.180336 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:05.148258  1841 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:05.188912 30899 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:05.154230  1761 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:05.121865  1661 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.175819  1731 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:05.197165 31588 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.198273  1785 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.200909  1785 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:05.201601 31013 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:05.202126  1661 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.195749  1784 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.183523  1829 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:05.198662  1731 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:05.208498  1731 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.211812  1837 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:05.194900  1841 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:05.212828  1841 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.216449 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.217034 31622 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.218811 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.219413 31617 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:25:05.220031 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.220219 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.221112 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.221266 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.222087 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.222726 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.223412 31615 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:05.224134 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.225062 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.225211 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.195137  1795 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:05.225979  1795 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:05.184954  1857 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.195115  1761 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:05.226778  1761 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.222334 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.226305 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.232134  1767 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.232141 31617 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:25:05.232919 31616 raft_consensus.cc:2410] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:05.231696 31622 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:05.237919  1470 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.239086 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1818) took 1158 ms. Trace:
I20260709 12:25:05.239435 30976 rpcz_store.cc:276] 0709 12:25:04.081188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.796212 (+715024us) service_pool.cc:224] Handling call
0709 12:25:04.796526 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.951141 (+154615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.238870 (+287729us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400327154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:05.239030 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354365824}
I20260709 12:25:05.241855  1868 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:05.242311  1868 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:05.242689  1868 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.201577 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:05.244388  1881 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:25:05.246562 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2168) took 2382 ms. Trace:
I20260709 12:25:05.246928 31051 rpcz_store.cc:276] 0709 12:25:02.864787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.587827 (+723040us) service_pool.cc:224] Handling call
0709 12:25:05.246380 (+1658553us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400158bd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:05.246504 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559477120}
I20260709 12:25:05.144377  1401 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.248986 30893 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.251055  1401 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.251960  1816 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.253142 30895 raft_consensus.cc:2393] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:05.253981  1816 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.256254 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:05.206254  1784 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:05.262777 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 62985.3us
I20260709 12:25:05.276388 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:05.277139 30895 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:05.278656 31618 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:25:05.279117  1891 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:05.280470  1661 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:05.282148  1849 raft_consensus.cc:3055] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:05.256546  1829 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:05.282586  1889 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:05.283373  1861 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.820s	user 0.000s	sys 0.003s
W20260709 12:25:05.225560  1888 log.cc:927] Time spent T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:05.284018  1829 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:05.226352  1795 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.282191  1633 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.288658 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2175) took 2610 ms. Trace:
I20260709 12:25:05.289038 30975 rpcz_store.cc:276] 0709 12:25:02.677808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.233633 (+1555825us) service_pool.cc:224] Handling call
0709 12:25:04.770567 (+536934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.948350 (+177783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.287811 (+339461us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540008a554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:05.288501 (+   690us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540008a550. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:05.288609 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641800320}
W20260709 12:25:05.291393  1399 consensus_meta.cc:287] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.005s
I20260709 12:25:05.295707 30897 raft_consensus.cc:2410] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:05.306252 30893 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:05.309875 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.310142 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.313814  1802 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.282547  1849 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:05.316936  1849 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.318118  1849 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.291792  1399 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.318313  1816 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.322206  1816 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.323072  1682 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.322247  1399 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.329226 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 568) took 3260 ms. Trace:
I20260709 12:25:05.329622 30900 rpcz_store.cc:276] 0709 12:25:02.068962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.070741 (+  1779us) service_pool.cc:224] Handling call
0709 12:25:04.971178 (+2900437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.971859 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.329030 (+357171us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b5400231ed0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:05.329163 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6669658368}
W20260709 12:25:05.331707  1832 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 1.969s	user 0.004s	sys 0.012s
I20260709 12:25:05.335041 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:05.336774  1792 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.337443  1792 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.340188 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1808) took 2617 ms. Trace:
I20260709 12:25:05.340600 30968 rpcz_store.cc:276] 0709 12:25:02.723156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.246034 (+1522878us) service_pool.cc:224] Handling call
0709 12:25:04.246261 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.458276 (+212015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.339941 (+881665us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400126454. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:05.340124 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444961024}
I20260709 12:25:05.344141 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2159) took 2204 ms. Trace:
I20260709 12:25:05.344558 31050 rpcz_store.cc:276] 0709 12:25:03.139358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.216478 (+1077120us) service_pool.cc:224] Handling call
0709 12:25:04.216737 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.292530 (+ 75793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.343906 (+1051376us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b540013f454. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:05.344079 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173220736}
W20260709 12:25:05.358983 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 101182us
W20260709 12:25:05.359586 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 206513us
I20260709 12:25:05.369886 30974 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:05.366309 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.376278 30968 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:05.378659 30865 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.381711 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.383457  1868 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.383672  1829 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:05.385437  1631 consensus_meta.cc:287] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.004s
I20260709 12:25:05.385615  1868 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.388947 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:05.395412 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.267017  1783 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.403231 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.414245 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.434240 31622 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.440749 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.441929 30865 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.382102  1792 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.383819  1732 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.447052 31013 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:05.448931 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.460573 31618 raft_consensus.cc:2393] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:05.452407 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.452711 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.453917 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.462379 30972 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.458539 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:05.463306 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 238931us
I20260709 12:25:05.464948 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.465586 31619 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
W20260709 12:25:05.467593 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.468844 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.469434 31050 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:05.471499 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.385905  1631 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.472252 31045 raft_consensus.cc:2393] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:05.412133  1682 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.483546 30972 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:05.489575 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:05.490435 31043 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:05.490676 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.416554  1829 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.487388 31045 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:05.495018 31050 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:05.486054 31622 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:05.440609  1893 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:05.499464  1893 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.501415  1893 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.492494 30975 raft_consensus.cc:2368] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:25:05.497022 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.504361 31045 raft_consensus.cc:2376] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8. Re-sending same reply.
W20260709 12:25:05.472972  1844 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:25:05.506458 31045 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:05.496959 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:05.490221 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 386455us
I20260709 12:25:05.498967  1732 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.473641  1792 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:05.488452  1646 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:05.516328 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 342979us
I20260709 12:25:05.517378 31051 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:05.493023  1401 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:05.520049 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.526971  1633 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:05.531100 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.531183  1633 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.532701  1783 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.533219  1633 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.533731  1738 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:05.535637  1738 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:05.536818 31588 leader_election.cc:400] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:25:05.537142 31588 leader_election.cc:403] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:25:05.538627  1661 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.538987  1738 consensus_queue.cc:1059] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:05.505100  1627 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:05.540097  1767 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:05.540482  1767 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:05.540438  1627 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.541429  1767 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.542733  1732 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.545387 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.546180 30972 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:05.547782 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.505020  1816 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.543236  1732 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.548528 30971 raft_consensus.cc:2393] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:25:05.548832 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 496626us
I20260709 12:25:05.550132 31624 raft_consensus.cc:2410] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:05.552615 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.553927 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.570642 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.572224 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.522742  1646 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.555119 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.597714 30972 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:25:05.544822  1303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.017s
I20260709 12:25:05.604800 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.605588 30975 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:05.527433  1401 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:05.491958  1731 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.613322 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.575693 31050 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:25:05.600055 31014 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.600358 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.602269 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.599481 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.603314 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.527506  1829 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.596903  1884 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.626569 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.612147 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.612298 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.629637 31615 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:05.600596  1792 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:05.613253  1303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.003s	sys 0.017s
I20260709 12:25:05.630573 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.599975  1825 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.636449 31621 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:05.632535 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:05.633819 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.634654 31587 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.598834  1816 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.601545  1646 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.615523  1401 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.635483 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.638046 31587 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:05.637262 31050 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:05.641489 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:05.642719 31622 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:05.639967  1801 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:05.643893  1816 consensus_queue.cc:1059] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:05.644965  1731 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.645506 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.644937  1816 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:05.645179  1889 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.647501  1889 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.648595 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.649152 31615 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:05.638020  1633 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:25:05.652318 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.652901 31042 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.652993  1783 consensus_queue.cc:1059] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:05.654137  1783 raft_consensus.cc:3055] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:05.654454  1783 raft_consensus.cc:740] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:05.633109  1682 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.656149 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.656931 31048 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:05.658035 31046 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:05.659014 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:05.659543 31044 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.655198  1783 consensus_queue.cc:260] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.679594 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.550840  1868 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 12:25:05.680482 31622 raft_consensus.cc:2410] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:05.681320 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.681543  1904 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:05.681998  1904 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:05.682807  1904 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.684757 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.686342 31615 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:05.705271 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.706257 31615 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:05.660298 31042 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:05.714632 31044 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:05.646660  1732 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.735335  1902 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.736208 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.632313  1884 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.740803  1903 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:05.741431  1903 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.741815  1884 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.659623  1825 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.744055  1631 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.704762  1303 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:25:05.746014  1303 raft_consensus.cc:3055] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:05.746390  1303 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:05.632045  1829 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.749298 31616 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:05.749444  1661 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:25:05.750386 31619 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:05.743461  1903 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.750906  1906 consensus_queue.cc:1059] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:05.735948  1902 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:05.755084  1902 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:05.755589  1902 raft_consensus.cc:3055] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:05.755918  1902 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:05.641382  1841 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.683940  1904 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.767753  1750 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.768934  1750 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.634096  1761 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.773566  1761 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:05.756699  1902 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.648386  1795 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.844903 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.845782 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:05.939833 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.747215  1303 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:05.953167 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.954756 30973 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:05.957705 31623 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:05.899258  1868 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:05.914426  1889 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:05.968905 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 452793us
W20260709 12:25:05.969727 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 328279us
I20260709 12:25:05.965601 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:05.966197 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 314458us
W20260709 12:25:05.966678 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.967187 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.984608 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:05.984850 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:05.985174 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.985360 30973 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.986025 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:05.988113 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:05.990329 31016 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.991523 31016 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:05.992159 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:05.998049 31587 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:05.965696  1783 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.997572 31016 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.007858 31016 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.009060 31016 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:06.005656 31049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.002s	sys 0.019s
W20260709 12:25:06.010808 31049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.002s	sys 0.020s
I20260709 12:25:05.999982  1731 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:06.014382  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.013s
I20260709 12:25:06.005110  1303 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.009100  1896 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.992344  1682 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:05.994850  1893 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.995390  1795 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:05.994706  1784 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.014885  1868 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:06.004567  1633 consensus_queue.cc:1059] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:25:06.014592  1761 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.013661  1785 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:06.018496  1731 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:06.018966  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.013s
I20260709 12:25:06.039947  1825 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:06.074772 30865 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.012s	sys 0.005s
W20260709 12:25:06.233287 30865 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.013s	sys 0.006s
W20260709 12:25:06.233726 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 753491us
I20260709 12:25:06.222807  1919 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:25:06.076798 30866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.004s	sys 0.008s
I20260709 12:25:06.077345 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2123) took 2862 ms. Trace:
W20260709 12:25:05.993673 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.087976 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.002s	sys 0.008s
W20260709 12:25:06.242889 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.002s	sys 0.009s
W20260709 12:25:06.243269 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 687826us
I20260709 12:25:06.090570 30976 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:06.117280 30864 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.023943  1682 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.245716  1682 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:06.176671 30970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.017s
W20260709 12:25:06.248068 30970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.018s	sys 0.018s
I20260709 12:25:06.248987  1931 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.249843  1931 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.255816  1868 consensus_queue.cc:1059] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:06.258677  1893 raft_consensus.cc:3055] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:06.259202  1893 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:06.178130 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 179983us
W20260709 12:25:06.189815  1401 consensus_meta.cc:287] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.000s
I20260709 12:25:06.031231  1731 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.198908 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 863) took 1016 ms. Trace:
W20260709 12:25:06.201701 31624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 838) took 2599 ms (client timeout 2060 ms). Trace:
W20260709 12:25:06.242017 30866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.005s	sys 0.008s
I20260709 12:25:06.267069 30973 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:06.262756  1929 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:06.270087 31587 leader_election.cc:400] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:25:06.284344 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.286170  1897 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:06.286710  1897 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:06.287146  1897 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.288120 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1041) took 1010 ms. Trace:
I20260709 12:25:06.288498 31623 rpcz_store.cc:276] 0709 12:25:05.277680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.277806 (+   126us) service_pool.cc:224] Handling call
0709 12:25:05.278118 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.959601 (+681483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.287567 (+327966us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54006f45d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:06.287956 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555819392}
I20260709 12:25:06.286211  1801 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:06.291258  1801 raft_consensus.cc:697] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:06.292821  1801 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.294549  1829 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:06.296357  1841 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:06.304663 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 295537us
I20260709 12:25:06.261718 31621 rpcz_store.cc:276] 0709 12:25:05.181915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.182060 (+   145us) service_pool.cc:224] Handling call
0709 12:25:05.182378 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.636824 (+454446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.198163 (+561339us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54007616d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:06.198586 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043852160}
W20260709 12:25:06.262034 31624 rpcz_store.cc:269] 0709 12:25:03.601885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.602007 (+   122us) service_pool.cc:224] Handling call
0709 12:25:06.201097 (+2599090us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54006bb554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:06.201382 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4003947776}
I20260709 12:25:06.348976  1931 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.351841  1401 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.352835  1767 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.354461  1401 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.355687  1893 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.357724  1893 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:06.360527 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 243533us
I20260709 12:25:06.367193 30895 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:06.368198 30798 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53550 (request call id 396) took 18918 ms (client timeout 15000 ms). Trace:
I20260709 12:25:06.284180  1902 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.371589  1810 raft_consensus.cc:3055] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:06.372036  1810 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:06.372974  1810 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.373950  1810 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:06.372048 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 60005.6us
I20260709 12:25:06.376864 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.378968 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.379488 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.379979 30976 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:06.380373 31051 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:06.380492 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.381256  1906 consensus_queue.cc:1059] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:06.382884 30901 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:06.384092  1920 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:06.385046 30899 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:06.385349  1920 consensus_queue.cc:1059] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:06.385769  1792 raft_consensus.cc:3055] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:06.386168  1792 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:06.390995  1904 consensus_queue.cc:1059] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:06.386170  1816 raft_consensus.cc:3055] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:06.392244  1904 raft_consensus.cc:3055] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:06.392680  1904 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:06.393700  1904 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.394687  1738 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.395098  1904 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.395514  1816 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:06.396188 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.396505  1816 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:06.397073  1750 consensus_meta.cc:287] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.005s
I20260709 12:25:06.398183  1816 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:06.398468  1646 consensus_meta.cc:287] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.005s
I20260709 12:25:06.398916  1646 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:06.399405 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 412297us
I20260709 12:25:06.398367  1931 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:06.399979 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.400506  1931 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.368685 30900 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:06.241950  1910 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 12:25:06.384280 30867 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:06.403535 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.404882 31587 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.406368 31587 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.407968  1633 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.408093  1926 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:06.260573 30898 rpcz_store.cc:276] 0709 12:25:03.215154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.215565 (+   411us) service_pool.cc:224] Handling call
0709 12:25:03.215883 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.259276 (+ 43393us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:03.353129 (+ 93853us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.339605 (+1986476us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18003bc080. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd23a 00007f0330637a2a
0709 12:25:05.613203 (+273598us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.613673 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.613794 (+   121us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:05.613824 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.613957 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.076132 (+462175us) raft_consensus.cc:1685] finished
0709 12:25:06.076436 (+   304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.077007 (+   571us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69698,"prepare.queue_time_us":122242,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2880,"raft.queue_time_us":183344,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":2984,"spinlock_wait_cycles":7412224,"thread_start_us":358036,"threads_started":2,"wal-append.queue_time_us":2581093}
I20260709 12:25:06.370101 31016 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:06.410231 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.387318  1792 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.412094 30867 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.412955  1792 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.413511 31016 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.413995 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.414932  1909 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.415782  1909 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:06.416471  1909 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.412210  1896 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:06.399667 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:06.421186 30970 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.421746 31050 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:06.422902 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.421780 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.395323  1738 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.424485 31049 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:06.425318  1930 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:06.425933  1930 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.398208 30899 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:06.410768  1646 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.428213  1930 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.429047 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.431568 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.432328 30967 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:06.433214 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.435125 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.435915 30969 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:06.410672  1868 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.436535  1868 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:06.436954  1868 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.443842  1930 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.444818 30898 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:06.444674  1930 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.444895  1682 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.446029 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.446746 30901 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.447549  1930 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.450724 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.452055 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.452544  1920 raft_consensus.cc:3055] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:06.452952  1920 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:06.453315 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.453986 30972 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:06.433432 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.454684 30900 raft_consensus.cc:2376] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8. Re-sending same reply.
I20260709 12:25:06.455752 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:06.456250 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.383443  1906 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:25:06.461905 30970 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:06.463402  1682 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.464071  1909 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.465083 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:06.466071 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:06.423656 31051 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:06.466670  1401 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.467240  1906 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.369741 30795 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.467749  1750 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.436082  1931 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.468195  1912 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.471987  1920 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:06.474717 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.475741 31049 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:06.467406 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.426410  1738 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.476706 30864 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.477540 31043 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:06.479993 30901 raft_consensus.cc:2410] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:25:06.370940 30798 rpcz_store.cc:269] 0709 12:24:47.449244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.449383 (+   139us) service_pool.cc:224] Handling call
0709 12:24:48.754309 (+1304926us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540021d9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330597090 00007f0330635f3a 00007f03363ebe9c 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc 00007f03349aa392 00007f032e96848c 00007f032e9678c6
0709 12:25:06.367893 (+17613584us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:02.806842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:02.927012 (+120170us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:02.927063 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:25:02.927084 (+    21us) tablet.cc:662] Decoding operations
0709 12:25:03.138672 (+211588us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:03.138751 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:03.138782 (+    31us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:25:03.197027 (+ 58245us) tablet.cc:701] Row locks acquired
0709 12:25:03.197078 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:25:03.197232 (+   154us) write_op.cc:270] Start()
0709 12:25:03.197371 (+   139us) write_op.cc:276] Timestamp: P: 1783599903197173 usec, L: 0
0709 12:25:03.197392 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:25:03.306370 (+108978us) log.cc:844] Serialized 9237 byte log entry
0709 12:25:04.961711 (+1655341us) op_driver.cc:464] REPLICATION: finished
0709 12:25:05.240647 (+278936us) write_op.cc:301] APPLY: starting
0709 12:25:05.240758 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:05.241169 (+   411us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:05.241308 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:05.338592 (+ 97284us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:05.339251 (+   659us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:25:05.339299 (+    48us) write_op.cc:312] APPLY: finished
0709 12:25:05.346671 (+  7372us) log.cc:844] Serialized 164 byte log entry
0709 12:25:05.400490 (+ 53819us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:05.448160 (+ 47670us) write_op.cc:454] Released schema lock
0709 12:25:05.490630 (+ 42470us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:05.531166 (+ 40536us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:05.531207 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3800,"reported_tablets":39,"spinlock_wait_cycles":804053888,"child_traces":[["op",{"apply.queue_time_us":207793,"apply.run_cpu_time_us":5919,"apply.run_wall_time_us":333631,"num_ops":24,"prepare.queue_time_us":146767,"prepare.run_cpu_time_us":19501,"prepare.run_wall_time_us":667399,"raft.queue_time_us":191588,"raft.run_cpu_time_us":39696,"raft.run_wall_time_us":200402,"replication_time_us":1764137,"spinlock_wait_cycles":3968,"thread_start_us":457232,"threads_started":4,"wal-append.queue_time_us":305736}]]}
I20260709 12:25:06.483875  1897 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.351365  1784 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.464183 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.500618 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.514154 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.499648  1761 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:06.525803 30899 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:06.527848 30976 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:06.487376  1910 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:25:06.528985 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 115654us
I20260709 12:25:06.534394 31588 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.517485 30795 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 3 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.521960  1896 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:06.511641  1401 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.552273  1889 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:06.558092 31588 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.525331  1906 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.523557  1750 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.569092 31016 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.527171  1801 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:06.525508  1912 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.587234 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.573736  1889 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:06.568933  1761 raft_consensus.cc:697] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:06.524091  1909 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.589700 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.579174  1303 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:06.571973  1896 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.583196  1897 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.583951  1849 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:06.589612 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:06.604530 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 61169.6us
I20260709 12:25:06.608289 30895 raft_consensus.cc:2410] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:06.598308  1889 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.613463 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:06.617534 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 54268us
I20260709 12:25:06.616359 30900 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:06.605687  1849 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.620944  1688 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.618212 31588 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.624560  1841 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:06.625124  1841 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:06.626157  1841 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.626905  1829 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.627322  1829 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.627652  1829 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.629046  1925 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.629630  1925 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.632088 30939 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.608283  1910 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:06.624382 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 147757us
I20260709 12:25:06.633061  1399 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:06.615588  1889 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.615129 30865 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.616323  1731 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.645588 30864 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:06.646433  1925 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.649770  1920 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.633481  1849 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.652207 30795 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 7 to 8, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.652979  1912 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.653689  1761 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.654592 30795 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:06.611057  1930 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:06.642449  1910 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.614272  1897 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.657495  1897 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.659891  1943 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.660384  1897 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.659811  1399 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:06.664125  1750 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.667941  1931 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:06.668784  1906 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.670270  1401 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.673169 30898 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
W20260709 12:25:06.683461 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 69414us
I20260709 12:25:06.690513  1912 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.690977  1912 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.691366  1912 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.689714  1897 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.696260  1910 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.696276  1897 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.696973  1897 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.660470  1943 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.701043  1731 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.706790  1897 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:06.708884 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 140631us
I20260709 12:25:06.707885  1912 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.710033 31587 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.710899  1912 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.711347 31587 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.713387  1802 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:06.714193  1802 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:06.714504 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:06.711887  1784 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.715590  1784 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.718075  1784 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:06.718703 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.720441 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.720810  1910 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:06.721235  1910 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.721545  1910 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.718714  1810 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:06.725445  1930 consensus_queue.cc:1059] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:06.727042  1943 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:06.738811 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 51261.4us
I20260709 12:25:06.746352 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.712617  1897 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.747002 31051 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
W20260709 12:25:06.749064 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 64993.4us
I20260709 12:25:06.740196 30865 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.748603  1943 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.751138 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.751821  1944 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.751468 30795 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
W20260709 12:25:06.752306 30942 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.864s (SENT)
I20260709 12:25:06.776793 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.752686 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:06.753491 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.753681 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:06.756124 31045 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:06.755548 30896 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:06.738984  1906 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:25:06.761986  1829 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.720944  1896 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.766671 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:06.767133 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.771027 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:06.711856  1801 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:25:06.771973 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:06.774511 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 49563.6us
I20260709 12:25:06.792901 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:06.738157  1784 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.797065  1945 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.797322 31621 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:06.797832  1952 raft_consensus.cc:3055] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:06.797960  1906 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:06.798309  1952 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:06.798924 30795 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.799432  1952 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.800890  1952 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.800608 30795 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 4, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 4 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.783217  1399 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:06.788738 31049 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:06.802521 30795 catalog_manager.cc:5697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.780182 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:06.790105 31046 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.789486 31050 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:06.790696 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.707518  1868 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.784461  1931 raft_consensus.cc:3055] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:06.797729  1945 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:06.794427 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 54281.9us
W20260709 12:25:06.797094 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 62717.9us
I20260709 12:25:06.809149  1930 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:06.809320 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.809795  1930 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.810294  1930 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.810740  1829 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.797106  1784 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.813658 30971 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:06.814610 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.815218 30976 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:06.816612 30864 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:06.817401  1910 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.818225  1401 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:06.818802  1401 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.805410 31622 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:06.819864 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.828056 30864 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:06.828711 30864 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:06.823010 30939 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.832947 30795 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 6, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 6 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.805258  1931 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:06.819458  1910 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.836702  1906 consensus_queue.cc:1059] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:06.837358  1802 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:06.837533  1889 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.826896  1784 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:06.839871  1943 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.841120 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:06.841602 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:06.841965 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.841864 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.843398 30976 raft_consensus.cc:2410] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:06.844368  1868 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.844559 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:06.845134 31623 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:06.845606 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 72781.6us
I20260709 12:25:06.846376 31587 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:06.844877 31043 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:06.848161 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:06.848361 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:06.848845 30976 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.839785 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.849177  1731 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:06.841856  1943 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.836571  1931 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:06.835019 30795 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 2 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.848225 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:06.849673 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:06.855350  1897 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.855929  1893 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.856519  1893 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.856844 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.857710  1952 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:06.830060  1909 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.849177 31618 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:06.858582  1941 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.893319  1941 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.893497 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.893659 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.788609  1944 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:06.858247  1952 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:06.896027 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:06.865427 30976 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:06.915993 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:06.917750 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.918411 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.918608 31048 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:06.901551 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:06.858333 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:06.919268  1930 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.916041 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.915179 31046 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:06.818512  1750 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.864408 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:06.929461 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.893808  1941 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.930763 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.928987 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.932021 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.940557 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.855805 31616 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.839622  1889 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:06.855815  1897 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.858711  1893 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:06.930799  1401 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.931272 30795 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 4 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 5 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:06.897537 31588 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.960789 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.961613 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.963687 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.957026 31049 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.959389 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:06.968906 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 120626us
I20260709 12:25:06.956007 31623 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:06.974720 30864 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:06.968547 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.968532 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 71084.4us
I20260709 12:25:06.981335 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:06.958562 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.957125 31042 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:06.983871 30976 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
W20260709 12:25:06.991925 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 133678us
I20260709 12:25:06.992763 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:06.964282 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.928156  1944 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:06.859534  1303 raft_consensus.cc:3055] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:06.995692 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:06.923048  1945 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:06.998749 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:06.864045  1784 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:06.999082 30892 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.998616 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:06.997540 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:06.859388  1931 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.907246  1802 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:07.001235 31013 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.002327 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.004989 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.006232 30896 raft_consensus.cc:2410] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:06.981557  1889 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:07.017266  1889 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:06.959137  1897 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.004041  1949 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.991881  1943 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.014081 31623 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:07.014431 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.014675 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.030827 30901 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.954540  1750 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.015882 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.016374 30897 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:06.909117  1909 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:25:07.019675 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.017282 31016 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.012411  1868 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.017336 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:06.859393  1906 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:25:07.014861 31624 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:07.012419 30895 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:06.851995  1829 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
I20260709 12:25:06.858917  1950 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:06.860834  1849 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.000051  1896 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:07.000674  1303 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.007805  1784 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.036520 31615 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:07.015969  1802 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:07.001076  1902 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:07.041061 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.045222 30864 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:07.033963  1750 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.048156 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.036007  1868 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.054446 30901 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:07.045900  1801 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.049674  1784 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.056134  1761 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:07.082612 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.056034  1952 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:07.056011 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 58369.2us
I20260709 12:25:07.056818  1802 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.063155 31620 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:07.062848  1303 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.039443  1930 raft_consensus.cc:2764] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:25:07.040673  1893 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.073172 31016 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.080966 31622 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:07.081202  1944 raft_consensus.cc:3055] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:07.100029  1944 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.056124  1896 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.100956  1944 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.050727  1943 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.095242 30892 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:07.120376 31616 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:07.126998  1944 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.073395  1868 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.072885  1920 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.064450  1950 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:07.141551  1943 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.100883  1941 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.142800  1401 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:07.143781 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.095481  1761 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.139501 31617 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
W20260709 12:25:07.146097 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 131771us
I20260709 12:25:07.151510 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.157748 30896 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:07.159479  1682 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:07.160769 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 110163us
I20260709 12:25:07.161473 31016 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.162534 31016 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.163311  1786 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.163662  1786 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:07.164016  1786 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.164615  1893 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.166894  1941 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.167557 31045 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.170367 31622 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.147084  1303 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:07.173038 30942 leader_election.cc:336] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.052s (SENT)
I20260709 12:25:07.144680  1920 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:07.175833 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:07.176052 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:07.178428  1953 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:07.158389  1761 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.154484  1401 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.185765 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.185521  1919 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:25:07.187911  1919 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:07.188252  1919 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.188536  1904 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:07.189018  1904 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:07.189697 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.189934  1904 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:07.189101 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 171847us
I20260709 12:25:07.185810 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.191694  1688 consensus_queue.cc:1059] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:07.192052 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:07.192569 30942 leader_election.cc:336] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 2.060s (SENT)
I20260709 12:25:07.193164 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.193223 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.193548 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:07.189077  1919 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.194085 31624 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:07.191941 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:07.195622  1925 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.193099 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.198573 30867 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.120380  1889 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.199679  1910 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.199566  1786 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:07.200445  1954 log.cc:927] Time spent T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:07.192763 31623 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:07.202724  1909 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:07.203789  1786 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:07.204069  1909 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:07.207240 31049 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:07.208748 30867 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.209637 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.210335  1910 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.210695  1910 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.211000  1910 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.212271  1849 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.215898  1909 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:07.216292  1909 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.216612  1909 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.222010  1910 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.224092  1950 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.228008 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.197706 31587 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.179884  1920 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:07.237390 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 43968.6us
I20260709 12:25:07.235046 30867 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.238303  1849 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:07.235989  1906 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.238559  1401 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:07.238963 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 46448.7us
I20260709 12:25:07.223253  1897 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.244621 30867 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.236371  1767 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:07.239301  1947 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:07.263581  1627 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.242373  1849 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:07.271864 30899 raft_consensus.cc:2393] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:25:07.272225 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.276059 30898 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:07.257601  1930 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.262450  1944 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.290850 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.293327  1868 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.293596 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.296205 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.296980  1688 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.297531 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.298260  1688 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.298825 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.267412  1401 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.299551  1688 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.297638  1906 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:07.301416  1906 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.302269  1906 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.304934  1897 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.306694 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.307237 31045 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.307842  1957 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.308388  1957 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.310402  1957 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.310930  1957 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:07.312731  1910 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:07.313716 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.314250 31616 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.316047 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.268064  1919 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.317338 30971 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:25:07.318147 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.274333  1947 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:07.320305 31042 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:07.295495  1868 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:07.320812  1947 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.323880 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.324607 30971 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.324020 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:07.323930 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 126308us
I20260709 12:25:07.327750 31587 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:07.329352 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.330511 31013 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.331987  1688 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.331993  1925 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:07.332629  1688 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.334357 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.334651  1750 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.315862  1909 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.338497 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.344290 30971 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:07.345230 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.350085 31616 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
W20260709 12:25:07.374437 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.332651  1925 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:07.377012 31622 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:07.283460  1849 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.382809 31013 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:07.385161 30900 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:07.385452 30969 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.397585 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.311525  1957 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.405584 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.406343 30893 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:07.381520  1688 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:07.409420 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:07.409436 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.415057 30969 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:07.425520 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.426219 30893 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:07.381177  1761 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.430181 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.432309 31622 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.382849  1784 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:07.445199 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.412412  1688 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:07.418298  1868 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.418123  1893 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.411648  1963 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:07.449110 31616 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:07.449468 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.450913 31622 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:07.454815 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.452771 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.456868 31051 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:07.458601 30893 raft_consensus.cc:2368] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:25:07.465281 31618 raft_consensus.cc:1240] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:07.451639  1688 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.469826 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.473232 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.473778 30893 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:07.471544 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 54945.7us
I20260709 12:25:07.470645 31624 raft_consensus.cc:2376] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5. Re-sending same reply.
I20260709 12:25:07.478973 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.479521 31616 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.481051 31617 raft_consensus.cc:2410] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:07.486367 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.496022 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.508136 31624 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:07.510689 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:07.509860 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 72471us
I20260709 12:25:07.511274 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.514489 31616 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:07.581766 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.582662 31624 raft_consensus.cc:2393] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:07.585938  1969 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:07.588137  1627 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:07.588776  1627 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.591358  1627 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.588193 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.594120 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.595124 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.596323  1957 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.470284  1920 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.633718  1920 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:07.597412  1896 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:07.598438  1967 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:25:07.486726  1893 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.600000  1909 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:07.601155  1784 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:07.604177 30897 raft_consensus.cc:2410] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:07.637388  1893 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:07.639834  1965 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:25:07.665441 30893 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:07.666008 31045 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:07.669387  1849 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.669967 30893 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:07.605696 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 128282us
I20260709 12:25:07.610021 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.707265 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:07.708201 30894 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:25:07.708587 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.709157 31622 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:07.612668 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.618902  1976 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.711956  1952 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.711747  1976 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:07.627115  1949 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.595s	user 0.002s	sys 0.005s
I20260709 12:25:07.627560  1982 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:07.628408 30896 raft_consensus.cc:2393] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:07.712613 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.712972  1973 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:07.477666  1925 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.713428  1810 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.605084  1761 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:07.671618  1849 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.714845  1957 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:07.715229  1957 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:07.715974  1976 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:07.713353 30896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:07.717090 30896 raft_consensus.cc:606] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.717427 30896 raft_consensus.cc:614] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:07.717645 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.615603  1944 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.719216 31587 leader_election.cc:400] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:25:07.719499 31587 leader_election.cc:403] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:07.720016  1810 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:07.720376  1810 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:07.720697  1810 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.695441 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.722144  1399 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.723383 30942 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.724222  1399 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.716420  1957 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.725441  1957 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.700071 31617 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.702999  1893 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.703761  1825 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:07.712347  1930 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:07.628618  1868 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:07.727032  1849 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:25:07.726982  1893 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.727988  1868 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.730010  1893 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:07.733330 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.733952 31045 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.714073  1949 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.714265  1973 consensus_queue.cc:1059] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:07.735973  1973 raft_consensus.cc:3055] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:07.736330  1973 raft_consensus.cc:740] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:07.737066  1973 consensus_queue.cc:260] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.738237  1973 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:07.739293 30892 raft_consensus.cc:1240] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:07.736363 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:07.741402 31045 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:07.741253 30892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb8d20fced0547649402e6668241468c"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:07.741591  1949 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:07.742265 30892 raft_consensus.cc:606] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:07.741348  1930 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.742650 30892 raft_consensus.cc:614] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:07.743217 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.744005  1930 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:07.745199  1930 raft_consensus.cc:697] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:07.746068  1930 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.746948 30892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c42f8452db3546feaba1bef22141480f"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:07.747339  1893 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:07.747507 30892 raft_consensus.cc:606] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:07.748207 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.750463 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:07.751860  1399 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:07.752125 31050 raft_consensus.cc:1240] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.752760  1399 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:07.753650 30892 raft_consensus.cc:614] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:07.755090 30867 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.755297 30864 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:07.755043 31587 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.755859 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.747912  1893 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.708145 30893 raft_consensus.cc:1240] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:07.764271 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:07.766332 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:07.766374 31050 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:07.769460 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.770239 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.770812 30972 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.771142 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.765215 30867 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.773543 30976 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:07.775063 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:07.766418 30864 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:07.778010 30939 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:07.779327 31619 raft_consensus.cc:2393] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:07.780586 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:07.742822 31622 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:07.783794  1993 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:07.785642  1993 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:07.771323  1627 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.771598  1919 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.787997 31047 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:07.788192  1399 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.779227  1920 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.790102  1801 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:07.790741  1893 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:07.791669 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:07.792011 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:07.792985 31049 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:07.779551 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:07.764485  1825 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.795547 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:07.796033 31617 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:07.799597 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.807018 31051 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:07.807986 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.808372 30967 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:25:07.809549 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.810077 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:07.810633 31050 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:07.811074  1810 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.812034 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:07.812774  1682 raft_consensus.cc:3055] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:07.813128  1682 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:07.813062  1810 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:07.814138 31046 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:07.813999  1682 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.765893  1949 consensus_queue.cc:1059] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:25:07.812178  1957 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.815546 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.808611 30973 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:07.800186 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:07.813464 31044 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:07.816200 30864 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.811959 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.817227 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:07.818890 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.795799  1906 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.815274  1682 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.822310 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.824031 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:07.828902 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.764760  1688 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.833637 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.815987  1992 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.834451 30976 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:07.836274 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:07.836495 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.836824 31044 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.838166 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:07.839854 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.816865  1920 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.820142  1973 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.852988 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.848567  1906 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.820838  1627 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.847360 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.823930  1919 raft_consensus.cc:697] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.854717 30973 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:07.853865 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.855342 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.825493  1801 consensus_queue.cc:1243] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer 5e9d2b069edc4166802ee0456ebcb706 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:07.856416 31046 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:07.859814 31045 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
W20260709 12:25:07.863634 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 351561us
I20260709 12:25:07.864564 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.865201 30899 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:07.865928 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.866657 30892 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:07.855624 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:07.868628 30898 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.833847  1944 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:07.835182  1941 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.876386 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.877152 31043 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:07.884173 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:07.885020 30893 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:07.886409 31016 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.787132  1993 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.887878 30973 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:07.888795 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:07.897558 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 98654.8us
W20260709 12:25:07.898767 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 51504.4us
I20260709 12:25:07.902021 30893 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:07.903839  1988 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:25:07.879920  1952 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.906666 30969 raft_consensus.cc:1240] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:07.907231 30972 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:07.907744 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:07.908306  1919 consensus_queue.cc:237] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:07.911162  1627 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.918339 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.919494 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:07.876309  1987 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.927711 31044 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
W20260709 12:25:07.928411 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.929116 31615 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:07.930495 31587 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.843078  1889 consensus_queue.cc:1059] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:25:07.932940 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.900219  1761 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:07.900336  1941 raft_consensus.cc:697] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.944248 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.953394 31588 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:07.897607  1944 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:07.950040  1399 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:07.951546 30898 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:07.961767 31047 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:07.930610  1767 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.964255 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:07.965745  1849 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:07.900068  1868 consensus_queue.cc:1059] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:25:07.940537  1893 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.955973  1825 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.969184 31050 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:07.970034 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 49832.4us
I20260709 12:25:07.960736  1841 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:07.966995 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 48757.3us
I20260709 12:25:07.976643 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:07.978773  1893 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.957926  1944 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:07.975060 30970 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.960001  1761 raft_consensus.cc:697] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:07.982604 31014 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:07.998225 31048 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:07.970175  1987 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.968873  1784 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.007516 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:08.010085 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:08.013507 31615 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:07.971329  1849 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:07.964310  1920 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.024802  1761 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.025727  1999 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:08.026646 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:07.965004  1399 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.027063 30898 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:08.028268 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:08.028824 31043 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:07.970010  1767 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.029142 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:08.096366 31045 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:08.028861  1979 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:08.030440  1977 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.034770  1816 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:08.038434 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.976075  1841 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:08.038599 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:08.039233 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:07.953075  1906 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.040376 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:08.041103 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:08.095566  1967 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:08.044462  1893 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:08.028228 31047 raft_consensus.cc:1240] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:08.029186 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 46654us
I20260709 12:25:08.092669 31044 raft_consensus.cc:2368] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:25:08.093475 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:08.093602  1810 consensus_queue.cc:1059] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:08.095580 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44569.5us
I20260709 12:25:08.096786 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:08.101688 30970 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.102144 30972 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:07.966462  1889 consensus_queue.cc:1059] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:08.020303  1976 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.101356 30976 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:08.103646 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 77077.3us
I20260709 12:25:08.048316  1784 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.100488  1401 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.097204  1688 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:08.176512 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:08.195209 31619 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:08.234098 31619 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:08.131301 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:08.153039 30939 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:08.241936 30973 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.242728 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:25:08.242744 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.172971 30901 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:08.132838 30898 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:08.100255  1977 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.182662 31013 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:08.249151 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 66568.6us
I20260709 12:25:08.101732  1952 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.101190  1941 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.257704  1893 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:08.258255  1893 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:08.258325  1750 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:08.260479 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:08.252905 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 99941.8us
W20260709 12:25:08.253647 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.253564 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:08.148248 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:08.256469  1825 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.262152 30898 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:08.259542  1893 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.103449  1999 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.254676  1910 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.130200  1816 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:08.254272  1977 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.232952  1976 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:08.263064 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 114920us
I20260709 12:25:08.151702  1767 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:08.270295 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:08.293805 31047 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:08.198372  1399 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:08.283418 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 186710us
I20260709 12:25:08.263312 30898 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:08.270557  1816 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:08.271617 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:08.276300  1976 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.281594 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2204) took 1110 ms. Trace:
I20260709 12:25:08.193869  1931 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:08.303391 31042 rpcz_store.cc:276] 0709 12:25:07.171399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.171536 (+   137us) service_pool.cc:224] Handling call
0709 12:25:07.173522 (+  1986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.320671 (+147149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.281291 (+960620us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001c8254. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:08.281513 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337048448}
I20260709 12:25:08.306655 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:08.312139 30970 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:08.146382  1949 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 12:25:08.194628  1997 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 12:25:08.194824  1984 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 12:25:08.316941 31050 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:08.263784  2007 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.276824  1810 raft_consensus.cc:3055] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:08.267309  1987 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:08.326920 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:08.330753 30973 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:08.301204  1947 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.301867  1688 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.254784  1401 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.327946 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:08.180112  1849 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:08.370999 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 127141us
I20260709 12:25:08.302855  1993 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:08.370105 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 416748us
W20260709 12:25:08.375216 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.376092 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 48224.4us
I20260709 12:25:08.376775 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:08.317641  1979 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.267199  1910 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.383073 30973 raft_consensus.cc:3055] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:08.386960 30973 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:08.385560 30865 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:08.332176  1902 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.383517 30898 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:08.389689 30894 raft_consensus.cc:2410] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:08.348224  1973 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.326221  1810 raft_consensus.cc:740] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:08.391913 30895 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:08.395300  2027 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.395852  2027 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.396550  1944 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.398221  2027 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:08.429179 30973 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:08.432370 30973 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.432735  1896 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.433342  1896 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:08.435882 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 119754us
I20260709 12:25:08.436712 31587 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:08.317085  1931 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:08.435479  1896 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:08.333684  1909 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:25:08.349721  1816 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:08.341244  1829 consensus_queue.cc:1059] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:25:08.439231 30900 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:08.386464  1952 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.386477  1950 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.460326  2023 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:08.342201  1992 consensus_queue.cc:1059] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:25:08.460273  1931 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:08.489827 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.517818 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 147136us
I20260709 12:25:08.378518  1688 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.392716  1973 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:08.652251 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 256896us
I20260709 12:25:08.652624 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:08.341398  2007 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:08.694077 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 303461us
I20260709 12:25:08.454097  1947 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.241s
I20260709 12:25:08.517531  1952 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:08.437659  1902 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:08.731674 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:09.136807 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1875) took 1097 ms. Trace:
W20260709 12:25:09.137413 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 1.13423e+06us
W20260709 12:25:09.138600 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 753040us
W20260709 12:25:09.093113 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 300284us
W20260709 12:25:09.096997 31587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.000s	sys 0.009s
W20260709 12:25:08.965471 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.139986 31624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.047s	sys 0.081s
W20260709 12:25:09.140277 31587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.000s	sys 0.009s
W20260709 12:25:08.928418 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 147741us
W20260709 12:25:09.141168 31624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.047s	sys 0.081s
W20260709 12:25:09.096758 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 365779us
W20260709 12:25:09.145900 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.137306 30894 rpcz_store.cc:276] 0709 12:25:08.039713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.256205 (+216492us) service_pool.cc:224] Handling call
0709 12:25:09.136607 (+880402us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400099054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:09.136748 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294728064}
I20260709 12:25:08.526582  1997 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:09.761049 30971 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:09.760795 31619 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:08.779098  2016 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:25:09.132750  1688 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.191919  1992 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:09.763098  1930 raft_consensus.cc:3055] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:09.763912  1399 raft_consensus.cc:3055] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:09.763693  1992 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.764345  1399 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
W20260709 12:25:09.714951  1906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.012s
I20260709 12:25:09.765367  1399 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:09.288233  2042 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.218906 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 80846.1us
I20260709 12:25:09.766678  2042 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:09.767695 31016 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:08.928225  1993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.004s	sys 0.046s
W20260709 12:25:09.708104 30940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.007s	sys 0.015s
I20260709 12:25:09.786041 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:08.697127  1973 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:09.055603  1979 consensus_meta.cc:287] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.002s
I20260709 12:25:09.602411  2027 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.588586  2028 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:09.769981 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:09.800416 31047 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:09.770146 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:09.147349  1952 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.288414  1902 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.771250 31046 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:09.125974  2007 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:09.553642  1999 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:09.349064  1998 log.cc:927] Time spent T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 1.081s	user 0.001s	sys 0.008s
I20260709 12:25:08.765506  1949 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.139760  1829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.011s
I20260709 12:25:09.216481  1816 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.320556 31588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.006s	sys 0.017s
W20260709 12:25:09.856228 31588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.016s	sys 0.031s
W20260709 12:25:09.772485 31013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.020s
W20260709 12:25:09.856966 31013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.009s	sys 0.020s
I20260709 12:25:09.773877  2031 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.551856  1303 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:08.972530  1825 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.444773  1977 consensus_meta.cc:287] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.169s	user 0.010s	sys 0.000s
I20260709 12:25:09.064782  1750 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.776525 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 637136us
I20260709 12:25:09.918880 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:09.776901  1957 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:09.439114  1976 consensus_meta.cc:287] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.039s	user 0.008s	sys 0.001s
I20260709 12:25:08.695472  1810 consensus_queue.cc:260] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.687450  1889 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:08.764490  2018 log.cc:927] Time spent T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
W20260709 12:25:09.732895 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.751919  1975 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:25:08.764739  1920 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.779300  1992 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.133226  1950 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.668s
W20260709 12:25:08.978324  2020 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.205s	user 0.000s	sys 0.002s
I20260709 12:25:09.780761 30895 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:09.775817 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 1.33906e+06us
I20260709 12:25:09.132085  2000 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.335500  1931 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:09.170823 30897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 604) took 1782 ms (client timeout 2074 ms). Trace:
I20260709 12:25:09.500979 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:09.454635 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2153) took 2184 ms. Trace:
I20260709 12:25:08.698045  2023 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.789252 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:09.853874  2028 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.513854  1801 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.246078  1963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.746s	user 0.005s	sys 0.023s
I20260709 12:25:09.802364 31623 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:08.788713  1925 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.984969  1963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.488s	user 0.018s	sys 0.046s
W20260709 12:25:08.807164  1893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.019s	sys 0.024s
I20260709 12:25:08.787681  1761 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.785615  1784 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.768770  2042 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:09.551174  1987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.162s	user 0.004s	sys 0.006s
I20260709 12:25:08.774984  1627 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.007539  1627 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:09.993785  1925 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.990418  2008 raft_consensus.cc:3055] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:10.009038  2008 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:10.010121  1925 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:10.009974  2008 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.098227  1682 raft_consensus.cc:3055] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:10.011134  1682 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:09.829807 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:09.809970 30973 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:10.013005 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:09.761997 31619 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:09.350366 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2160) took 1301 ms. Trace:
I20260709 12:25:09.243767  1984 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.288708  2026 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.016424  2026 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:09.834498 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 66873us
W20260709 12:25:09.513232  2017 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.733s	user 0.002s	sys 0.000s
I20260709 12:25:09.827750 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:10.019832 30976 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:09.538424  1982 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.021505  1982 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.763877  1930 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:09.916234  1977 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.024423  1930 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.025482  1930 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:09.231447  1401 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.585615  1912 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:09.481994  1919 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:10.028285  2040 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.028769  1919 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.950789  1889 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.225239  1767 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.032256  1889 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:09.789261  1909 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.686388  2025 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:10.032953  1909 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.033046  2025 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.034993  1909 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.245086  1896 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.910406  2031 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.346112  2038 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.515699  2032 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:09.793406  1944 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.994907  2028 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:09.638863  1941 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.865144 30972 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:10.095391  1950 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:09.732946  2036 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.288578  1910 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.784572  1993 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:09.772029  2043 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.853273  1904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.587s	user 0.014s	sys 0.024s
W20260709 12:25:09.890530 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.807492  1979 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.878638  1688 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.137415 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:09.912731 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:09.886648  2047 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:09.887117  1999 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:09.844928  2027 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.907181  1829 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.890758  1399 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.802771  1997 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.159888 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:09.878633  1949 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.878921  1816 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.926708  1957 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:09.793504 31050 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.978971 30901 rpcz_store.cc:276] 0709 12:25:07.270540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.281965 (+ 11425us) service_pool.cc:224] Handling call
0709 12:25:07.282259 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.243762 (+961503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.454375 (+1210613us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54003edad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:09.454569 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047785856}
W20260709 12:25:10.209177 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.210925 30898 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:09.771612  1841 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:09.978186 30897 rpcz_store.cc:269] 0709 12:25:07.355276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.380784 (+ 25508us) service_pool.cc:224] Handling call
0709 12:25:09.079591 (+1698807us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54003eadd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:09.137901 (+ 58310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472826240}
I20260709 12:25:09.982904 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:09.984833  1992 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:09.989504  2030 log.cc:927] Time spent T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:25:09.990013  2046 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:09.990486  2023 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.990974  2041 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.990648  1931 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.991348  2033 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.927321  1750 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:09.993501 31623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 902) took 2085 ms (client timeout 2385 ms). Trace:
W20260709 12:25:10.274081 31623 rpcz_store.cc:269] 0709 12:25:07.899857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.900595 (+   738us) service_pool.cc:224] Handling call
0709 12:25:09.456511 (+1555916us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:25:09.985195 (+528684us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43323264}
I20260709 12:25:09.916477  1825 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.281857  1825 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.282130 31049 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.284198 31618 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.916388  1303 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.930756  1976 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.000669 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2204) took 2186 ms. Trace:
W20260709 12:25:10.002382  1987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.615s	user 0.005s	sys 0.007s
I20260709 12:25:10.006088  1761 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.288424  1987 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:10.289333  1987 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.289824  1761 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:10.006867  2042 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:10.290563  2042 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.286844 30967 rpcz_store.cc:276] 0709 12:25:07.816384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.819993 (+  3609us) service_pool.cc:224] Handling call
0709 12:25:07.831378 (+ 11385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.846803 (+ 15425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.846834 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.852077 (+  5243us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.948005 (+ 95928us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:07.948043 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.948109 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.348301 (+1400192us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:09.982911 (+634610us) raft_consensus.cc:1685] finished
0709 12:25:09.982935 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.995849 (+ 12914us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2830,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":18284,"spinlock_wait_cycles":27898112,"thread_start_us":95551,"threads_started":1,"wal-append.queue_time_us":415925}
I20260709 12:25:10.293213  2042 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:09.998164  1893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.731s	user 0.028s	sys 0.078s
I20260709 12:25:09.990883  1801 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.295692  1801 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:09.766000  1906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.004s	sys 0.012s
I20260709 12:25:10.018926  1984 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.298144  1984 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:10.298740 30893 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.032018  1767 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:09.967068  1920 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:09.990845  2045 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:25:09.983562  1810 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.992758  2057 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:25:09.245786  1897 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:10.333384  1897 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.037328  2026 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:10.335783  1816 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.035683  2025 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:09.992817  2044 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:09.991803  2053 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.991945  2037 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.992887  2034 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:10.036017  1896 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:09.992969  2048 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.994184  1963 raft_consensus.cc:697] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:10.020974 30976 raft_consensus.cc:3055] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.028333  1401 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:25:10.088745 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 169848us
I20260709 12:25:10.015900 30900 rpcz_store.cc:276] 0709 12:25:08.049103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.266828 (+217725us) service_pool.cc:224] Handling call
0709 12:25:08.268456 (+  1628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.515791 (+247335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.350076 (+834285us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540014aad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:09.350276 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374032640}
W20260709 12:25:10.056668 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 125073us
I20260709 12:25:10.031564  1919 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.038407  2038 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.091401  1985 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.864156 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 623) took 2082 ms. Trace:
I20260709 12:25:10.039294  2029 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.038784  2032 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.039000  1944 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.038123  2031 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.099565  1947 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.106633 31619 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:10.104178 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.138049 31621 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:25:10.104625 30939 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.722s (SENT) [suppressed 25 similar messages]
W20260709 12:25:10.146910 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.089742  1982 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:10.137221  1904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.871s	user 0.015s	sys 0.025s
I20260709 12:25:10.156508 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:10.038100  1889 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:10.090234  1925 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:10.160137 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 187809us
I20260709 12:25:10.097882  1912 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.096690  1941 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.216271  1841 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:10.159696  1868 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.159940  1784 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.217535 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.159487  2028 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:10.151392  2047 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:10.216585  2000 consensus_queue.cc:1175] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1a7b44e2d0ed440985e5f643a5a54587" responder_term: 10 status { last_received { term: 7 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: [9.8-9.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:10.207870  1902 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:10.151736  1688 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.221738 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.224647 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:10.225951  2052 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.226689 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:10.227362  2067 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.231871  1995 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:10.136325  1950 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.159456  1979 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.160451  1829 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.247166  1957 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.240198  2066 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:10.147526  2043 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.244473  1993 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.135080  2036 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.236706  1992 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.276557  1952 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.277177  2041 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.277743  1682 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.278327 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:10.278625 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:10.279099  1786 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.279471  1931 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.279681 30896 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:25:10.280040 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.284812 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 626) took 1138 ms. Trace:
I20260709 12:25:10.284724 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:10.286255 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:10.313185 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.321087  2027 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.321877 31043 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:10.322253  1920 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.322750  1750 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.285243  2033 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.285352  1973 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.289736  1976 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:10.327906 30894 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:10.328025  2049 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:10.154356  1999 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.946722  1868 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.947507  1925 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.948933  1992 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:10.430274 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:10.949820 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.951449  2047 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.333303  1949 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.952265  2031 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.952677  1963 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.953050  2031 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.953986  2044 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.957715 30973 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:10.958703  1941 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.959908  2032 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.960852 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.960675  1889 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.961848 30895 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 4.
I20260709 12:25:10.964318 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.965232 31616 raft_consensus.cc:2410] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:10.966035 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.966648  1784 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.967424  1947 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:10.967891  1985 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.224684  1931 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:11.225214  1931 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.226115  1985 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:10.335649  1897 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.226943 31044 raft_consensus.cc:1240] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:11.227144  1931 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.227994  1303 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.228736 31048 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:11.228910 31051 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:10.968189  2029 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.229813  1784 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:10.969110  1802 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:25:11.231753  2029 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.415437 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 906) took 2160 ms. Trace:
I20260709 12:25:11.232554 31624 rpcz_store.cc:276] 0709 12:25:08.251381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.251625 (+   244us) service_pool.cc:224] Handling call
0709 12:25:08.260181 (+  8556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.282684 (+ 22503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.282715 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.313921 (+ 31206us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.141614 (+827693us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:09.141652 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.141724 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.411248 (+1269524us) raft_consensus.cc:1685] finished
0709 12:25:10.411268 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.411391 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33417,"raft.queue_time_us":32331,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":20344,"thread_start_us":766383,"threads_started":1,"wal-append.queue_time_us":1459381}
I20260709 12:25:11.234117  2068 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.970255  1995 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.234643  2068 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.971024  2038 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:10.560585 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 290403us
I20260709 12:25:11.236303  1995 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.234377 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.237497 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 913) took 1082 ms. Trace:
W20260709 12:25:10.973227 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.973428 30896 pending_rounds.cc:85] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 7
I20260709 12:25:11.238059 30896 pending_rounds.cc:107] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 9.8
W20260709 12:25:11.238270 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.418406 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:10.974244 30901 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:11.238444 30896 raft_consensus.cc:2889] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:11.238521 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.976382 31623 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:10.966104 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.967159 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:11.239194 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.238830 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1882) took 1454 ms. Trace:
I20260709 12:25:10.978317 31049 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.237906 31624 rpcz_store.cc:276] 0709 12:25:10.155137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.234139 (+1079002us) service_pool.cc:224] Handling call
0709 12:25:11.237419 (+  3280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:10.408174 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.434358 30893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 613) took 2423 ms. Trace:
W20260709 12:25:10.976687 31014 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.007s	sys 0.014s
I20260709 12:25:10.345781 31618 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:10.972801 30976 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:11.239882 31616 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:25:11.242688 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1095) took 1029 ms. Trace:
I20260709 12:25:11.239684 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:10.972615 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:10.955458  2031 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.237674  2068 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.963056  1889 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.949920  1925 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.243848 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1097) took 1027 ms. Trace:
I20260709 12:25:10.983960 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1078) took 3153 ms. Trace:
I20260709 12:25:11.240146 31621 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:10.946238 30975 rpcz_store.cc:276] 0709 12:25:07.769623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.770442 (+   819us) service_pool.cc:224] Handling call
0709 12:25:08.269025 (+498583us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800190598. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508eee 000000000036eb39 00007f033557c1e0 00007f03356450c4 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:25:08.269157 (+   132us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:08.317388 (+ 48231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.317417 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:08.331853 (+ 14436us) log.cc:844] Serialized 52 byte log entry
0709 12:25:08.751223 (+419370us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:08.751273 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.751338 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.823950 (+1072612us) raft_consensus.cc:1685] finished
0709 12:25:09.823975 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.851947 (+ 27972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40130,"raft.queue_time_us":55853,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":32330,"spinlock_wait_cycles":2604288,"thread_start_us":348841,"threads_started":1,"wal-append.queue_time_us":1386992,"wal-append.run_cpu_time_us":1949,"wal-append.run_wall_time_us":1085839}
I20260709 12:25:11.243132 31616 rpcz_store.cc:276] 0709 12:25:10.213844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.966941 (+753097us) service_pool.cc:224] Handling call
0709 12:25:11.242637 (+275696us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.245286 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.245450 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.246006 31616 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 5.
I20260709 12:25:11.246449 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.246711  1977 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.246979 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.244220 31622 rpcz_store.cc:276] 0709 12:25:10.216364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.972413 (+756049us) service_pool.cc:224] Handling call
0709 12:25:11.243793 (+271380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.248155 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.241931  1952 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.435642  2008 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:10.973562  1987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.004s	sys 0.010s
I20260709 12:25:11.240995 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:11.250438  1987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.005s	sys 0.010s
I20260709 12:25:11.250741 31049 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:11.249738 30975 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:11.251605 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.251757 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.252166 31049 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:11.252528 30975 raft_consensus.cc:2410] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:11.253157 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.253626 30975 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:11.086436 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.087343 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.254757 30897 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
W20260709 12:25:11.086139 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 981477us
I20260709 12:25:10.962915  1912 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.336544  1997 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.511186  1767 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.957145  1950 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:10.999209  2044 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:11.244517 31619 rpcz_store.cc:276] 0709 12:25:07.830579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.835117 (+  4538us) service_pool.cc:224] Handling call
0709 12:25:07.852419 (+ 17302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.195109 (+342690us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b54004c07a0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305a4dc0 00007f033062f1c0 00007f0330630231 00007f033062cd8f 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c
0709 12:25:09.356631 (+1161522us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b54004c07a0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305ab06f 00007f0330623f60 00007f03306257de 00007f033062fb49 00007f0330630416 00007f033062cd8f 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62
0709 12:25:10.968942 (+1612311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.983899 (+ 14957us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196102784}
I20260709 12:25:10.995456  1902 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.257074 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.249814 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.258049 31050 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.258337 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.258893 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:10.957180  1944 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.259881 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1084) took 1102 ms. Trace:
I20260709 12:25:10.994618  1786 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.993827  2049 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.946738  1979 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.260453  1950 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:11.262073  2049 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.263902  1786 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.994760  2028 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.969488  2037 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.995275  2052 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.271777  2052 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.272209  1303 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.204720  2048 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.207139  2036 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.208542  1868 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.209682  1896 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:11.215881 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:11.274459  2048 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.967499  2053 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.529001  1627 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.210098  1973 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.211324  2041 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.276404  2053 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:11.276839 30864 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:11.277029 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1090) took 1118 ms. Trace:
I20260709 12:25:11.212499 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:11.213193  1999 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.214708  2043 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.215436 31615 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:10.976018 31046 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:11.243306 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.216308  2032 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.218228 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.218724 30967 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:11.282018 30898 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:25:11.260227 31619 rpcz_store.cc:276] 0709 12:25:10.157018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.259139 (+1102121us) service_pool.cc:224] Handling call
0709 12:25:11.259399 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.259564 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.259588 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.259638 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:11.259668 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.259736 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.259832 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.286068 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1891) took 1376 ms. Trace:
I20260709 12:25:11.286396 31045 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:11.220988  1688 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.425851  1816 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:11.280007  1303 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.294728  1816 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.295327 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2210) took 1014 ms. Trace:
I20260709 12:25:11.295693 31045 rpcz_store.cc:276] 0709 12:25:10.280576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.280698 (+   122us) service_pool.cc:224] Handling call
0709 12:25:11.286172 (+1005474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.286747 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.295137 (+  8390us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400420c50. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.295268 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311689088}
I20260709 12:25:11.222555  1682 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:10.947084 31047 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.296973 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2208) took 1018 ms. Trace:
I20260709 12:25:10.514797  1980 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.231001  1829 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.229617  1957 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:10.977667 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:11.242635 30976 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:10.959376 30969 rpcz_store.cc:276] 0709 12:25:09.146202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.146323 (+   121us) service_pool.cc:224] Handling call
0709 12:25:09.220742 (+ 74419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.764843 (+544101us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:09.859977 (+ 95134us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.207316 (+347339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.207370 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:10.207412 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.284606 (+ 77194us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400247054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:10.284648 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.284759 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5228,"prepare.queue_time_us":166368,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":62998,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14377,"spinlock_wait_cycles":1250868608,"thread_start_us":372281,"threads_started":2,"wal-append.queue_time_us":454379}
I20260709 12:25:10.404138 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1876) took 2251 ms. Trace:
I20260709 12:25:10.946470  2034 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.249192 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.073633 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.239916 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1083) took 1083 ms. Trace:
I20260709 12:25:11.264537 31043 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:11.241824 30893 rpcz_store.cc:276] 0709 12:25:08.010538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.010690 (+   152us) service_pool.cc:224] Handling call
0709 12:25:08.056155 (+ 45465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.299161 (+2243006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.434095 (+134934us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b540009b354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:10.434294 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5157107968}
I20260709 12:25:11.267385  1979 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:11.253822 31049 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 5: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.268751 30968 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:11.269179  1902 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:10.994946  2067 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.270066  2037 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.272375 31620 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:11.277405 31621 rpcz_store.cc:276] 0709 12:25:10.158470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.965891 (+807421us) service_pool.cc:224] Handling call
0709 12:25:11.276972 (+311081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11136}
W20260709 12:25:11.094384 31042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.005s	sys 0.009s
W20260709 12:25:11.065590 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.250450 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2170) took 1468 ms. Trace:
W20260709 12:25:11.276317 30942 connection.cc:256] RPC call timeout handler was delayed by -1.2064936299998408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 12:25:11.277487  1627 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.279466  1897 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:11.272305 30799 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:11.249677 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1892) took 1316 ms. Trace:
I20260709 12:25:11.296897 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.297320 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2169) took 1515 ms. Trace:
W20260709 12:25:11.303259 30795 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53570 (request call id 373) took 13710 ms (client timeout 15000 ms). Trace:
I20260709 12:25:11.299820 31616 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:11.305632 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 611) took 3866 ms. Trace:
I20260709 12:25:11.325186 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1085) took 1168 ms. Trace:
I20260709 12:25:11.311002 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1884) took 1358 ms. Trace:
I20260709 12:25:11.307042 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 912) took 1154 ms. Trace:
I20260709 12:25:11.281543 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2207) took 1003 ms. Trace:
I20260709 12:25:10.430058  1849 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.331792 31622 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:11.331760  1849 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.332408 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1086) took 1174 ms. Trace:
I20260709 12:25:11.332731 31622 rpcz_store.cc:276] 0709 12:25:10.157558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.322263 (+1164705us) service_pool.cc:224] Handling call
0709 12:25:11.331461 (+  9198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.332181 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.332358 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.333683 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.334522  1849 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.334666 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:11.326853 31046 rpcz_store.cc:276] 0709 12:25:10.277966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.278081 (+   115us) service_pool.cc:224] Handling call
0709 12:25:11.281488 (+1003407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.321563 30973 rpcz_store.cc:276] 0709 12:25:09.933057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.012748 (+ 79691us) service_pool.cc:224] Handling call
0709 12:25:11.249505 (+1236757us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540016c1d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.249600 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171279616}
W20260709 12:25:11.241972 31014 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.007s	sys 0.015s
I20260709 12:25:11.325275 30896 rpcz_store.cc:276] 0709 12:25:07.439062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.718454 (+279392us) service_pool.cc:224] Handling call
0709 12:25:09.137649 (+1419195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.238935 (+2101286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.289925 (+ 50990us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003eadd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.305435 (+ 15510us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003eadd0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.305563 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5888925696}
W20260709 12:25:11.335821 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 1.06419e+06us
I20260709 12:25:11.297318 31047 rpcz_store.cc:276] 0709 12:25:10.278271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.278394 (+   123us) service_pool.cc:224] Handling call
0709 12:25:11.296920 (+1018526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.336285 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.336834 30896 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:11.336942 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.240247 30901 rpcz_store.cc:276] 0709 12:25:09.784415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.226437 (+442022us) service_pool.cc:224] Handling call
0709 12:25:11.238766 (+1012329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.287066 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2225) took 1515 ms. Trace:
W20260709 12:25:11.288301 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 43706.4us
I20260709 12:25:11.322288 30895 rpcz_store.cc:276] 0709 12:25:09.781727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.979360 (+197633us) service_pool.cc:224] Handling call
0709 12:25:11.250299 (+1270939us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540009a954. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.250391 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716614016}
I20260709 12:25:11.338583 30867 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:11.289022 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.289495 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2209) took 1011 ms. Trace:
I20260709 12:25:11.289520 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2214) took 1005 ms. Trace:
I20260709 12:25:11.284521 30974 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:11.339546 31050 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.240876 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:11.291126 30894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1881) took 1701 ms (client timeout 1732 ms). Trace:
I20260709 12:25:11.340466 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1096) took 1124 ms. Trace:
I20260709 12:25:11.322968 30892 rpcz_store.cc:276] 0709 12:25:08.152451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.282318 (+129867us) service_pool.cc:224] Handling call
0709 12:25:08.302468 (+ 20150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.318420 (+ 15952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.318449 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.318943 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.503270 (+1184327us) spinlock_profiling.cc:243] Waited 1e+03 us on lock 0x7b180041aca0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:25:10.147064 (+643794us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:10.207195 (+ 60131us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.207712 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.208156 (+   444us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.402158 (+194002us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b180041aca0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:25:10.403846 (+  1688us) raft_consensus.cc:1685] finished
0709 12:25:10.403869 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.404048 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20621,"prepare.queue_time_us":101756,"prepare.run_cpu_time_us":1534,"prepare.run_wall_time_us":21747,"raft.queue_time_us":14589,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":18522,"spinlock_wait_cycles":40336512,"thread_start_us":410322,"threads_started":2,"wal-append.queue_time_us":1898731}
W20260709 12:25:11.340775 30894 rpcz_store.cc:269] 0709 12:25:09.589894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.788970 (+199076us) service_pool.cc:224] Handling call
0709 12:25:11.290966 (+1501996us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54000320d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.291066 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800495360}
I20260709 12:25:11.341008 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1886) took 1250 ms. Trace:
W20260709 12:25:11.290227 31618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 899) took 3411 ms (client timeout 1804 ms). Trace:
I20260709 12:25:11.342926 30895 rpcz_store.cc:276] 0709 12:25:10.090952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.338747 (+1247795us) service_pool.cc:224] Handling call
0709 12:25:11.340569 (+  1822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.340725 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.340748 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.340786 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:11.340817 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.340865 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.340952 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.323498 31623 rpcz_store.cc:276] 0709 12:25:10.156724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.279810 (+123086us) service_pool.cc:224] Handling call
0709 12:25:11.239852 (+960042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.321705 30900 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:25:11.326802 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.344743 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1888) took 1208 ms. Trace:
I20260709 12:25:11.345081 30900 rpcz_store.cc:276] 0709 12:25:10.136092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.073288 (+937196us) service_pool.cc:224] Handling call
0709 12:25:11.344685 (+271397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.323786 31621 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:11.326350 31042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.007s	sys 0.012s
I20260709 12:25:11.323282 30976 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.298388 31615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 911) took 1150 ms. Trace:
I20260709 12:25:11.346484 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.329924 30898 rpcz_store.cc:276] 0709 12:25:09.952192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.309747 (+1357555us) service_pool.cc:224] Handling call
0709 12:25:11.310073 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.310691 (+   618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.310718 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.310762 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:11.310796 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.310849 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.310946 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92}
I20260709 12:25:11.347105 30973 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:11.325713 31616 rpcz_store.cc:276] 0709 12:25:10.157267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.299181 (+1141914us) service_pool.cc:224] Handling call
0709 12:25:11.299487 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.324959 (+ 25472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.325138 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.286597 30972 rpcz_store.cc:276] 0709 12:25:09.910073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.105358 (+195285us) service_pool.cc:224] Handling call
0709 12:25:10.147356 (+ 41998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.947670 (+800314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.947699 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.947772 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:10.947802 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.285868 (+338066us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54001e64d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.285911 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.286020 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1840154496}
I20260709 12:25:11.337631 31048 rpcz_store.cc:276] 0709 12:25:09.771915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.772043 (+   128us) service_pool.cc:224] Handling call
0709 12:25:09.772337 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.229073 (+1456736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.286048 (+ 56975us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400420c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.287010 (+   962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2948875520}
I20260709 12:25:11.329034 31617 rpcz_store.cc:276] 0709 12:25:10.152512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.152644 (+   132us) service_pool.cc:224] Handling call
0709 12:25:10.162747 (+ 10103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.215116 (+1052369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.215148 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.215192 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:11.215260 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.306798 (+ 91538us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540065dbd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.306845 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.306967 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":247210,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":1841792256,"thread_start_us":56839,"threads_started":1}
W20260709 12:25:11.280609 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 68176.3us
I20260709 12:25:11.339313 31622 raft_consensus.cc:2376] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10. Re-sending same reply.
W20260709 12:25:11.343874 31618 rpcz_store.cc:269] 0709 12:25:07.878539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.887595 (+  9056us) service_pool.cc:224] Handling call
0709 12:25:09.500815 (+1613220us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:25:11.290075 (+1789260us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54005e33d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.290165 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716397056}
I20260709 12:25:11.340401 31624 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:11.334980 30799 catalog_manager.cc:5697] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 3 to 8, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 8 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.346083 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1087) took 1188 ms. Trace:
I20260709 12:25:11.342267 31051 rpcz_store.cc:276] 0709 12:25:10.284377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.284485 (+   108us) service_pool.cc:224] Handling call
0709 12:25:11.289347 (+1004862us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400159fd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.289467 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572758784}
I20260709 12:25:11.350054 31621 rpcz_store.cc:276] 0709 12:25:10.157779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.323211 (+1165432us) service_pool.cc:224] Handling call
0709 12:25:11.323484 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.345858 (+ 22374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.346034 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.350922 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.351512 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1093) took 1192 ms. Trace:
I20260709 12:25:11.340852 31620 rpcz_store.cc:276] 0709 12:25:10.216058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.960585 (+744527us) service_pool.cc:224] Handling call
0709 12:25:11.340322 (+379737us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54005fee54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.340410 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714892544}
I20260709 12:25:11.351941 31621 rpcz_store.cc:276] 0709 12:25:10.159152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.350812 (+1191660us) service_pool.cc:224] Handling call
0709 12:25:11.351081 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.351242 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.351264 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.351305 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:11.351334 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.351379 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.351465 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.339357 31044 rpcz_store.cc:276] 0709 12:25:10.278594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.279865 (+  1271us) service_pool.cc:224] Handling call
0709 12:25:10.280192 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.227325 (+947133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.289279 (+ 61954us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54000ae1d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.289445 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176762112}
I20260709 12:25:11.351624 31051 raft_consensus.cc:2393] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.353325 31621 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:11.346812 31615 rpcz_store.cc:276] 0709 12:25:10.147939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.148067 (+   128us) service_pool.cc:224] Handling call
0709 12:25:11.298212 (+1150145us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54006bd5d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.298334 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327987456}
I20260709 12:25:11.354429 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:11.322852  1897 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.323416 30899 rpcz_store.cc:276] 0709 12:25:09.781449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.781593 (+   144us) service_pool.cc:224] Handling call
0709 12:25:09.801860 (+ 20267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:10.956254 (+1154394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.956296 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:10.956703 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.020502 (+ 63799us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:11.020546 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.284878 (+264332us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400098654. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.284923 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.284967 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:11.284980 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.297256 (+ 12276us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2998,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":2654125312,"thread_start_us":63369,"threads_started":1,"wal-append.queue_time_us":275071}
I20260709 12:25:11.356462 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.356735 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1092) took 1197 ms. Trace:
I20260709 12:25:11.357156 31624 rpcz_store.cc:276] 0709 12:25:10.158906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.349805 (+1190899us) service_pool.cc:224] Handling call
0709 12:25:11.356328 (+  6523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.356475 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.356499 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.356532 (+    33us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:11.356560 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.356606 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.356688 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.358522 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.357774 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.359280 31623 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:11.284407  2039 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.285637  1750 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.363873 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 914) took 1205 ms. Trace:
I20260709 12:25:11.362995 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2219) took 1598 ms. Trace:
I20260709 12:25:11.364568 31615 raft_consensus.cc:1240] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:11.358546 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.359356 30893 raft_consensus.cc:2393] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:11.366719 30895 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:11.361539  1897 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.335619  1816 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.362416  2067 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.399608 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.400118 30864 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:11.363379 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 915) took 1193 ms. Trace:
I20260709 12:25:11.405126 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.406229 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.407178 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.367700 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.362871 30799 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:11.409036 30799 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.396296 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:11.374827 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.375425 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.379171 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.395629 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.417939 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:11.397718 31048 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:11.420158 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2215) took 1134 ms. Trace:
I20260709 12:25:11.420472 31048 rpcz_store.cc:276] 0709 12:25:10.285523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.397278 (+1111755us) service_pool.cc:224] Handling call
0709 12:25:11.397546 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.419925 (+ 22379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.420104 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.399029 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.421499 31620 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:25:11.423334 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 445702us
I20260709 12:25:11.424026 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1089) took 1265 ms. Trace:
I20260709 12:25:11.401433 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.426918 31043 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:11.401986 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:11.395474 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.358148  1947 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.356400  2037 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.413853 31047 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:11.413702  2076 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:11.404469 31621 rpcz_store.cc:276] 0709 12:25:10.161104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.352814 (+1191710us) service_pool.cc:224] Handling call
0709 12:25:11.353051 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.353825 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.353978 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.376778  2031 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:11.403921  2081 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:11.407640 31615 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:11.339881  1980 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.445135 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.396958 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1883) took 1448 ms. Trace:
I20260709 12:25:11.418198 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.407678 31624 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:11.445109 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.400954 31044 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:11.446897 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2217) took 1160 ms. Trace:
I20260709 12:25:11.424780 31619 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:11.447768 31619 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:11.448076 30976 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:11.323552 30795 rpcz_store.cc:269] 0709 12:24:57.592664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.592881 (+   217us) service_pool.cc:224] Handling call
0709 12:25:11.303170 (+13710289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:07.500108 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:07.589518 (+ 89410us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:07.589568 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:25:07.589587 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:07.590660 (+  1073us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:07.590736 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:07.590889 (+   153us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:25:07.656501 (+ 65612us) tablet.cc:701] Row locks acquired
0709 12:25:07.656552 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:25:07.656719 (+   167us) write_op.cc:270] Start()
0709 12:25:07.656872 (+   153us) write_op.cc:276] Timestamp: P: 1783599907656655 usec, L: 0
0709 12:25:07.656892 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:25:07.657754 (+   862us) log.cc:844] Serialized 4343 byte log entry
0709 12:25:07.957920 (+300166us) op_driver.cc:464] REPLICATION: finished
0709 12:25:08.519005 (+561085us) write_op.cc:301] APPLY: starting
0709 12:25:08.693699 (+174694us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:08.969860 (+276161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:08.989987 (+ 20127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:09.011194 (+ 21207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:09.011689 (+   495us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:25:09.011758 (+    69us) write_op.cc:312] APPLY: finished
0709 12:25:09.012156 (+   398us) log.cc:844] Serialized 83 byte log entry
0709 12:25:09.348075 (+335919us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:09.348228 (+   153us) write_op.cc:454] Released schema lock
0709 12:25:09.348290 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:09.348767 (+   477us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:09.348797 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1089,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":426376,"apply.run_cpu_time_us":23069,"apply.run_wall_time_us":894611,"num_ops":11,"prepare.queue_time_us":265996,"prepare.run_cpu_time_us":14252,"prepare.run_wall_time_us":306667,"raft.queue_time_us":171099,"raft.run_cpu_time_us":44136,"raft.run_wall_time_us":334389,"replication_time_us":300864,"thread_start_us":1030776,"threads_started":5,"wal-append.queue_time_us":959745,"wal-append.run_cpu_time_us":18484,"wal-append.run_wall_time_us":2533722}]]}
I20260709 12:25:11.424510 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:11.314000  2028 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.425522 31051 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:11.427683 30969 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.447258 31044 rpcz_store.cc:276] 0709 12:25:10.285993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.400498 (+1114505us) service_pool.cc:224] Handling call
0709 12:25:11.400789 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.446680 (+ 45891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.446846 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.428049 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.449179 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2218) took 1162 ms. Trace:
I20260709 12:25:11.449872 31617 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:11.449864 31051 rpcz_store.cc:276] 0709 12:25:10.287098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.410863 (+1123765us) service_pool.cc:224] Handling call
0709 12:25:11.415699 (+  4836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.448933 (+ 33234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.449125 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:11.429422 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 75072.5us
I20260709 12:25:11.430104 31622 rpcz_store.cc:276] 0709 12:25:10.158232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.355823 (+1197591us) service_pool.cc:224] Handling call
0709 12:25:11.423500 (+ 67677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.423668 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.423690 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.423797 (+   107us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:11.423834 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.423886 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.423973 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.440325  2041 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.445818 30974 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
W20260709 12:25:11.433117 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1454920579999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 12:25:11.455394 30864 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:11.456830 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.457397 30939 connection.cc:256] RPC call timeout handler was delayed by -1.0969764360002046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2358s for a response
I20260709 12:25:11.455922 30865 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:11.431661 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:11.378064  1902 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:11.461440 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:11.437824 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2219) took 1145 ms. Trace:
I20260709 12:25:11.461644 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.461926 31047 rpcz_store.cc:276] 0709 12:25:10.287354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.413277 (+1125923us) service_pool.cc:224] Handling call
0709 12:25:11.413546 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.432726 (+ 19180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.432904 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.430950  1979 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.462469 30895 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.363597  1849 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:11.463408 31051 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:11.465935 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.466511 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.425706  1816 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.364437 31042 rpcz_store.cc:276] 0709 12:25:09.764550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.764681 (+   131us) service_pool.cc:224] Handling call
0709 12:25:09.765022 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:10.088181 (+323159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.088211 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:10.092465 (+  4254us) log.cc:844] Serialized 52 byte log entry
0709 12:25:10.407742 (+315277us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b1800344aa0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:25:11.346067 (+938325us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:11.346105 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.362722 (+ 16617us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540015a4d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.362765 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.362803 (+    38us) raft_consensus.cc:1685] finished
0709 12:25:11.362815 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.362945 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80519,"raft.queue_time_us":61744,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4068,"spinlock_wait_cycles":619680384,"thread_start_us":938155,"threads_started":1,"wal-append.queue_time_us":1128941}
I20260709 12:25:11.448608 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1889) took 1592 ms. Trace:
I20260709 12:25:11.427809 31616 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:11.432291 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.447376 30897 rpcz_store.cc:276] 0709 12:25:09.948304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.255359 (+1307055us) service_pool.cc:224] Handling call
0709 12:25:11.255647 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.363917 (+108270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.363945 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.363982 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:11.364010 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.396745 (+ 32735us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400149bd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.396790 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.396906 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248613632}
I20260709 12:25:11.467626 30976 rpcz_store.cc:276] 0709 12:25:09.856418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.020509 (+164091us) service_pool.cc:224] Handling call
0709 12:25:10.020818 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.448408 (+1427590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.448562 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:11.468596 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.437476  2076 consensus_queue.cc:1243] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 9f38f761eded4f28b9d802f6570ee71e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:11.457635 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.464278 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:11.472826 31047 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.297569  2032 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.459468 31587 leader_election.cc:400] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:25:11.455374  1980 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.471410 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.476218 31046 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.475072 31587 leader_election.cc:403] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.430640  1944 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:25:11.479753 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:11.440661  1303 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.365134 31618 rpcz_store.cc:276] 0709 12:25:10.158819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.349062 (+1190243us) service_pool.cc:224] Handling call
0709 12:25:11.349341 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.363516 (+ 14175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.363543 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.363581 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:11.363610 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.363667 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.363823 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13868,"raft.queue_time_us":14803}
I20260709 12:25:11.481657  2043 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.416472  2039 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.482312 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1885) took 1411 ms. Trace:
I20260709 12:25:11.482709 30901 rpcz_store.cc:276] 0709 12:25:10.071423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.338229 (+1266806us) service_pool.cc:224] Handling call
0709 12:25:11.365041 (+ 26812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.431452 (+ 66411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.431637 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.431682 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:11.431743 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.482102 (+ 50359us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b54003ec6d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.482147 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.482258 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152311168}
I20260709 12:25:11.484045 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.484769 31042 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:11.485060  2039 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.438922  2037 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.485664 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1890) took 1607 ms. Trace:
I20260709 12:25:11.486032 30968 rpcz_store.cc:276] 0709 12:25:09.889386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.890356 (+   970us) service_pool.cc:224] Handling call
0709 12:25:11.485486 (+1595130us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540016bcd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.485611 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2598728448}
I20260709 12:25:11.486822  2037 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.456646  2000 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:25:11.488009  2000 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:11.488142 30799 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 6, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 6 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.489207 31617 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.490590 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.490108 30799 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 6, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 6 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.456517  1829 consensus_queue.cc:1059] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:25:11.491173 31624 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:11.475035 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.475055  1849 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:11.465654  2028 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:25:11.438759  1802 consensus_queue.cc:1059] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:25:11.474098 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:11.441929 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.576817 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.485594  2039 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:25:11.574306 31049 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:11.511761 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.554713  2037 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:11.579873 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.579756 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.580786  2039 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:11.580533  2037 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.581080 31046 raft_consensus.cc:2393] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:11.581144  2039 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:11.578274 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.491650 30799 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 6, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 6 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.513639  1897 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.582180  2039 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.581178 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.583551 31045 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:11.584031  1897 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.577893 31047 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:11.584785 30976 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:11.584837  1849 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.525323  2043 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7.
I20260709 12:25:11.498894 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.586254 31617 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:11.510540  2032 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.472100 30972 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 5.
I20260709 12:25:11.502508 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.502394 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.587978 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:11.588410 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.588615 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.588995 31617 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:11.589615  2041 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:11.586292 30974 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:11.461689  1902 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.590960 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.590622  1902 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.591965 31014 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:11.591985 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.592692  2081 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:11.593067  2081 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.593210 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.593454  2081 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.510857 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.471130  1979 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.596031  2000 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:11.596251 31044 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:11.491683  1829 raft_consensus.cc:3055] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:11.596720  1829 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:11.597697  1829 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.598915  1829 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.599561  1979 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.516412 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.464927  2031 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.583298  2039 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.516047 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.505055 31616 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.601615 30973 raft_consensus.cc:2410] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:11.518816 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.496380 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.507143 31619 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.512657 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.502174 31621 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:11.498387 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:11.521512 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.491869 30970 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:11.590094 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.578344 31051 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.493233 30894 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:25:11.498137 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:11.494122 30971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1883) took 1707 ms (client timeout 2016 ms). Trace:
I20260709 12:25:11.611930 31618 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:11.504721 31624 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.582815 30799 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 6, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 6 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.589052 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.580228 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.603701 31619 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.459618 31016 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:11.612989 31620 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:11.605182 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.605829 30901 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:25:11.606323 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.609227 30894 pending_rounds.cc:85] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 5
I20260709 12:25:11.626191 30894 pending_rounds.cc:107] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:11.626428 30894 raft_consensus.cc:2889] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.610927 30967 raft_consensus.cc:2410] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:11.602397 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.628340 30973 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:11.629221 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:11.548628 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 117015us
I20260709 12:25:11.600217 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.630856 30973 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:11.619984 30895 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
W20260709 12:25:11.620129 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 151966us
I20260709 12:25:11.610978 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.555954 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:11.607913 31617 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:11.631665 30972 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:11.585114 30969 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:11.633503 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.634100 30969 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:11.608054 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.492292 30864 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:11.631657 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.863762 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1890) took 1592 ms. Trace:
I20260709 12:25:11.883615 30894 rpcz_store.cc:276] 0709 12:25:10.271158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.358155 (+1086997us) service_pool.cc:224] Handling call
0709 12:25:11.358506 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.626839 (+268333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.863469 (+236630us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400098154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:11.863678 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309087232}
I20260709 12:25:11.765640 30976 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:11.613236 30968 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:11.882849 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.641108 30974 raft_consensus.cc:2410] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:11.604229 30975 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:25:11.610639 30971 rpcz_store.cc:269] 0709 12:25:09.787071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.787768 (+   697us) service_pool.cc:224] Handling call
0709 12:25:11.493950 (+1706182us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400023854. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:11.494066 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3332323456}
W20260709 12:25:11.886637 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 251516us
I20260709 12:25:11.889536 31624 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:11.746826 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:11.886068 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 393846us
I20260709 12:25:11.675408 30867 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:25:11.846179 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.641683 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 182127us
I20260709 12:25:11.635318 30970 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:11.651893 31051 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:11.895756 31016 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:11.888885 30897 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:11.883419 30973 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
W20260709 12:25:11.888104 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 332200us
I20260709 12:25:11.675024 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:11.916045 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:11.905709 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 370259us
W20260709 12:25:11.917191 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.917641 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.917960 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.918303 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.896312 30972 raft_consensus.cc:2410] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:25:11.882563 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.919833 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.638888 31616 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:11.590044  2041 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.535041  2033 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.548703  2076 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:11.887653 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.921011 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.922130 30894 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
W20260709 12:25:11.887779 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 276359us
I20260709 12:25:11.922669 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.646956 30799 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.924067 31014 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:11.473701  1993 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:11.928841 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.925822 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.926751 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.930486 31049 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:11.930186 30898 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:11.924137 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.926206 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.932287 30894 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:11.640959  1947 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.925092 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.520174  2034 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:11.680143  1979 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.551349  1816 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.936983 30799 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 6, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 6 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:11.938584 30970 raft_consensus.cc:3055] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:11.956377 30970 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:11.938992 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:11.947738 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.957234 30895 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:11.641508  2032 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:11.641104  1941 raft_consensus.cc:2764] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:11.962726 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.963289 30969 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:11.675319  2031 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.265s
I20260709 12:25:11.952149 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.953226 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:11.969295 31045 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:11.953925 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.970201 30975 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:11.962059 30970 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.954566 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.958120 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:11.972802 30896 raft_consensus.cc:2410] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:11.922152  1897 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.959519 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.960606 30971 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:11.921646  1950 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:11.924126  2041 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.674892  2043 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:11.880388  2081 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:11.954144  1682 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:11.927654  1957 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.924311  2076 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.701608  1303 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.254s
I20260709 12:25:11.720345  1627 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.239s
I20260709 12:25:11.984586  2043 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.997948  2043 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:11.998463  2043 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.998914  2043 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.953079  1993 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.922370  2000 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.001092  2043 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:12.001485  1993 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.001696  2043 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.002597  2043 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.002979  2037 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.004766  2043 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.006407  2041 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.980504  2032 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:12.008081 31044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:12.009742 30799 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:11.982574 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.012718  2041 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.014451  1897 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.014901  1897 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:12.015481 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.017026 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.017644 30971 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:12.018414 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.019961  1947 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:11.983489  1980 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.021994  1980 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.022331  1980 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.025628  2032 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.027808 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:12.028439 30972 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.988091 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:11.982467  1950 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.990531  2081 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:11.984624  1682 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.991226  1957 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:11.991947  2076 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.015211  1902 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:12.032898 31050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.017s	sys 0.023s
W20260709 12:25:12.033380 31050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.017s	sys 0.023s
I20260709 12:25:11.981649  1816 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:12.034207 31044 raft_consensus.cc:606] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.040756 31044 raft_consensus.cc:614] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:12.034981 30973 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:12.030894 30799 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 7, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 7 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:12.044144 30799 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:12.046219 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.047632 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.030525  1950 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.093250 30897 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:12.091305 30972 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:12.095453 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.096180 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.081220 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.030604  2033 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:25:12.097549  2033 consensus_queue.cc:1243] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Peer 5e9d2b069edc4166802ee0456ebcb706 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:12.097913 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.098819 30972 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:12.097652 30975 raft_consensus.cc:2410] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:25:12.032707  1682 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:12.139051 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.137252 30972 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:12.047166  1816 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.145172 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.143330 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.146059 30976 raft_consensus.cc:2410] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:12.146246 30969 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:12.145002 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:12.149231 30972 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:25:12.149588 30972 pending_rounds.cc:85] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 4
I20260709 12:25:12.149794 30972 pending_rounds.cc:107] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:25:12.150000 30972 raft_consensus.cc:2889] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.156059 30969 pending_rounds.cc:85] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 4
I20260709 12:25:12.156404 30969 pending_rounds.cc:107] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:25:12.156682 30973 raft_consensus.cc:2410] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:12.178831 30969 raft_consensus.cc:2889] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.150918  1816 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.176709  1902 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:12.190271 31587 connection.cc:256] RPC call timeout handler was delayed by -2.3394341960001839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 12:25:12.190791 31587 connection.cc:256] RPC call timeout handler was delayed by -1.5834296119996907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260709 12:25:12.210762 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:12.228683 31047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:12.229290 31047 raft_consensus.cc:606] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.229609 31047 raft_consensus.cc:614] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:12.208002  1829 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:12.214092  2039 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:12.235189 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:12.240360  2039 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:25:12.240931  2086 log.cc:927] Time spent T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:25:12.241344  2039 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.236085  1829 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.243923  1682 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.245645  1829 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.245874  1682 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.234947 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:12.250547 31050 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:12.252513 31050 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:12.254429 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:12.255249 31616 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 5: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:12.255095 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:12.255892 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:12.256119 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:12.256471 31617 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:12.256847 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:12.257441 31624 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
W20260709 12:25:12.258993 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 354022us
I20260709 12:25:12.259393 31587 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:12.260565 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 336553us
W20260709 12:25:12.262352 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 366660us
I20260709 12:25:12.263067 31016 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.264279 31016 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.265729 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:12.267359 31016 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:12.267848 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 349095us
W20260709 12:25:12.270541 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 330605us
I20260709 12:25:12.265144  1868 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:12.274341 30864 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:12.276574 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:12.279382 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 604016us
I20260709 12:25:12.277422 31016 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.279457 30942 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.280488 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:12.281944 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 303389us
I20260709 12:25:12.272318 31014 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.265059  2041 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.294719 30942 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.296252 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:12.299844 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.300428 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1887) took 2182 ms. Trace:
I20260709 12:25:12.301417 30939 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.303360 30900 raft_consensus.cc:2393] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:12.290360  1825 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:12.291586  1979 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.273833  1688 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:25:12.309636 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.335166 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:12.335654 30897 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.332501 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:12.364223 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.300841 30892 rpcz_store.cc:276] 0709 12:25:10.117818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.341532 (+1223714us) service_pool.cc:224] Handling call
0709 12:25:11.377509 (+ 35977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.377739 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:11.809049 (+431310us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.300092 (+491043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.300144 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:12.300189 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.300261 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.300372 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":758245,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":848558,"threads_started":2}
I20260709 12:25:12.331641 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.368474 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.300424  1912 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:12.333583 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.328469 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.281668  1993 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:12.369376 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.312822  1979 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.426348 30894 raft_consensus.cc:1240] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:12.427201 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:12.386972 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.297968  1849 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:12.428143 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.447732 30899 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:12.302989  2099 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.368407  1941 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.441442 30898 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:12.441942 30897 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:12.454627 30901 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:12.454707 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.378958 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.311607  1825 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:12.455302  1941 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.445497 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.456357  1825 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.440917 30900 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:12.457369 30893 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: [7.7-9.8]
W20260709 12:25:12.444264 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 168685us
I20260709 12:25:12.458321 30894 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:12.461815  1941 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:12.464501 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 96068.3us
I20260709 12:25:12.310360  2104 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:12.444808 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 163231us
I20260709 12:25:12.337158  1868 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:12.465991 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:12.483443 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 182101us
I20260709 12:25:12.484200 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.465955 30892 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:25:12.480489 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.469782 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.490291 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.498350 30896 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
W20260709 12:25:12.498652 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 215454us
I20260709 12:25:12.492942 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.444583  1979 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.490681 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.478607  2104 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.482437  1868 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.501048 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:12.502667 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 230003us
I20260709 12:25:12.510051 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.457828 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.524864 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:12.525079 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 62792.5us
I20260709 12:25:12.539077  2117 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.539928  2033 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:12.540359  2033 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:12.540737  2033 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.541111  2131 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.520205  2125 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.549549  2125 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:12.549906  2125 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:12.550487  1980 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.004s
I20260709 12:25:12.550880  1980 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:12.509495  1868 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.553751 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.505541  2104 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:12.669417 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 374744us
I20260709 12:25:12.673983 30942 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.674589 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 928) took 1272 ms. Trace:
I20260709 12:25:12.675076 31623 rpcz_store.cc:276] 0709 12:25:11.401753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.417727 (+ 15974us) service_pool.cc:224] Handling call
0709 12:25:12.674355 (+1256628us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54007616d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:12.674525 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006482304}
W20260709 12:25:12.676640  2106 log.cc:927] Time spent T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:25:12.677237 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.677871 30896 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
W20260709 12:25:12.678874  1897 consensus_meta.cc:287] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.002s
W20260709 12:25:12.679173  1950 consensus_meta.cc:287] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.585s	user 0.002s	sys 0.006s
I20260709 12:25:12.680550  1950 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:12.681582 30971 raft_consensus.cc:2368] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6.
W20260709 12:25:12.633816  2076 consensus_meta.cc:287] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.009s
I20260709 12:25:12.682412  2076 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.683452 30897 raft_consensus.cc:2393] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:12.551509  2129 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 12:25:12.685104  1980 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:12.670110  2099 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:12.688158  2099 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.688565  2099 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.688905  2099 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.689548 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.689711  1950 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.691118 30894 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:25:12.691540 30894 pending_rounds.cc:85] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 7
I20260709 12:25:12.691746 30894 pending_rounds.cc:107] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:25:12.692065 30894 raft_consensus.cc:2889] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.532656  1688 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:12.708532 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:12.709226 31044 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.528224  2032 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.181s
I20260709 12:25:12.709002  2043 consensus_queue.cc:1059] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:12.710747  2032 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:12.711122  2043 raft_consensus.cc:3055] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:12.711526  2043 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:12.711783 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.712307  2043 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.713140 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.719049 31050 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:12.525287  1829 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.167s
I20260709 12:25:12.726579 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 643) took 1100 ms. Trace:
I20260709 12:25:12.726963 30974 rpcz_store.cc:276] 0709 12:25:11.626169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.912854 (+286685us) service_pool.cc:224] Handling call
0709 12:25:11.948557 (+ 35703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.308232 (+359675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.308266 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:12.308705 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:25:12.494547 (+185842us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:12.494586 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.494652 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.726372 (+231720us) raft_consensus.cc:1685] finished
0709 12:25:12.726395 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.726521 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67128,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":544764,"threads_started":2,"wal-append.queue_time_us":228004}
I20260709 12:25:12.728474  1688 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.728919  1688 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.736395 30942 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:12.553539  1993 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:12.742542 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.745020 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:12.746181 31587 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.747443 31587 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:12.742420 31050 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:12.751349 31044 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
W20260709 12:25:12.751960 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 241948us
I20260709 12:25:12.753232 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1912) took 1239 ms. Trace:
I20260709 12:25:12.754907  2131 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:12.755633 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 254637us
I20260709 12:25:12.756407 31014 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.759958 31014 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.761333 31014 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.756654 30967 rpcz_store.cc:276] 0709 12:25:11.513830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.698008 (+184178us) service_pool.cc:224] Handling call
0709 12:25:11.698396 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.698590 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:11.893084 (+194494us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.752473 (+859389us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.752613 (+   140us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:12.752694 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.752831 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.753088 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":395287,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2382,"raft.queue_time_us":237907,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":1031170,"threads_started":3,"wal-append.queue_time_us":601109}
I20260709 12:25:12.743491  2076 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.679314  1897 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:12.691112  1950 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.771128  2097 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:12.771742  2028 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:12.772871  2127 raft_consensus.cc:2764] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:12.773866  2043 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.775110 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:12.785531 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:12.780929 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1094) took 2574 ms. Trace:
I20260709 12:25:12.775445  2125 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.775974 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.688575  1849 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.766606  1829 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:12.759174 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:12.747968  1993 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:12.783669  1816 consensus_meta.cc:287] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.007s
I20260709 12:25:12.789454 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.804733 30864 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:12.807065 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1915) took 1292 ms. Trace:
I20260709 12:25:12.782099  2131 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.788551 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:12.784027  2052 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:25:12.824999 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:12.786291 31619 rpcz_store.cc:276] 0709 12:25:10.206588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.353868 (+1147280us) service_pool.cc:224] Handling call
0709 12:25:11.424664 (+ 70796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.506824 (+ 82160us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5400107320. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305ab06f 00007f0330623f60 00007f03306257de 00007f033062fb49 00007f0330630416 00007f033062cd8f 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62
0709 12:25:11.929629 (+422805us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:12.253079 (+323450us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.770738 (+517659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:12.780128 (+  9390us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:12.780246 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.780583 (+   337us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.780844 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1071,"prepare.queue_time_us":280268,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":2201,"raft.queue_time_us":162935,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":16842,"spinlock_wait_cycles":92817152,"thread_start_us":819090,"threads_started":3,"wal-append.queue_time_us":512558}
W20260709 12:25:12.796206 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.785825 30942 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:25:12.827253 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 300038us
I20260709 12:25:12.827622 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.821417 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:12.829190 30898 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
W20260709 12:25:12.822160 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.816169 30968 rpcz_store.cc:276] 0709 12:25:11.514574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.905004 (+390430us) service_pool.cc:224] Handling call
0709 12:25:11.928138 (+ 23134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.272901 (+344763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.272933 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:12.290797 (+ 17864us) log.cc:844] Serialized 26 byte log entry
0709 12:25:12.668667 (+377870us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:12.668711 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.668788 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.806877 (+138089us) raft_consensus.cc:1685] finished
0709 12:25:12.806896 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.807011 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10987,"raft.queue_time_us":42103,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5730,"thread_start_us":673215,"threads_started":2,"wal-append.queue_time_us":500169}
I20260709 12:25:12.785184  1950 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:12.809439  1825 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.811820  1993 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.806552  1957 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.864549  2112 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:12.865108  2112 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.867282  2112 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.809098  2127 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:12.813107  2097 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:12.789822  1829 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:12.868299  1829 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.856598  2031 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:25:12.834672  2032 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.870743  2032 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:12.871096  2032 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.789321  2096 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 12:25:12.873898 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.801661  2130 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:25:12.802930  2142 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:12.849624 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:12.786901  2122 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:12.876433  2122 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.876811  2122 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.877251  1829 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.787168  2134 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.808604  2095 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:12.854559 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.835645  2039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.004s	sys 0.014s
I20260709 12:25:12.863831  2118 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:12.803508  2041 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:25:12.846390 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 362267us
I20260709 12:25:12.823683  2131 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:12.785049  2132 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:25:12.890370 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 129101us
W20260709 12:25:12.890477 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 357455us
W20260709 12:25:12.891310 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.789528  1849 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.820356  1816 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.892470 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.834563  2101 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.899552 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:12.900414 31050 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:12.894601 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 64813.1us
W20260709 12:25:12.886409  2039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.004s	sys 0.015s
I20260709 12:25:12.895968 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.834637  2138 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.903609 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.852373  2145 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:12.901490 31588 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.885118  2095 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:12.903017 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 53467.2us
I20260709 12:25:12.904587 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.904922 31013 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.852104  1682 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:25:12.891860  2118 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:12.936473  2118 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.937132  1993 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.938042  1829 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.939281  1993 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.939735  1849 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.905869  2053 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.940819  2053 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.941658  2041 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:12.942682  2053 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.943019  2041 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:12.906473 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.892510  2131 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.894074  2142 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.956454  2142 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:12.956842  2142 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.889647  2127 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:12.946048 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44652.4us
I20260709 12:25:12.950685  1688 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:12.928715  2129 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:12.954676  2104 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.929464  2037 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:12.964129  2129 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:12.968616  2143 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:12.969422  2143 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:12.969770  2143 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.971894  2148 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:12.972527  2041 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:12.929144  1947 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.973470  1947 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:12.955879 30896 raft_consensus.cc:2393] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:25:12.960479 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 55635.1us
I20260709 12:25:12.974422 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:12.974303  1947 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:12.975703  1688 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:12.969013  2129 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.961503 31588 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:12.980039 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:12.980950 31588 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:12.981098 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.981670 30970 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.982198 31588 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.982800 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:12.983193  2028 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:12.968932  2037 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.983579  2028 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.950817  1868 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.984200  2028 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.984468  2136 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:12.985608  2136 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:12.985787  1868 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:12.981702  1825 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.983059 31588 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.903311  1897 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:12.964706 31587 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:12.959973  2039 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:12.964602 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 60100us
I20260709 12:25:12.987049 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:12.998174 30970 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:25:13.004861 30970 pending_rounds.cc:85] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 7
I20260709 12:25:13.005167 30970 pending_rounds.cc:107] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:25:13.005112 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:13.005707 30970 raft_consensus.cc:2889] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.981842  1802 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.006562 31587 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.887043  2033 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:12.932937  2095 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.932013  2101 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:13.018925 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 112529us
I20260709 12:25:13.019680 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.893232  2144 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.898285  2097 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.023283 31587 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.984385  2037 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.020336 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:12.986436  1825 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:13.006889 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2230) took 1068 ms. Trace:
I20260709 12:25:13.024721 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:13.038173 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.032119 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.034852 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.039021 30971 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:13.028769 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.029381 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.028561 31049 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 9. Ops: []
I20260709 12:25:13.030732 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.030270 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.038479 30897 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:13.032725 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.039328 30974 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:13.040244 30967 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 4.
I20260709 12:25:13.040913 30973 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:13.039391 30970 rpcz_store.cc:276] 0709 12:25:11.938154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.938246 (+    92us) service_pool.cc:224] Handling call
0709 12:25:11.938476 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.816059 (+877583us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b58007a6cd0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305890aa 00007f033060b447 00007f0330623fe7 00007f03306257de 00007f033062fb49 00007f0330630416 00007f033062cd8f 00007f033062c83e 00007f03355f1419 00007f032eb68bd4
0709 12:25:12.981239 (+165180us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5400073620. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305a2a1d 00007f03305891a4 00007f033060b447 00007f0330623fe7 00007f03306257de 00007f033062fb49 00007f0330630416 00007f033062cd8f 00007f033062c83e 00007f03355f1419
0709 12:25:13.006662 (+ 25423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.006838 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703342720}
I20260709 12:25:13.006932  2043 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.043859 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.045761 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:13.015975  1802 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.018342  2117 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.047052 31616 pending_rounds.cc:85] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 6
I20260709 12:25:13.047253 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.057648 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:13.057605 31616 pending_rounds.cc:107] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:25:13.058717 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:13.058785 31616 raft_consensus.cc:2889] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:13.048728 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.022210  2144 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.052824 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:13.054989 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:13.056303 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:13.042456  2081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.009s	sys 0.018s
I20260709 12:25:13.058387 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:13.109539 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:13.110252 30897 raft_consensus.cc:2393] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:13.033146  1993 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:13.060716 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:13.110906  1993 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.111181 30894 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:13.111464  1993 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.031443  2041 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.077867 31615 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:13.114368 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:13.031255  2145 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.030786  1682 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.989938  2032 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.116044  1682 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.116636  1682 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.118043  2032 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:13.072425 30899 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.073153 30865 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:13.067941 31618 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
W20260709 12:25:13.070937 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 311818us
I20260709 12:25:13.064394 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:13.042686  1825 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.124429 31016 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:12.987175  2142 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.036248  2125 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:13.070469 30970 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:13.045929  2053 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.059010  2147 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.075560 31620 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.040650  2120 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:13.116014  2145 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.125712  1682 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.127471 30899 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:13.129246 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:13.129866 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.130728 31045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:13.178231 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:13.026161  2146 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.062791 31588 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.182951 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.132977 31622 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:13.053905  1829 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.058441  1802 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.144680 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:13.175920 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 130225us
I20260709 12:25:13.224803 31587 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:13.131543 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58467.8us
I20260709 12:25:13.226464 30865 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.087604  1897 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.177901 30892 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:13.178402 31045 raft_consensus.cc:606] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:13.181152  2156 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.240128 31587 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:13.240751 31051 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:13.183657 30967 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:13.018499  1950 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:13.221237 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 158480us
I20260709 12:25:13.077728  2144 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.228809 30865 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.244338 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.230019 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.231043 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.071450  2096 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 12:25:13.233127 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 159038us
I20260709 12:25:13.236826 31045 raft_consensus.cc:614] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:13.239838 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.146394  2147 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:13.247023 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.147890  2141 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.179780  1816 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:13.134359  2081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.009s	sys 0.018s
I20260709 12:25:13.249377 30970 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:25:13.313340 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.250869 31014 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.234340  2000 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:13.181704  2146 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.145646  1912 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:13.256476 30974 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 4.
I20260709 12:25:13.257597 31588 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:13.257704 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:13.191488  2101 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.294094 30968 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:13.230794  2119 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.299912 30973 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.252018  2155 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.234720  1897 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:13.147473  2053 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.240520  2156 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:13.315274 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 64478.3us
I20260709 12:25:13.190632  2043 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:13.299026  1979 consensus_meta.cc:287] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.000s
I20260709 12:25:13.247769  1849 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:13.295527  2152 log.cc:927] Time spent T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:25:13.321172 30939 leader_election.cc:336] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.722s (SENT)
W20260709 12:25:13.438609  2158 log.cc:927] Time spent T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:25:13.515405 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 194232us
I20260709 12:25:13.316730 31620 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:13.325539 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.260618  2130 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:13.501613  2129 consensus_meta.cc:287] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.003s
I20260709 12:25:13.297493  2034 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:13.331391 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 73743.6us
W20260709 12:25:13.494592 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 99288.1us
I20260709 12:25:13.495143 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.495625 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.380460  2112 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.495244 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.524840 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:13.526278 31051 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:13.493533  2104 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:13.380586  1825 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.365432 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.179064  2127 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.297611  2147 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.327646  1912 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.333343  1897 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.381678  2119 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:13.323760  2146 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.498731  2134 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.544669 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.498833  1682 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:13.386833 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.379869  1627 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:13.380641 31623 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:13.252954  2039 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:25:13.145499  2136 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.495952 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:13.417665  2153 log.cc:927] Time spent T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:25:13.503751 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.507663 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 173796us
W20260709 12:25:13.510303 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 252749us
I20260709 12:25:13.513497 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.384636  2156 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.520479 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.239451  2031 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:25:13.324898  2000 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.577798  2000 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:13.314538  2141 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.524863 30865 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.578771  1902 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:13.578884 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 54098.2us
I20260709 12:25:13.525482 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:13.579993 31620 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.581565 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.380227  1993 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.529166 30973 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:13.380324  2172 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.500964  2105 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.530366 30970 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:13.533058 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:13.533589 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:13.511507  1849 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.541785 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.542631 31618 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:13.551409 30974 raft_consensus.cc:2393] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:13.533088  2118 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:13.510326  1816 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:13.510401  1979 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:13.541342  1941 consensus_meta.cc:287] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 1.078s	user 0.010s	sys 0.000s
W20260709 12:25:13.523134  2115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:25:13.540647  1912 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.542701  2119 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:13.559391 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:13.565560 31047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.011s
I20260709 12:25:13.561987 31588 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:13.589709  2033 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:13.570647  2122 consensus_meta.cc:287] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.000s
W20260709 12:25:13.571861  2143 consensus_meta.cc:287] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.000s
I20260709 12:25:13.551282  2134 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:13.557040  2164 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:25:13.700102  2039 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:13.700644  2039 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.531867  2129 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.572891  2117 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:13.557664  1957 consensus_queue.cc:1059] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:25:13.526916  2130 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.558712  1627 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:13.575320  2131 consensus_meta.cc:287] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.000s
I20260709 12:25:13.579501  2141 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:13.587675 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.683074  2178 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.648500 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.747334 31619 raft_consensus.cc:2393] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:13.560304  2148 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.657683 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:13.673568 31620 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:13.652508  1829 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:13.724767  2099 consensus_meta.cc:287] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.035s	user 0.008s	sys 0.002s
W20260709 12:25:13.678294 31047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.011s
W20260709 12:25:13.678521 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 116611us
W20260709 12:25:13.678134 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 118800us
I20260709 12:25:13.626119  2096 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.625262  1902 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:13.665328  2115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.013s	sys 0.000s
I20260709 12:25:13.696012 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.761837 31622 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:13.664939  1849 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.762581 31014 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:13.717240 31045 raft_consensus.cc:2368] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:13.677765  2119 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.683853  2172 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:13.647286 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 128351us
W20260709 12:25:13.744634 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 157035us
I20260709 12:25:13.772065 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.746675  2031 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.751927 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.674840  1941 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.567902  2052 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:13.725371  2028 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.000s
I20260709 12:25:13.756752 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.779567 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.754837 31046 raft_consensus.cc:2393] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:13.719017  2117 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:13.784994 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.674553  2105 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.697367  2122 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.816124  2122 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:13.816694  2122 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.817090  2122 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.818943  2122 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:13.820158  1993 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:13.820284  2182 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:13.821449  2129 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:13.822481  1979 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:13.664948  2118 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:25:13.766556  2170 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:25:13.809598 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.770460 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.771154 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:13.751368  2178 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.707893  2000 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.777781 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:13.705961  2143 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.753648  2120 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:13.760326 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 233647us
I20260709 12:25:13.795593 31016 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.837261 30974 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
W20260709 12:25:13.839651 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 44155.5us
I20260709 12:25:13.796061 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:13.797101 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.840463 31622 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.840823  2171 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:25:13.841003 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 43973.5us
I20260709 12:25:13.841871  2041 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:13.844364  2041 raft_consensus.cc:697] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:13.845250  2041 consensus_queue.cc:237] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.847236 31622 raft_consensus.cc:2468] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:13.848389 31016 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.795601 30865 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.800849 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:13.849548 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 54021.6us
I20260709 12:25:13.849720 31050 raft_consensus.cc:2368] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:13.850704 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.851985  1979 raft_consensus.cc:2804] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:13.852545  1979 raft_consensus.cc:697] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:13.853503  1979 consensus_queue.cc:237] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:13.810093  2169 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:25:13.809576  2117 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.856248  2117 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:13.810738  2184 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:25:13.813925  1829 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:13.814352  1802 consensus_meta.cc:287] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.001s
I20260709 12:25:13.825083 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:13.771792  2172 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.835827 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:13.860404  1829 raft_consensus.cc:3055] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:13.861449  1829 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:13.861689 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.860910 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:13.862550  2129 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:25:13.836462 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 58765.8us
I20260709 12:25:13.823176  1627 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.863621 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:13.745118  2131 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.759793  1688 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.779150  2043 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.860280  1802 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.796500  1682 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:13.841396  2171 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:13.860893 31046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:13.887792 31046 raft_consensus.cc:606] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:13.865028  1993 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.866519 30972 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:13.867236 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:13.764227  2096 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.870651  1816 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:13.869297  2165 log.cc:927] Time spent T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.313s	user 0.000s	sys 0.000s
I20260709 12:25:13.871155  2172 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.799289  2028 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.762449  2099 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.773005  2048 consensus_queue.cc:1059] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:25:13.859162  1944 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.884044 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:13.915639 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 65443.9us
I20260709 12:25:13.834851  2118 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.917033 30865 leader_election.cc:400] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6.
I20260709 12:25:13.886653 30969 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:13.886773 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:13.888161 31046 raft_consensus.cc:614] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:13.861300 30968 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.917382 30865 leader_election.cc:403] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:13.890569 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:13.891289 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:13.785981  1947 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:25:13.796269  2132 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:25:13.866071  2000 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.780995  1957 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:25:13.896248 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:13.798820  1902 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:25:13.838407  2178 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.864907  2112 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.865247  2120 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.869093  1829 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:13.897699  2180 log.cc:927] Time spent T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:25:13.871829  2185 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.886258 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:13.899240  2095 consensus_meta.cc:287] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.863s	user 0.002s	sys 0.007s
I20260709 12:25:13.895246 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:13.899266  2179 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.900100  1682 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:13.911784  2031 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:13.933473 31043 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:13.874246  2147 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:13.937335 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:14.068673 31616 raft_consensus.cc:2368] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:14.069475 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:14.070299 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:14.071015 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:14.071363 31616 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:13.938508 30899 raft_consensus.cc:2410] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
W20260709 12:25:13.950809 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 55622.4us
I20260709 12:25:14.072415 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:13.934316  2101 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6.
I20260709 12:25:14.072975  2048 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.073637  2101 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.075140 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 656) took 1057 ms. Trace:
I20260709 12:25:14.075549 30975 rpcz_store.cc:276] 0709 12:25:13.017290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.017396 (+   106us) service_pool.cc:224] Handling call
0709 12:25:13.030945 (+ 13549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.043051 (+ 12106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.043078 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.051426 (+  8348us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.177897 (+126471us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.177935 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.178002 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.074924 (+896922us) raft_consensus.cc:1685] finished
0709 12:25:14.074944 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.075080 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4994,"raft.queue_time_us":12417,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":9361,"thread_start_us":62234,"threads_started":1,"wal-append.queue_time_us":436521}
I20260709 12:25:13.953724  2125 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.072985 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:14.079983  1897 consensus_meta.cc:287] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.006s
I20260709 12:25:14.080160  2101 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:13.937800  1816 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:25:14.087232 31615 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:14.095467 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:14.096975 30970 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:14.078348  2037 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 1.026s	user 0.006s	sys 0.003s
I20260709 12:25:14.100937 30897 raft_consensus.cc:1240] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:14.088709  2192 log.cc:927] Time spent T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:25:14.091275  2144 consensus_meta.cc:287] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.834s	user 0.006s	sys 0.003s
W20260709 12:25:14.104214  2175 log.cc:927] Time spent T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.728s	user 0.002s	sys 0.000s
I20260709 12:25:14.104070 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:14.107331 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1116) took 1072 ms. Trace:
W20260709 12:25:14.108706  2173 log.cc:927] Time spent T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:25:14.109032 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:14.091022  1993 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:14.110106  1941 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:14.102244 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:14.152765 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48773us
I20260709 12:25:14.153492 30867 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:14.152935 30897 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.112841 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:13.950291  2095 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.113674  2145 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:14.114352  2186 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:25:14.115087  1849 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:14.116304  2146 consensus_meta.cc:287] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.000s
I20260709 12:25:14.091955  2130 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:14.112000  2037 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.068430  1829 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.139662 31618 rpcz_store.cc:276] 0709 12:25:13.034616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.124882 (+ 90266us) service_pool.cc:224] Handling call
0709 12:25:13.125122 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.661388 (+536266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.107104 (+445716us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54005bde54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:14.107274 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959805824}
I20260709 12:25:14.140103 30899 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:14.341236 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1926) took 1265 ms. Trace:
I20260709 12:25:14.148452 31616 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:14.344200 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 920) took 1039 ms. Trace:
I20260709 12:25:14.344525 31616 rpcz_store.cc:276] 0709 12:25:13.305294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.075235 (+769941us) service_pool.cc:224] Handling call
0709 12:25:14.344128 (+268893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:14.345484 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:14.346181 31616 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:14.165834 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 634) took 1138 ms. Trace:
I20260709 12:25:14.077540  2031 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:14.058832  2171 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:14.252457  2199 log.cc:927] Time spent T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:25:14.253217  2205 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:14.396562  2205 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:14.397013  2205 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.256711  2136 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.400019  2136 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.257251 31051 raft_consensus.cc:2368] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:14.257759  2195 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.152187  1993 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:14.258467  1941 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:14.258756  2099 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:14.258865  2131 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:14.140458  2181 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.384s	user 0.000s	sys 0.002s
I20260709 12:25:14.095780  1897 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:14.258221 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 104797us
I20260709 12:25:14.260686 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1110) took 1227 ms. Trace:
I20260709 12:25:14.346752 31048 rpcz_store.cc:276] 0709 12:25:13.027079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.027189 (+   110us) service_pool.cc:224] Handling call
0709 12:25:13.027457 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.047561 (+ 20104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.047590 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.057732 (+ 10142us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.500260 (+442528us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.500297 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.500358 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.165580 (+665222us) raft_consensus.cc:1685] finished
0709 12:25:14.165601 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.165769 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19757,"raft.queue_time_us":26092,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":71375,"thread_start_us":324613,"threads_started":1,"wal-append.queue_time_us":800244}
I20260709 12:25:14.141435  2144 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:14.257195  2095 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:14.351780 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:14.342543 30971 rpcz_store.cc:276] 0709 12:25:13.075484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.318839 (+243355us) service_pool.cc:224] Handling call
0709 12:25:13.331006 (+ 12167us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:13.331349 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.331377 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:13.331908 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 12:25:13.718019 (+386111us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:13.718057 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.718128 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.341000 (+622872us) raft_consensus.cc:1685] finished
0709 12:25:14.341019 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.341174 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36980,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":211402,"threads_started":1,"wal-append.queue_time_us":374858}
W20260709 12:25:14.375089 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.422206 31622 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:14.401683  1993 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.459743  2203 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.112422  2119 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.493088 30897 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
W20260709 12:25:14.494038 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.473605 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:14.493753 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1908) took 1469 ms. Trace:
W20260709 12:25:14.582348 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 495668us
I20260709 12:25:14.582481 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 911) took 1282 ms. Trace:
I20260709 12:25:14.564330 31617 rpcz_store.cc:276] 0709 12:25:13.032981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.033096 (+   115us) service_pool.cc:224] Handling call
0709 12:25:13.051540 (+ 18444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.145294 (+ 93754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.145324 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.175938 (+ 30614us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.553382 (+377444us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:13.553422 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.553491 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.260478 (+706987us) raft_consensus.cc:1685] finished
0709 12:25:14.260497 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.260625 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93359,"raft.queue_time_us":95209,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6719,"thread_start_us":296325,"threads_started":1,"wal-append.queue_time_us":565614}
I20260709 12:25:14.586989 31618 rpcz_store.cc:276] 0709 12:25:13.300379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.351498 (+1051119us) service_pool.cc:224] Handling call
0709 12:25:14.582401 (+230903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:14.589026 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:14.492395  2201 log.cc:927] Time spent T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:25:14.590782 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:14.591481 31046 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
W20260709 12:25:14.593101 30896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.021s	sys 0.032s
I20260709 12:25:14.585629 30900 rpcz_store.cc:276] 0709 12:25:13.024662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.025297 (+   635us) service_pool.cc:224] Handling call
0709 12:25:13.025579 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.025780 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.025803 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.037942 (+ 12139us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.583576 (+545634us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:13.583617 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.583684 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:14.153898 (+570214us) raft_consensus.cc:1685] finished
0709 12:25:14.153925 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.493692 (+339767us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":453083,"threads_started":1,"wal-append.queue_time_us":686439}
I20260709 12:25:14.594462 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:14.594594 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:14.593509 30896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.021s	sys 0.032s
I20260709 12:25:14.596855 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:14.600777 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:14.603654 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 919) took 1298 ms. Trace:
I20260709 12:25:14.604050 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:14.604969 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:14.604596 31616 rpcz_store.cc:276] 0709 12:25:13.305014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.366517 (+1061503us) service_pool.cc:224] Handling call
0709 12:25:14.603591 (+237074us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:14.607501 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2110858239998379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:25:14.608861 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:14.405227  1802 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:14.614745 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:14.619704 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:14.620926 31049 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:14.594015  2203 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:14.623095  2000 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:14.623914  2000 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.624257  2203 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:14.625759  2031 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:14.627064 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:14.627616  2037 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:14.629155  1849 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:14.594645  2145 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.636438  2145 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.638731  2145 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:14.639261  2145 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:14.401608  2195 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.642130  2195 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:14.567193  2101 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:14.341972  2146 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.644495  2146 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:14.352732  1682 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:14.647085  2178 consensus_meta.cc:287] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.706s	user 0.000s	sys 0.005s
I20260709 12:25:14.649071 31618 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.649678 31042 raft_consensus.cc:2368] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:14.653100 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:14.656397 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:14.657401 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 933) took 1517 ms. Trace:
I20260709 12:25:14.494277  1941 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:14.657922 31617 rpcz_store.cc:276] 0709 12:25:13.140047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.616443 (+1476396us) service_pool.cc:224] Handling call
0709 12:25:14.657333 (+ 40890us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:14.661660  2202 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.542s	user 0.001s	sys 0.000s
W20260709 12:25:14.664333 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 67060.1us
I20260709 12:25:14.665740  2150 consensus_queue.cc:1059] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:14.666013 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2237) took 1170 ms. Trace:
I20260709 12:25:14.666558  2150 raft_consensus.cc:3055] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:14.667335  2150 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:14.668159  2150 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.669273  2150 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:14.664268  2160 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 1.288s	user 0.010s	sys 0.024s
I20260709 12:25:14.666443 31042 rpcz_store.cc:276] 0709 12:25:13.495275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.496067 (+   792us) service_pool.cc:224] Handling call
0709 12:25:14.665779 (+1169712us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400159fd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:14.665921 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2505771392}
I20260709 12:25:14.672595 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:14.673333 31042 raft_consensus.cc:2368] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:14.674098 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:14.675138 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:14.617309  1902 consensus_queue.cc:1059] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:25:14.647572  2178 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:15.040964  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.078s	sys 0.126s
W20260709 12:25:16.166277  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.055s	user 0.087s	sys 0.141s
W20260709 12:25:15.865340  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.005s	sys 0.008s
I20260709 12:25:14.651602  2145 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.169267  2145 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:15.987407  2144 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:14.687614  1912 consensus_meta.cc:287] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.971s	user 0.009s	sys 0.000s
W20260709 12:25:15.917243  2181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.277s	user 0.005s	sys 0.006s
I20260709 12:25:16.170336  1912 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.173229  1912 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:16.164542  1897 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:15.014289  1941 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.676251  2147 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:15.880486  2120 consensus_meta.cc:287] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.940s	user 0.010s	sys 0.000s
W20260709 12:25:16.066128  2156 consensus_meta.cc:287] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 2.479s	user 0.000s	sys 0.008s
I20260709 12:25:16.188297  2120 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:14.616648  2129 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:16.190056  2181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.550s	user 0.006s	sys 0.007s
W20260709 12:25:16.166818  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.519s	user 0.005s	sys 0.010s
I20260709 12:25:14.834626  1802 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:16.192462  1802 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.195757  2099 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:14.976624  1993 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:16.196408  2099 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.198446  1993 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:16.198596  2099 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:16.053937  2150 consensus_meta.cc:287] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.384s	user 0.008s	sys 0.000s
I20260709 12:25:16.184504  1902 raft_consensus.cc:3055] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:14.872608  2028 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:14.783841  2037 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:14.678882  2127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.027s	sys 0.049s
I20260709 12:25:14.853992  2136 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:16.167419  2119 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:14.739271  2172 consensus_meta.cc:287] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.811s	user 0.004s	sys 0.004s
I20260709 12:25:16.188347  2156 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:16.063419  2118 consensus_meta.cc:287] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 2.137s	user 0.007s	sys 0.000s
W20260709 12:25:16.231947  2127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.154s	user 0.036s	sys 0.087s
I20260709 12:25:14.788142  2117 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:16.220104  1902 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:14.865324  2207 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:16.221288  2178 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:16.255788  1802 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:16.246626  2037 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.259297  2118 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.273487  2037 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:16.267829  2117 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:16.275935  2205 consensus_meta.cc:287] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 1.878s	user 0.011s	sys 0.000s
I20260709 12:25:16.263777  2207 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:16.277275  1902 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:16.276216  1829 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 1.887s	user 0.006s	sys 0.004s
I20260709 12:25:16.257870  2172 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.277221  2205 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.278867  2207 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:16.279453  2156 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:16.278453  1902 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.280329  2172 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:16.278391  2117 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:16.280375  2205 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:16.273720  2118 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:16.349360  2138 raft_consensus.cc:3055] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:16.350270  2138 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:16.352154  2138 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:16.353973  2138 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:14.684800 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:17.091310 30900 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 7: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:25:17.123083  2167 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 3.561s	user 0.009s	sys 0.032s
I20260709 12:25:17.273458  2033 raft_consensus.cc:3055] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:17.274138  2033 raft_consensus.cc:740] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:17.303786  2033 consensus_queue.cc:260] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:17.306241  2033 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.307600 30898 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 12:25:17.308555 30900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1923) took 2697 ms (client timeout 1693 ms). Trace:
W20260709 12:25:17.309077 30900 rpcz_store.cc:269] 0709 12:25:14.610962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.684507 (+ 73545us) service_pool.cc:224] Handling call
0709 12:25:17.305037 (+2620530us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.310477 30900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2207) took 2503 ms (client timeout 1776 ms). Trace:
W20260709 12:25:17.310696 30900 rpcz_store.cc:269] 0709 12:25:14.807464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.310286 (+2502822us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:17.310415 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:25:17.311355 30900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2201) took 2712 ms (client timeout 2018 ms). Trace:
W20260709 12:25:17.311565 30900 rpcz_store.cc:269] 0709 12:25:14.598865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.311243 (+2712378us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:17.311323 (+    80us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:25:17.312340 30900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2203) took 2700 ms (client timeout 2025 ms). Trace:
W20260709 12:25:17.312736 30900 rpcz_store.cc:269] 0709 12:25:14.612132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.312168 (+2700036us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:17.312283 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:17.313961 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:17.314718 30900 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:17.315239  2138 consensus_meta.cc:287] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.000s
I20260709 12:25:17.322902 30900 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
W20260709 12:25:17.323539 30900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2206) took 2535 ms (client timeout 2864 ms). Trace:
W20260709 12:25:17.323962 30900 rpcz_store.cc:269] 0709 12:25:14.788215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.313383 (+2525168us) service_pool.cc:224] Handling call
0709 12:25:17.323463 (+ 10080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.327647 31618 consensus_meta.cc:287] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 2.678s	user 0.026s	sys 0.061s
I20260709 12:25:17.329010 31618 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:17.328517 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2198) took 2741 ms. Trace:
I20260709 12:25:17.329514 30900 rpcz_store.cc:276] 0709 12:25:14.587508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.324591 (+2737083us) service_pool.cc:224] Handling call
0709 12:25:17.325170 (+   579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.325546 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:17.326473 (+   927us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.328082 (+  1609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.328153 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:17.328203 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.328278 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.328411 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":836,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":1063,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":231,"spinlock_wait_cycles":23552,"thread_start_us":1472,"threads_started":3,"wal-append.queue_time_us":688}
I20260709 12:25:17.332193 30900 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:17.332715 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2200) took 2742 ms. Trace:
I20260709 12:25:17.332937 30900 rpcz_store.cc:276] 0709 12:25:14.589969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.331551 (+2741582us) service_pool.cc:224] Handling call
0709 12:25:17.331951 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.332528 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.332660 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.334403 30900 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:17.334832 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2204) took 2722 ms. Trace:
I20260709 12:25:17.335059 30900 rpcz_store.cc:276] 0709 12:25:14.612485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.333579 (+2721094us) service_pool.cc:224] Handling call
0709 12:25:17.333976 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.334655 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.334798 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.341612  2053 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:17.397294  2120 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.402866  2053 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:17.403940  2053 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.407045  2053 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:17.409981  2142 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.415694  2043 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.416700  2043 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.420219  2043 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:17.420555  2198 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 3.273s	user 0.000s	sys 0.028s
W20260709 12:25:14.809455 31622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 934) took 1667 ms (client timeout 1810 ms). Trace:
W20260709 12:25:17.427642 31622 rpcz_store.cc:269] 0709 12:25:13.141770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.871219 (+729449us) service_pool.cc:224] Handling call
0709 12:25:14.809278 (+938059us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54006d0954. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:14.809398 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134767488}
W20260709 12:25:17.429039 31622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 910) took 4128 ms (client timeout 3168 ms). Trace:
W20260709 12:25:17.429358 31622 rpcz_store.cc:269] 0709 12:25:13.300129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.428803 (+4128674us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:17.428930 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:25:17.430202 31622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 945) took 3680 ms (client timeout 3152 ms). Trace:
W20260709 12:25:17.430465 31622 rpcz_store.cc:269] 0709 12:25:13.749861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.430038 (+3680177us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:17.430166 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:25:17.431164 31622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1124) took 2833 ms (client timeout 2670 ms). Trace:
W20260709 12:25:17.431382 31622 rpcz_store.cc:269] 0709 12:25:14.598002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.430994 (+2832992us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:17.431089 (+    95us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:17.433044 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1117) took 4398 ms. Trace:
I20260709 12:25:17.433624 31622 rpcz_store.cc:276] 0709 12:25:13.034843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.431875 (+4397032us) service_pool.cc:224] Handling call
0709 12:25:17.432419 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.432733 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.432747 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.432787 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.432821 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.432863 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.432948 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.435815 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1930) took 3655 ms. Trace:
I20260709 12:25:17.436149 30970 rpcz_store.cc:276] 0709 12:25:13.780257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.780383 (+   126us) service_pool.cc:224] Handling call
0709 12:25:13.780672 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.097387 (+316715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.435269 (+3337882us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54001e55d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:17.435568 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726993152}
W20260709 12:25:17.473300 31049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2236) took 3978 ms (client timeout 2021 ms). Trace:
W20260709 12:25:17.473789 31049 rpcz_store.cc:269] 0709 12:25:13.495009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.495408 (+   399us) service_pool.cc:224] Handling call
0709 12:25:17.472603 (+3977195us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540007c1d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:17.472980 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2519790976}
I20260709 12:25:17.476487 31049 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:25:17.477169 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2257) took 2858 ms. Trace:
I20260709 12:25:17.477443 31049 rpcz_store.cc:276] 0709 12:25:14.618620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.475144 (+2856524us) service_pool.cc:224] Handling call
0709 12:25:17.475826 (+   682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.476866 (+  1040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.477082 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.479328 31049 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:17.479974 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2258) took 2764 ms. Trace:
I20260709 12:25:17.480412 31049 rpcz_store.cc:276] 0709 12:25:14.716042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.478435 (+2762393us) service_pool.cc:224] Handling call
0709 12:25:17.478904 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.479650 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.479898 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.481866 31049 raft_consensus.cc:1240] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:17.482431 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2259) took 2699 ms. Trace:
I20260709 12:25:17.482753 31049 rpcz_store.cc:276] 0709 12:25:14.783193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.481084 (+2697891us) service_pool.cc:224] Handling call
0709 12:25:17.481517 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.482192 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.482381 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.530685  2039 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:17.539861  2183 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 3.759s	user 0.014s	sys 0.014s
W20260709 12:25:17.547111 30939 leader_election.cc:336] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.621s (SENT)
W20260709 12:25:17.551280 30939 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 2.021s (SENT) [suppressed 22 similar messages]
W20260709 12:25:17.553040 30939 connection.cc:256] RPC call timeout handler was delayed by -2.7014147869999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 12:25:17.553383 30939 connection.cc:256] RPC call timeout handler was delayed by -2.5721177370000987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 12:25:17.553602 30939 connection.cc:256] RPC call timeout handler was delayed by -2.5721177370000987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 12:25:17.554284 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:17.554888 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.571074 31046 raft_consensus.cc:2368] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6.
I20260709 12:25:17.584839 30900 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:17.586467 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.587276 30900 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:17.595062 30973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2260) took 2808 ms. Trace:
I20260709 12:25:17.593982 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:17.595669 30973 rpcz_store.cc:276] 0709 12:25:14.786267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.786374 (+   107us) service_pool.cc:224] Handling call
0709 12:25:14.787410 (+  1036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.584551 (+2797141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.584605 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.585301 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.592103 (+  6802us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.592136 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.592238 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.594270 (+  2032us) raft_consensus.cc:1685] finished
0709 12:25:17.594292 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.594907 (+   615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22214,"thread_start_us":6411,"threads_started":1,"wal-append.queue_time_us":6800}
I20260709 12:25:17.597183 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.601078  1688 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:17.601787  1688 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.602769 31048 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:17.603425 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2256) took 3003 ms. Trace:
I20260709 12:25:17.603708 31048 rpcz_store.cc:276] 0709 12:25:14.600050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.723486 (+123436us) service_pool.cc:224] Handling call
0709 12:25:17.602335 (+2878849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.603176 (+   841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.603361 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.604444  1688 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.604943  1688 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:17.605543  1688 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:17.606786 31618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 936) took 4464 ms (client timeout 2423 ms). Trace:
W20260709 12:25:17.607199 31618 rpcz_store.cc:269] 0709 12:25:13.142497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.600542 (+1458045us) service_pool.cc:224] Handling call
0709 12:25:17.606550 (+3006008us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b54005ee054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:17.606706 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109711232}
I20260709 12:25:17.611568  2120 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:17.612855 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:17.613484  2134 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:17.596149 30893 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.614408  2120 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:17.614782 30900 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:17.615006  2120 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:17.623971 30900 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:17.629093  2120 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.631285  2096 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:17.637115 30893 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:17.607611  1688 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:17.641151 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.651875 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1111) took 4618 ms. Trace:
W20260709 12:25:17.653462 31616 consensus_meta.cc:287] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 3.033s	user 0.017s	sys 0.008s
I20260709 12:25:17.652400 31621 rpcz_store.cc:276] 0709 12:25:13.033365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.033672 (+   307us) service_pool.cc:224] Handling call
0709 12:25:13.033975 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.044355 (+ 10380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.044383 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.044784 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.558717 (+513933us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.558761 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.558964 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.538794 (+3979830us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:17.650970 (+112176us) raft_consensus.cc:1685] finished
0709 12:25:17.650995 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.651630 (+   635us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83513,"raft.queue_time_us":11127,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9556,"spinlock_wait_cycles":35383680,"thread_start_us":429133,"threads_started":1,"wal-append.queue_time_us":644084}
I20260709 12:25:17.653980 31616 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:17.654834 31622 raft_consensus.cc:1240] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:17.657326 31013 connection.cc:256] RPC call timeout handler was delayed by -1.831608856999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 12:25:17.659646 31616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1119) took 3746 ms (client timeout 2097 ms). Trace:
W20260709 12:25:17.660226 31616 rpcz_store.cc:269] 0709 12:25:13.912000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.619445 (+707445us) service_pool.cc:224] Handling call
0709 12:25:17.656671 (+3037226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.662081 31616 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:17.662781 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 940) took 4519 ms. Trace:
I20260709 12:25:17.663072 31616 rpcz_store.cc:276] 0709 12:25:13.143606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.661046 (+4517440us) service_pool.cc:224] Handling call
0709 12:25:17.661655 (+   609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.662472 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.662729 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:14.779485 30867 leader_election.cc:336] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Timed out: RequestConsensusVote RPC to 127.29.9.4:39869 timed out after 1.821s (SENT)
W20260709 12:25:17.664134 31587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.052s	user 0.009s	sys 0.013s
I20260709 12:25:17.664543 30867 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:17.664938 31045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2245) took 4167 ms (client timeout 1696 ms). Trace:
W20260709 12:25:17.665318 31045 rpcz_store.cc:269] 0709 12:25:13.497417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.532760 (+ 35343us) service_pool.cc:224] Handling call
0709 12:25:17.657743 (+4124983us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54001c8c54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:17.664759 (+  7016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71858560}
W20260709 12:25:17.666009 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 2.88635e+06us
W20260709 12:25:17.669754 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.670744  2048 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:17.664548 31616 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:17.671458  2048 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.672379 31620 raft_consensus.cc:2368] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:17.673928  2048 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.674467  2048 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:17.674201 31620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 912) took 4373 ms (client timeout 1621 ms). Trace:
I20260709 12:25:17.676034  1980 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.676128 31620 rpcz_store.cc:269] 0709 12:25:13.300927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.756479 (+455552us) service_pool.cc:224] Handling call
0709 12:25:17.673943 (+3917464us) spinlock_profiling.cc:243] Waited 3.89 s on lock 0x7b54004d0154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:17.674134 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8950604160}
I20260709 12:25:17.676740  1980 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:17.678097 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 660) took 3909 ms. Trace:
I20260709 12:25:17.678491 30972 rpcz_store.cc:276] 0709 12:25:13.768221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.769748 (+  1527us) service_pool.cc:224] Handling call
0709 12:25:13.770041 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.893146 (+123105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.677597 (+3784451us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b540008c354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:17.677891 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221478144}
I20260709 12:25:17.678983 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 909) took 4379 ms. Trace:
I20260709 12:25:17.660439 31621 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:17.679970 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 939) took 4536 ms. Trace:
I20260709 12:25:17.680155  2232 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:17.680366 31621 rpcz_store.cc:276] 0709 12:25:13.143362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.657913 (+4514551us) service_pool.cc:224] Handling call
0709 12:25:17.660067 (+  2154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.679620 (+ 19553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.679877 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.681166  2232 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:17.682456 31621 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:17.683171 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 915) took 4379 ms. Trace:
W20260709 12:25:17.640991 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 46959us
W20260709 12:25:17.684149 31016 connection.cc:256] RPC call timeout handler was delayed by -2.2600837600002706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24230000000000002s for a response
I20260709 12:25:17.680408  1688 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:17.685089  1688 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.683454 31621 rpcz_store.cc:276] 0709 12:25:13.304053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.681462 (+4377409us) service_pool.cc:224] Handling call
0709 12:25:17.681989 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.682902 (+   913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.683116 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.684508 31016 connection.cc:256] RPC call timeout handler was delayed by -1.2414234010002474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31520000000000004s for a response
I20260709 12:25:17.675115  2048 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:17.664659 31587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.053s	user 0.009s	sys 0.013s
I20260709 12:25:17.683434  2232 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:17.690841 30867 connection.cc:256] RPC call timeout handler was delayed by -2.3962390260003303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 12:25:17.706799 31616 rpcz_store.cc:276] 0709 12:25:13.299850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.663833 (+4363983us) service_pool.cc:224] Handling call
0709 12:25:17.664280 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.671430 (+  7150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.678899 (+  7469us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.712494 30867 connection.cc:256] RPC call timeout handler was delayed by -1.4503137480000987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 12:25:17.712841 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 914) took 4409 ms. Trace:
I20260709 12:25:17.679112  1980 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:17.711444  2135 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:17.717186 31050 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:17.718201  1688 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.718466 31050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2240) took 4222 ms. Trace:
I20260709 12:25:17.718861 31050 rpcz_store.cc:276] 0709 12:25:13.496205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.862797 (+366592us) service_pool.cc:224] Handling call
0709 12:25:13.863065 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.717635 (+3854570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.718187 (+   552us) spinlock_profiling.cc:243] Waited 3.85 s on lock 0x7b540007cbd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:17.718411 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8862767488}
I20260709 12:25:17.711470  2034 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:17.720356  2048 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.720192  2034 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.724102  2034 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.724956 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.725647 30899 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:17.725819 31050 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:17.727221  2143 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.727346 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:17.728297 31050 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.733506  2105 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:17.734663 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:17.736084 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:17.737268 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:17.739869  1825 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:14.808506 31051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2244) took 1311 ms. Trace:
I20260709 12:25:17.742854 31051 rpcz_store.cc:276] 0709 12:25:13.497178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.533369 (+ 36191us) service_pool.cc:224] Handling call
0709 12:25:14.808295 (+1274926us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54000f4bd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:14.808442 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387592448}
I20260709 12:25:17.740106 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:17.744522 31050 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
W20260709 12:25:17.749601 30897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.677s	user 0.023s	sys 0.027s
W20260709 12:25:17.766502 30892 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.080s	user 0.005s	sys 0.025s
W20260709 12:25:17.766677 30897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.694s	user 0.023s	sys 0.027s
W20260709 12:25:17.767088 30892 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.089s	user 0.005s	sys 0.026s
I20260709 12:25:14.695870 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:17.767906 31617 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
W20260709 12:25:17.768461 31617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1125) took 3167 ms (client timeout 1800 ms). Trace:
W20260709 12:25:17.768895 31617 rpcz_store.cc:269] 0709 12:25:14.600762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.695537 (+ 94775us) service_pool.cc:224] Handling call
0709 12:25:17.768377 (+3072840us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:17.752296 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 3.14806e+06us
W20260709 12:25:17.769865 31623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1105) took 4740 ms (client timeout 1821 ms). Trace:
W20260709 12:25:17.770314 31623 rpcz_store.cc:269] 0709 12:25:13.029049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.029158 (+   109us) service_pool.cc:224] Handling call
0709 12:25:17.769491 (+4740333us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400583754. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:17.769658 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783063936}
I20260709 12:25:17.770687 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 922) took 4271 ms. Trace:
W20260709 12:25:14.733870 31588 leader_election.cc:336] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.677s (SENT)
I20260709 12:25:17.772396 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 942) took 4066 ms. Trace:
W20260709 12:25:17.772662 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 3.03848e+06us
I20260709 12:25:17.752153 30895 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.772933 31623 rpcz_store.cc:276] 0709 12:25:13.705811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.771163 (+4065352us) service_pool.cc:224] Handling call
0709 12:25:17.771516 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.771840 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.771992 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.772086 (+    94us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:17.772154 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.772219 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.772344 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.775784 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 943) took 4069 ms. Trace:
I20260709 12:25:17.776230 31623 rpcz_store.cc:276] 0709 12:25:13.706083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.774043 (+4067960us) service_pool.cc:224] Handling call
0709 12:25:17.774427 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.774672 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.774695 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.775478 (+   783us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:17.775545 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.775604 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.775714 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.771059 31617 rpcz_store.cc:276] 0709 12:25:13.499473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.769575 (+4270102us) service_pool.cc:224] Handling call
0709 12:25:17.770015 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.770371 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.770397 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.770447 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:17.770496 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.770544 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.770640 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.781719 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:17.771129  2188 raft_consensus.cc:3055] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:17.783088  2188 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:17.770531 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:17.784260  2188 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:17.785463  2188 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.755266 31616 raft_consensus.cc:1240] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:17.759315  1944 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.786357 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 918) took 4481 ms. Trace:
I20260709 12:25:17.786211  1944 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:17.760135 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:17.787225 30899 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.787906  1825 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.760891  2034 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.761431 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.788774  2034 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:17.789443 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.790935  2034 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:17.762712 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:17.773420 30968 consensus_meta.cc:287] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 3.855s	user 0.016s	sys 0.014s
I20260709 12:25:17.786785 31616 rpcz_store.cc:276] 0709 12:25:13.304794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.714109 (+4409315us) service_pool.cc:224] Handling call
0709 12:25:17.754886 (+ 40777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.786054 (+ 31168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.786281 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.715358 31620 rpcz_store.cc:276] 0709 12:25:13.303798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.677309 (+4373511us) service_pool.cc:224] Handling call
0709 12:25:17.677849 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.684739 (+  6890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.684766 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.685374 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.708148 (+ 22774us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:17.708190 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.708266 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.710076 (+  1810us) raft_consensus.cc:1685] finished
0709 12:25:17.710101 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.711105 (+  1004us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5819,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":22325,"threads_started":1,"wal-append.queue_time_us":22657}
I20260709 12:25:17.822444 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1921) took 3718 ms. Trace:
I20260709 12:25:17.838898 30892 rpcz_store.cc:276] 0709 12:25:14.103567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.495041 (+391474us) service_pool.cc:224] Handling call
0709 12:25:14.613460 (+118419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.613674 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:17.767571 (+3153897us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.821986 (+ 54415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.822060 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:17.822137 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.822242 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.822359 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1552282,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"thread_start_us":3143106,"threads_started":2}
I20260709 12:25:17.854234 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:17.823565  2135 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:17.857208  2135 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:17.860033 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.860877 30900 raft_consensus.cc:2410] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:17.861547 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:17.837029 30968 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:17.871215 30900 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:25:17.880494 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.881003 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:17.885455 30971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.802s	user 0.000s	sys 0.022s
I20260709 12:25:17.889109 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.890064 31050 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
W20260709 12:25:17.891428 30971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.819s	user 0.000s	sys 0.023s
W20260709 12:25:17.886376 30968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 659) took 4106 ms (client timeout 2104 ms). Trace:
I20260709 12:25:17.892482 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2258) took 3108 ms. Trace:
I20260709 12:25:17.892563 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:17.893229 31049 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:17.893963 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 113372us
W20260709 12:25:17.897315 30969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 652) took 4881 ms (client timeout 1677 ms). Trace:
W20260709 12:25:17.897787 30969 rpcz_store.cc:269] 0709 12:25:13.016222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.017940 (+  1718us) service_pool.cc:224] Handling call
0709 12:25:17.896855 (+4878915us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54001b9ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:17.897087 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949613824}
I20260709 12:25:17.892879 30971 rpcz_store.cc:276] 0709 12:25:14.784508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.784654 (+   146us) service_pool.cc:224] Handling call
0709 12:25:14.785262 (+   608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:14.789177 (+  3915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.789210 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:14.854737 (+ 65527us) log.cc:844] Serialized 52 byte log entry
0709 12:25:17.891996 (+3037259us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.892079 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.892182 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.892235 (+    53us) raft_consensus.cc:1685] finished
0709 12:25:17.892249 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.892416 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3420,"raft.queue_time_us":23158,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":2819428,"threads_started":1,"wal-append.queue_time_us":1185780,"wal-append.run_cpu_time_us":1842,"wal-append.run_wall_time_us":1001838}
I20260709 12:25:17.905652 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:17.906598 31042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2254) took 3307 ms (client timeout 2018 ms). Trace:
W20260709 12:25:17.906929 31042 rpcz_store.cc:269] 0709 12:25:14.599054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.679275 (+ 80221us) service_pool.cc:224] Handling call
0709 12:25:17.906517 (+3227242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.908233 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:17.892968 31048 raft_consensus.cc:2368] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
W20260709 12:25:17.892117 30968 rpcz_store.cc:269] 0709 12:25:13.767939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.828994 (+ 61055us) service_pool.cc:224] Handling call
0709 12:25:17.870556 (+4041562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:17.907152 31049 raft_consensus.cc:2410] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:17.920692 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:17.940999 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:18.004274 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.008661  2134 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:17.945220 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.041973 30895 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:18.046816 31048 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:18.008771 31042 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:17.943451 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 944) took 4234 ms. Trace:
I20260709 12:25:18.045331 31050 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:17.942916 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:17.943051 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1922) took 3839 ms. Trace:
I20260709 12:25:17.922930 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:17.935281 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:18.011060 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:18.005398 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 935) took 4863 ms. Trace:
I20260709 12:25:18.024161 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1120) took 4111 ms. Trace:
I20260709 12:25:18.052538 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 946) took 4264 ms. Trace:
I20260709 12:25:18.053252 31617 rpcz_store.cc:276] 0709 12:25:13.784367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.780108 (+3995741us) service_pool.cc:224] Handling call
0709 12:25:17.780541 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.780876 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.780905 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.781558 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.838139 (+ 56581us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:17.838173 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.838247 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.048197 (+209950us) raft_consensus.cc:1685] finished
0709 12:25:18.048225 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.048340 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":56174,"threads_started":1,"wal-append.queue_time_us":98858}
I20260709 12:25:18.051301 31616 rpcz_store.cc:276] 0709 12:25:13.912258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.837586 (+3925328us) service_pool.cc:224] Handling call
0709 12:25:17.881173 (+ 43587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.931123 (+ 49950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.931157 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.931207 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:17.931240 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.931300 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.024078 (+ 92778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.051093 31622 rpcz_store.cc:276] 0709 12:25:13.142194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.435158 (+4292964us) service_pool.cc:224] Handling call
0709 12:25:17.654569 (+219411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.655261 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.005160 (+349899us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54005fee50. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:18.005319 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503398272}
I20260709 12:25:18.057315 31617 pending_rounds.cc:85] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 8
I20260709 12:25:18.057690 31617 pending_rounds.cc:107] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:25:17.944294 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:18.008436  2135 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:18.007911  1825 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.059593 31617 raft_consensus.cc:2889] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.048915 31623 rpcz_store.cc:276] 0709 12:25:13.706349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.777390 (+4071041us) service_pool.cc:224] Handling call
0709 12:25:17.777966 (+   576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.778448 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:17.855563 (+ 77115us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.940583 (+ 85020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.940634 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.940672 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.940731 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.940855 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73,"prepare.queue_time_us":113278,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":10600,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2258,"thread_start_us":94266,"threads_started":2}
I20260709 12:25:18.069769 30900 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:18.053989  2134 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.071557  2233 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:18.072036  2233 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.072381  2233 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.072876  2134 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.049453 30897 rpcz_store.cc:276] 0709 12:25:14.103803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.602340 (+498537us) service_pool.cc:224] Handling call
0709 12:25:14.602647 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.602856 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:15.072249 (+469393us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.869666 (+2797417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.888015 (+ 18349us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:17.911472 (+ 23457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.919285 (+  7813us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.942990 (+ 23705us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":855,"prepare.queue_time_us":1562878,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":143122,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":29574,"thread_start_us":3255974,"threads_started":3,"wal-append.queue_time_us":1199170,"wal-append.run_cpu_time_us":1203,"wal-append.run_wall_time_us":1001197}
W20260709 12:25:18.069408 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 160225us
W20260709 12:25:14.685871 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 226237us
I20260709 12:25:18.092584 30901 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:25:18.092835 31619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1104) took 5064 ms (client timeout 1670 ms). Trace:
I20260709 12:25:18.093997 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1109) took 5061 ms. Trace:
I20260709 12:25:18.094712 31618 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:18.097009 31043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 635) took 5069 ms. Trace:
I20260709 12:25:18.099889 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:15.070565 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 637) took 1203 ms. Trace:
W20260709 12:25:18.115232 31619 rpcz_store.cc:269] 0709 12:25:13.028371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.028542 (+   171us) service_pool.cc:224] Handling call
0709 12:25:18.092391 (+5063849us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b540065dbd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:18.092652 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626503552}
I20260709 12:25:18.116595 31043 rpcz_store.cc:276] 0709 12:25:13.027349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.027454 (+   105us) service_pool.cc:224] Handling call
0709 12:25:13.052277 (+ 24823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.066390 (+1014113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.096473 (+4030083us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54001595d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:18.096798 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026170624}
I20260709 12:25:18.100046  1825 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.101832  1944 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:18.103960 31014 connection.cc:256] RPC call timeout handler was delayed by -2.5412862149996727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 12:25:18.104414  2246 log.cc:927] Time spent T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:25:18.105006 31046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2248) took 3512 ms (client timeout 1513 ms). Trace:
I20260709 12:25:18.104887 30893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c42f8452db3546feaba1bef22141480f"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:18.138885 30893 raft_consensus.cc:606] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:18.106277 30865 connection.cc:256] RPC call timeout handler was delayed by -3.6709080579998954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 12:25:18.108198 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 640) took 4239 ms. Trace:
I20260709 12:25:18.108723  2139 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:18.110844 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1126) took 3502 ms. Trace:
I20260709 12:25:18.149441 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:18.150426 31050 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 11: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:18.140501 30898 rpcz_store.cc:276] 0709 12:25:13.868570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.871342 (+  2772us) service_pool.cc:224] Handling call
0709 12:25:13.871618 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.308295 (+3436677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.107904 (+799609us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b5400099054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:18.108124 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7900852992}
W20260709 12:25:18.151597 31014 connection.cc:256] RPC call timeout handler was delayed by -2.1367093640001258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2405s for a response
W20260709 12:25:18.152031 31014 connection.cc:256] RPC call timeout handler was delayed by -1.0257751519998237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3093s for a response
I20260709 12:25:18.151965  2139 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:18.116832 30896 rpcz_store.cc:276] 0709 12:25:13.867239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.867385 (+   146us) service_pool.cc:224] Handling call
0709 12:25:13.869074 (+  1689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.869380 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:13.869408 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.869808 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 12:25:14.595564 (+725756us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:14.595604 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.595667 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.070325 (+474658us) raft_consensus.cc:1685] finished
0709 12:25:15.070348 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.070491 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":714,"raft.queue_time_us":28394,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3080,"thread_start_us":725376,"threads_started":1,"wal-append.queue_time_us":1198793,"wal-append.run_cpu_time_us":1581,"wal-append.run_wall_time_us":1001611}
I20260709 12:25:18.113366 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:18.114476 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.116297 30899 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:18.118770 31045 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 6: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:18.141203 30865 connection.cc:256] RPC call timeout handler was delayed by -3.3649752960000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 12:25:18.138324 31046 rpcz_store.cc:269] 0709 12:25:14.592338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.613026 (+ 20688us) service_pool.cc:224] Handling call
0709 12:25:18.104804 (+3491778us) spinlock_profiling.cc:243] Waited 2.94 s on lock 0x7b540015b3d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:18.104943 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6768178944}
W20260709 12:25:18.154022 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.115906 31624 rpcz_store.cc:276] 0709 12:25:13.032706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.032811 (+   105us) service_pool.cc:224] Handling call
0709 12:25:13.033084 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.045670 (+ 12586us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:13.045698 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.051426 (+  5728us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.260111 (+208685us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.260150 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.260214 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.121916 (+3861702us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:18.093516 (+971600us) raft_consensus.cc:1685] finished
0709 12:25:18.093536 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.093816 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98669,"raft.queue_time_us":98,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":25530,"spinlock_wait_cycles":15173504,"thread_start_us":113560,"threads_started":1,"wal-append.queue_time_us":428501}
I20260709 12:25:18.148903 31623 rpcz_store.cc:276] 0709 12:25:14.608411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.070454 (+3462043us) service_pool.cc:224] Handling call
0709 12:25:18.110214 (+ 39760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.110492 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.110522 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.110560 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:18.110632 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.110680 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.110785 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.112177 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.173844 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.152706  2048 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.112103  2142 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:18.068429  2188 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.365164 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1123) took 4452 ms. Trace:
I20260709 12:25:18.177502 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1122) took 4264 ms. Trace:
W20260709 12:25:18.181715 30865 connection.cc:256] RPC call timeout handler was delayed by -3.2083408180001243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 12:25:18.184116 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 289422us
I20260709 12:25:18.365648 31622 rpcz_store.cc:276] 0709 12:25:13.912942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.057094 (+4144152us) service_pool.cc:224] Handling call
0709 12:25:18.057562 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:18.192457 (+134895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.192492 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:18.197098 (+  4606us) log.cc:844] Serialized 52 byte log entry
0709 12:25:18.243959 (+ 46861us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:18.243995 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.244080 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.364904 (+120824us) raft_consensus.cc:1685] finished
0709 12:25:18.364924 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.365098 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":173203,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":157847,"threads_started":2,"wal-append.queue_time_us":158371}
I20260709 12:25:18.367816 30864 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:18.186445 31043 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:18.187698 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1127) took 3561 ms. Trace:
I20260709 12:25:18.193517 31048 raft_consensus.cc:1240] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:18.195933 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:15.159086 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.205157 31042 raft_consensus.cc:2393] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:18.217689 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 633) took 5190 ms. Trace:
I20260709 12:25:18.208240 31047 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:18.223392  2139 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.207912 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.225346  2134 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:18.226826 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.229627  2233 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:18.211882 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.230247  2252 log.cc:927] Time spent T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.224s	user 0.004s	sys 0.005s
W20260709 12:25:18.236793 31588 connection.cc:256] RPC call timeout handler was delayed by -2.4287298180001926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 12:25:18.372185 31588 connection.cc:256] RPC call timeout handler was delayed by -2.2756962670000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 12:25:18.372502 31588 connection.cc:256] RPC call timeout handler was delayed by -2.1641298180002195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:25:18.372769 31588 connection.cc:256] RPC call timeout handler was delayed by -2.1173298180001439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:25:18.373026 31588 connection.cc:256] RPC call timeout handler was delayed by -1.9840962670000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 12:25:18.373293 31588 connection.cc:256] RPC call timeout handler was delayed by -1.7377307470001142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:25:18.373548 31588 connection.cc:256] RPC call timeout handler was delayed by -1.6516645410001729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:25:18.373829 31588 connection.cc:256] RPC call timeout handler was delayed by -1.5388307470002474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 12:25:18.374092 31588 connection.cc:256] RPC call timeout handler was delayed by -1.5237043059996722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 12:25:18.374433 31588 connection.cc:256] RPC call timeout handler was delayed by -1.2349800060001144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
I20260709 12:25:18.224395 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.209431 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:18.239009 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 183403us
W20260709 12:25:18.239776 31587 connection.cc:256] RPC call timeout handler was delayed by -2.63823487100035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 12:25:18.375880 31587 connection.cc:256] RPC call timeout handler was delayed by -2.3944934460000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 12:25:18.376176 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.376967 31622 raft_consensus.cc:2393] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:18.245038  2259 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.377938  2259 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.380213  2259 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:25:18.243842  2048 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.380867 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:18.382187  2048 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:18.382403 30899 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:18.245719 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.383759 31051 raft_consensus.cc:2410] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:18.261650 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 917) took 4957 ms. Trace:
I20260709 12:25:18.258221 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1121) took 4345 ms. Trace:
I20260709 12:25:18.269460  2238 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:18.384296 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.384729  2238 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.384135 31621 rpcz_store.cc:276] 0709 12:25:13.304536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.712374 (+4407838us) service_pool.cc:224] Handling call
0709 12:25:17.796871 (+ 84497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.817151 (+ 20280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.817179 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:17.817736 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.888451 (+ 70715us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:17.888489 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.888562 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.927344 (+ 38782us) raft_consensus.cc:1685] finished
0709 12:25:17.927364 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.261398 (+334034us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b5400583750. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:18.261599 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":946,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":35551,"spinlock_wait_cycles":116182784,"thread_start_us":32911,"threads_started":1,"wal-append.queue_time_us":99698}
I20260709 12:25:18.386969  2238 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:18.296770 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.332466 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 938) took 5189 ms. Trace:
I20260709 12:25:18.387558 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.387873 31618 rpcz_store.cc:276] 0709 12:25:13.143127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.611489 (+4468362us) service_pool.cc:224] Handling call
0709 12:25:18.094402 (+482913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.116218 (+ 21816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.330539 (+214321us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540065dbd0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:18.332394 (+  1855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109385984}
I20260709 12:25:18.369230 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.388901 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.389339 31043 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:18.392169 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:18.392776 30896 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.394191 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:18.394937 30898 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 11: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:18.368716 31620 rpcz_store.cc:276] 0709 12:25:14.626794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.095525 (+3468731us) service_pool.cc:224] Handling call
0709 12:25:18.095961 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.096203 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:18.096543 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.187368 (+ 90825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.187420 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:18.187467 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.187530 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.187638 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":814,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":57767,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":89963,"threads_started":1,"wal-append.queue_time_us":135368}
I20260709 12:25:18.396150 30899 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:18.383598 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.365801 31616 rpcz_store.cc:276] 0709 12:25:13.912706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.057660 (+4144954us) service_pool.cc:224] Handling call
0709 12:25:18.062365 (+  4705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.141743 (+ 79378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.141775 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.160471 (+ 18696us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:18.177244 (+ 16773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.177326 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.177449 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.400556 31050 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:18.404385 30864 leader_election.cc:400] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:18.404726 30864 leader_election.cc:403] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:18.405840  1950 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:18.406513 30865 connection.cc:256] RPC call timeout handler was delayed by -1.1605666430000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4699s for a response
I20260709 12:25:18.406369  1950 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.407263 30865 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:18.408946  1993 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:18.409597  1993 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.409950 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:18.411988  2253 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.412285  2134 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.412550  2253 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:18.415035  2253 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:18.401158 31617 rpcz_store.cc:276] 0709 12:25:13.912483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.054891 (+4142408us) service_pool.cc:224] Handling call
0709 12:25:18.057006 (+  2115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.080112 (+ 23106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.080141 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.086725 (+  6584us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.233435 (+146710us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:18.233469 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.233543 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.257999 (+ 24456us) raft_consensus.cc:1685] finished
0709 12:25:18.258017 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.258158 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":123639,"threads_started":1,"wal-append.queue_time_us":146468}
W20260709 12:25:18.332018 30939 connection.cc:256] RPC call timeout handler was delayed by -2.369617737000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2358s for a response
W20260709 12:25:18.417286 30939 connection.cc:256] RPC call timeout handler was delayed by -1.5993095490002815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 12:25:18.417635 30939 connection.cc:256] RPC call timeout handler was delayed by -1.5876095490002626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:25:18.417896 30939 connection.cc:256] RPC call timeout handler was delayed by -1.4886095490001026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:25:18.418171 30939 connection.cc:256] RPC call timeout handler was delayed by -1.4211095489999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 12:25:18.418433 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3923095490004016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 12:25:18.418691 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3743095490003725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 12:25:18.418951 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3491095490003318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 12:25:18.419212 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3491095490003318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 12:25:18.419471 30939 connection.cc:256] RPC call timeout handler was delayed by -1.3482095490003303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:25:18.419899 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2762095490002139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:25:18.420197 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2537095490001775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 12:25:18.420459 30939 connection.cc:256] RPC call timeout handler was delayed by -1.2492095490001702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:25:18.420719 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1628942000002098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:25:18.420979 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1628942000002098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:25:18.421291 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1448095490000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 12:25:18.421558 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1448095490000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 12:25:18.421826 30939 connection.cc:256] RPC call timeout handler was delayed by -1.1385095489999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 12:25:18.402657 31047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 641) took 4611 ms (client timeout 2104 ms). Trace:
I20260709 12:25:18.428431 31045 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:18.408469  2240 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:18.425890 31047 rpcz_store.cc:269] 0709 12:25:13.762145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.851126 (+ 88981us) service_pool.cc:224] Handling call
0709 12:25:18.113092 (+4261966us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b580017fa98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:25:18.373751 (+260659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33838848}
I20260709 12:25:18.430142 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:18.370199 31044 rpcz_store.cc:276] 0709 12:25:13.026817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.026949 (+   132us) service_pool.cc:224] Handling call
0709 12:25:13.046832 (+ 19883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.177196 (+130364us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:13.177225 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.515096 (+337871us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b2c00042028. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032ef26a11 00007f032ef36372 00007f0330668a01 00007f033062d43a 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2
0709 12:25:13.522955 (+  7859us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.751011 (+228056us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.751046 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.217179 (+4466133us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002a6054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:18.217255 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.217310 (+    55us) raft_consensus.cc:1685] finished
0709 12:25:18.217322 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.217533 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313326592,"thread_start_us":205988,"threads_started":1,"wal-append.queue_time_us":318498,"wal-append.run_cpu_time_us":4586,"wal-append.run_wall_time_us":1228257}
I20260709 12:25:18.365406  2188 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:18.415585  2253 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:18.436803 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 59056.6us
I20260709 12:25:18.428081  2139 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:18.405866  2241 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:18.422660  2135 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.417034  1993 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:18.425218  2048 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:18.422719  2134 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:18.447410 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 238053us
I20260709 12:25:18.449121  2239 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:18.451128  2048 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.453524  2142 consensus_queue.cc:1059] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:18.455647 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.450117  2240 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.445928  2139 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.456423 31616 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.456727  2139 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.457443  1688 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:18.459226  1950 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:18.446100  2241 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.459983  2241 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.447268  2257 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.461463  2257 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.461354 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.464076 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.464833 31617 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:18.438992  2259 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.470037  2142 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:18.470403  2142 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:18.471101  2142 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.471359  2273 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:18.476423 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.463680  2257 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:18.479051  2264 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:18.483456  2257 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:18.483843  2257 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:18.484393  2233 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:18.485029  2233 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.484761  2257 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.485407  2233 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:18.486124 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.486296  2233 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:18.486948 31622 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:18.487082  2259 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.487237 30894 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.156797  1825 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.494194  2259 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:18.489006  2240 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:18.489540 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.495112 31620 raft_consensus.cc:1275] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:18.495656 31617 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:18.498807  2139 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:18.499191 30894 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:18.504453 31616 raft_consensus.cc:2468] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:18.512209 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:18.513762 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 59835.6us
I20260709 12:25:18.516127 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.519336 31047 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:18.520653 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58904.9us
W20260709 12:25:18.523481 31615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44882 (request call id 1115) took 5489 ms (client timeout 4699 ms). Trace:
I20260709 12:25:18.523846 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:18.523905 31615 rpcz_store.cc:269] 0709 12:25:13.034394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.114135 (+ 79741us) service_pool.cc:224] Handling call
0709 12:25:18.523144 (+5409009us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54004a1fd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:18.523292 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484231040}
I20260709 12:25:18.528364  2257 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.532558  2233 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.533985 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.534750 31622 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:18.538944  2259 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:18.539587  2259 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.539215 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.541261 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.541831 31621 raft_consensus.cc:2376] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9. Re-sending same reply.
I20260709 12:25:18.540069 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.556038 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.556943 31618 raft_consensus.cc:2410] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:18.568838 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.569747 31617 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:18.572940 31621 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:25:18.573356 31621 pending_rounds.cc:85] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 8
I20260709 12:25:18.573568 31621 pending_rounds.cc:107] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:25:18.573789 31621 raft_consensus.cc:2889] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.587574 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.588361 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:18.589983 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.599852 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.757718 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 292524us
W20260709 12:25:18.760025 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 237875us
I20260709 12:25:18.763739 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.768743 31622 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:18.766350 31616 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:18.787240  2279 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.787937  2279 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:18.790702  2279 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.798830  1825 consensus_queue.cc:1059] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:18.804131  2274 raft_consensus.cc:3055] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:18.804566  2274 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:18.805577  2274 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.812471 31615 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:18.818967 31615 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:18.819378 31615 pending_rounds.cc:85] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 7
I20260709 12:25:18.819443  2259 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:18.822832 31615 pending_rounds.cc:107] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:18.823154 31615 raft_consensus.cc:2889] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.824594 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.825377 31615 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:18.827491 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:18.829851 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.813629  2241 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.832537  2241 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:18.833611  2188 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.833842  2139 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.830483 31621 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:18.888835 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 93170.7us
W20260709 12:25:18.889910 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.888748 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:18.891086 31621 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:18.897490 31615 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:18.889096  2139 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.898850  2120 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.899323  2139 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:18.900550 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2261) took 4114 ms. Trace:
I20260709 12:25:18.902002  2139 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.900993 30970 rpcz_store.cc:276] 0709 12:25:14.786542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.437020 (+2650478us) service_pool.cc:224] Handling call
0709 12:25:17.437463 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.398468 (+961005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.398502 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.439773 (+ 41271us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.838779 (+399006us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:18.838816 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.838884 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.900327 (+ 61443us) raft_consensus.cc:1685] finished
0709 12:25:18.900346 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.900479 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":826753,"raft.queue_time_us":970700,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"spinlock_wait_cycles":58624,"thread_start_us":177832,"threads_started":2,"wal-append.queue_time_us":102400}
I20260709 12:25:18.902835  2232 raft_consensus.cc:3055] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.904213  2232 raft_consensus.cc:740] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:18.902972  2282 consensus_queue.cc:1059] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:18.903301 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.903604 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.906255  2232 consensus_queue.cc:260] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.907297  2232 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.909389  2048 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:18.912119 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.912660 31622 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:18.912915 31621 raft_consensus.cc:2368] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:18.914148 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:18.914390 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:18.914717 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.914984 31621 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 11: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:18.915354  2278 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.915450 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.916467 31016 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:18.917918 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.921903 31047 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:18.922461 31620 raft_consensus.cc:2410] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:18.923264  2273 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:18.923862  2273 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:18.925040  2273 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.921859 31016 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:18.929908  2278 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.931339 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:18.932170 31047 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:18.939785  2264 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.940145 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.940577  2264 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.939891  2282 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.941721 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:18.942272  2282 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.942874 31042 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:18.940156 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.944609  2282 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:18.944929 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.945686  2264 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:18.944500  2257 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:18.946388  2257 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:18.946764  2257 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:18.949620 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:18.947569 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2259) took 4161 ms. Trace:
I20260709 12:25:18.952430 30901 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:18.955482 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:18.956328 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:18.957794 31016 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:18.952521 30975 rpcz_store.cc:276] 0709 12:25:14.785853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.785985 (+   132us) service_pool.cc:224] Handling call
0709 12:25:14.787313 (+  1328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.557248 (+2769935us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:17.558314 (+  1066us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.428620 (+870306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.428683 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:18.428726 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.947213 (+518487us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54000212d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:18.947254 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.947417 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":693125,"prepare.queue_time_us":1011,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"spinlock_wait_cycles":6369255808,"thread_start_us":174281,"threads_started":3,"wal-append.queue_time_us":10754,"wal-append.run_cpu_time_us":1400,"wal-append.run_wall_time_us":1002967}
I20260709 12:25:18.958339  2139 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:18.962555  2139 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.962807  2120 consensus_queue.cc:1048] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:18.956990  2278 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:25:18.959975  2233 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:18.965138  2233 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:18.966081  2233 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.958171  2048 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:25:18.967906  2139 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.974463 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:18.957250  2282 consensus_queue.cc:1059] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:25:18.981777  2282 raft_consensus.cc:3055] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:18.982160  2282 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:18.982813  2257 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.983038  2282 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:18.990226  2257 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:18.990358  2282 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.984108  2139 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:18.985126 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.996138 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:18.957381  2273 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:25:18.997370 31047 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:19.010434 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.012141 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.014266 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.014823 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.015479 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.016121 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.016844 30898 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:19.017978 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.019763 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.020066 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.020800 30898 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:19.021770 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.024003 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.024712 30894 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:19.025524 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.026178 30901 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:19.026695  2139 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:19.029348 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.029121 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:19.029873 31622 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.031831 31047 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:19.036111 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:19.036720 31622 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:19.037393 31044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:19.037966 31044 raft_consensus.cc:606] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:19.038376 31044 raft_consensus.cc:614] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:19.049577 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:19.051095 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:18.959157  2232 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:19.037894 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.052574 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:19.054036  2139 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:19.055318  2282 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:19.060500  2139 raft_consensus.cc:697] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:19.061942  2139 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.063534  2274 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:19.068547  2037 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.069180  2037 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:19.073133 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 639418us
I20260709 12:25:19.074322  2241 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:19.075075 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:19.078831  2240 consensus_queue.cc:1059] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:19.080039  2241 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:19.080415  2241 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:19.081322  2241 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.082381  2241 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.084570 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:19.062974  2282 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:19.097280  2037 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:19.112347 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48950.1us
I20260709 12:25:19.113554 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:19.114289 31047 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:19.124092 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:19.127266 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:19.127523 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:19.124831 31044 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
W20260709 12:25:19.134191 30896 consensus_meta.cc:287] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.009s
I20260709 12:25:19.135588 30896 raft_consensus.cc:2410] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:25:19.470410 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.470945 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.458997  2282 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.458413  2241 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:19.375185  2259 raft_consensus.cc:3055] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:19.702849  2259 raft_consensus.cc:740] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:25:19.754890 30864 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.003s	sys 0.007s
W20260709 12:25:19.755395 30864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.004s	sys 0.007s
I20260709 12:25:19.723418  2241 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:19.765730 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.011s
W20260709 12:25:19.767307 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.000s	sys 0.012s
W20260709 12:25:19.768579 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 655380us
I20260709 12:25:19.762705  2240 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.766062  2232 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.000s	sys 0.012s
W20260709 12:25:19.785501 30895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 638) took 5915 ms (client timeout 2140 ms). Trace:
W20260709 12:25:19.785946 30895 rpcz_store.cc:269] 0709 12:25:13.867687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.867834 (+   147us) service_pool.cc:224] Handling call
0709 12:25:18.431814 (+4563980us) spinlock_profiling.cc:243] Waited 3.83 s on lock 0x7b54000325d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:19.782925 (+1351111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8817798528}
I20260709 12:25:19.788493  2297 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.789131  2297 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:19.791400  2297 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:19.801369 30939 leader_election.cc:336] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.513s (SENT)
I20260709 12:25:19.821489 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:19.802768 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.822479 30896 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:19.808648  2241 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:19.803848  2259 consensus_queue.cc:260] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.824532  2259 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.784184  2240 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.829879  2240 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:19.813807 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:19.831272 30895 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
W20260709 12:25:19.829879 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.833284 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48671.2us
I20260709 12:25:19.835083 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:19.837755  1688 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.851503  1688 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.853572  1688 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:19.847388  2125 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:19.854292  2125 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.856320  2125 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:19.849272 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.857061 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.857630  2274 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:19.858150  2274 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.859053 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:19.860239  2274 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:19.860802  2274 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:19.861264  2274 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.863168  2274 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:19.873734  2142 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:19.880102 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.883683  2134 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:19.884238  2134 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.886320  2134 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:19.887805  1944 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:19.888537  1944 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:19.890553 30867 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:19.891346  2240 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.893944 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:19.895802 30864 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:19.895991  2076 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:19.901855  2232 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.012s
I20260709 12:25:19.910903  2240 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:19.912510  2240 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.911406 30867 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:19.913888  1944 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:19.914358  1944 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:19.915072  2240 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:19.915211  1944 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.900529  2076 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:19.917721  2076 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:19.913405 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.919915 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.921077 31618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.002s	sys 0.014s
W20260709 12:25:19.921430 31618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.002s	sys 0.014s
I20260709 12:25:19.922027  2278 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:19.922555  2278 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.924141 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:19.908644  2298 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:19.924752 31049 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:19.924991  2298 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.925354  2298 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:19.928181 31622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.000s	sys 0.025s
I20260709 12:25:19.928356 31050 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:19.929602 31622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.000s	sys 0.026s
I20260709 12:25:19.929316 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.932190 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.937120 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:19.938524 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 96188.7us
I20260709 12:25:19.946416 31013 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:19.947317 30865 leader_election.cc:336] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.828s (SENT)
I20260709 12:25:19.948009  2297 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:19.932968  2278 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:19.949092 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:19.951095  1688 consensus_queue.cc:1059] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:19.948702  1944 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:19.952175  2139 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:19.952613  1944 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:19.954209 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:19.952950 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08001bbd00 after lost signal to thread 29735
I20260709 12:25:19.954756 31048 raft_consensus.cc:1813] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Handling vote request from an unknown peer 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:19.955313 31048 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:25:19.955461 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08003820e0 after lost signal to thread 30833
I20260709 12:25:19.955093  1944 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:19.950313  2233 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.956288  1944 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:19.956770 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08002060e0 after lost signal to thread 30925
W20260709 12:25:19.957049 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08002cef60 after lost signal to thread 30926
W20260709 12:25:19.958038 31646 debug-util.cc:398] Leaking SignalData structure 0x7b080020e6c0 after lost signal to thread 31000
W20260709 12:25:19.958256 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca000 after lost signal to thread 31001
I20260709 12:25:19.958294 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:19.959414 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2780 after lost signal to thread 31075
W20260709 12:25:19.960502 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08003af560 after lost signal to thread 31649
W20260709 12:25:19.960925 31646 debug-util.cc:398] Leaking SignalData structure 0x7b080035a9a0 after lost signal to thread 2032
W20260709 12:25:19.961150 31646 debug-util.cc:398] Leaking SignalData structure 0x7b0800361620 after lost signal to thread 2033
W20260709 12:25:19.961421 31646 debug-util.cc:398] Leaking SignalData structure 0x7b0800346040 after lost signal to thread 2096
W20260709 12:25:19.961627 31646 debug-util.cc:398] Leaking SignalData structure 0x7b080029f540 after lost signal to thread 2105
W20260709 12:25:19.961911 31646 debug-util.cc:398] Leaking SignalData structure 0x7b0800385120 after lost signal to thread 2131
W20260709 12:25:19.962139 31646 debug-util.cc:398] Leaking SignalData structure 0x7b080037d460 after lost signal to thread 2138
W20260709 12:25:19.962384 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6700 after lost signal to thread 2143
W20260709 12:25:19.962590 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8200 after lost signal to thread 2147
W20260709 12:25:19.962852 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.952167  2278 raft_consensus.cc:3055] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:19.953894  2076 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:19.963268  2278 raft_consensus.cc:740] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:19.964217  2134 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:19.964184  2278 consensus_queue.cc:260] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:19.964363 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:19.967236 31587 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:19.967401  2076 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:19.968591  2278 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:19.959553 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:19.962822 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf200 after lost signal to thread 2167
I20260709 12:25:19.950635 30864 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:19.974828 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08002c18e0 after lost signal to thread 2179
W20260709 12:25:19.975133 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6e80 after lost signal to thread 2185
W20260709 12:25:19.975409 31646 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1e20 after lost signal to thread 2207
I20260709 12:25:19.976634  2134 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.976763  2282 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:19.977380  2282 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:19.977658  2270 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:19.978242  2270 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.976712  2076 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:19.986301 31587 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:19.979352  2266 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.988019  2268 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.001266  2268 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.980646  2282 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:19.988559 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:19.989460  2134 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.003587  2134 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.003942  2134 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.004314 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.005613  2274 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.984233  2270 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:19.990434 31013 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:20.019356  2309 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:20.019861  2311 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.020048  2309 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.020377  2311 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:20.022375 30895 raft_consensus.cc:1240] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:20.023041  2309 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:19.987027  2076 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.024236  2076 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.024529 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.026924 30901 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:19.991562  2233 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:25:19.994480  2112 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.007s	sys 0.016s
W20260709 12:25:20.029119  2112 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.008s	sys 0.017s
I20260709 12:25:20.029260 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.031070 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.032305 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.034060 31616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 959) took 1496 ms. Trace:
I20260709 12:25:20.034417 31616 rpcz_store.cc:276] 0709 12:25:18.538021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.753561 (+215540us) service_pool.cc:224] Handling call
0709 12:25:20.033878 (+1280317us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b54004c04d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:20.033977 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4199296}
I20260709 12:25:20.041399 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.044253 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:20.045269 30892 raft_consensus.cc:2410] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:20.047466 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.048344 30900 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:20.047308  1825 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.016821  2259 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:20.073274 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 66763.5us
I20260709 12:25:20.074239 31587 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:20.075605 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 95653.8us
W20260709 12:25:20.052508 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 62174.7us
I20260709 12:25:20.078212 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.080204 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.081357 31044 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.077337  2233 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:20.082139  2233 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:20.082701  2282 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:20.083940  1825 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.084918  2268 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.085865 31587 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:20.086651  2282 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.005546  2266 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:20.087922 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:20.087847 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 978) took 1104 ms. Trace:
I20260709 12:25:20.088510 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:20.083076  2233 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:20.091908 30899 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:20.092240 30900 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:20.095814 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.089582 31617 rpcz_store.cc:276] 0709 12:25:18.973888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.974002 (+   114us) service_pool.cc:224] Handling call
0709 12:25:18.979523 (+  5521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.979899 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.979926 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.980356 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.053500 (+ 73144us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:19.053545 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.053628 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.078594 (+1024966us) raft_consensus.cc:1685] finished
0709 12:25:20.078611 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.078754 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":983,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":72716,"threads_started":1,"wal-append.queue_time_us":141623}
I20260709 12:25:20.097596 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:20.097935 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.098248 31617 raft_consensus.cc:2368] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:20.101034 31616 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:20.091049 31016 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.097066 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.091308 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:20.125739 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 48956.9us
I20260709 12:25:20.089160  2282 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.141362 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.141613 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:20.142298 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.142455 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.141376 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:20.143195 31622 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 11: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:20.144414 30892 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:20.141376 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:20.145300 31617 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:20.140857 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:20.147615 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:20.148010 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:20.148430 31616 raft_consensus.cc:2410] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:20.150393 31615 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:20.158038  2139 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:20.159489  2139 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.159857  2139 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.160276  2139 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.164227 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:20.122879  2142 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.167550 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:20.180670 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.149178  2282 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.147775  2274 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.188206  2274 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.188669  2274 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:20.189071  2274 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.192895 31616 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:20.188233  2134 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:20.200011 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 178508us
I20260709 12:25:20.181295  2280 consensus_queue.cc:1059] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:20.181849  2142 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:20.149701  2309 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:25:20.210566 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 122108us
I20260709 12:25:20.211040 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.218799 31616 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:20.220417 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:20.224871  2280 raft_consensus.cc:3055] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:20.225548  2280 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:20.216454  2142 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.230813 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.205155  2139 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:20.239288 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 98507.8us
I20260709 12:25:20.245437  2317 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:20.246003  2317 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.246347  2317 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.246346 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:20.248986 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.251587 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.255957  2266 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:20.258880 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08003d36e0 after lost signal to thread 29732
W20260709 12:25:20.259341 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002fcb80 after lost signal to thread 29735
W20260709 12:25:20.260260 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0380 after lost signal to thread 30833
W20260709 12:25:20.261389 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3d40 after lost signal to thread 30925
W20260709 12:25:20.261585 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800386780 after lost signal to thread 30926
W20260709 12:25:20.261767 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1200 after lost signal to thread 30942
W20260709 12:25:20.262400 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08001584e0 after lost signal to thread 31000
I20260709 12:25:20.248176  2316 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:20.263814 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800397300 after lost signal to thread 31001
W20260709 12:25:20.266135 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1c60 after lost signal to thread 31075
I20260709 12:25:20.266114 31050 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
W20260709 12:25:20.267243 30997 debug-util.cc:398] Leaking SignalData structure 0x7b080040b5a0 after lost signal to thread 31649
I20260709 12:25:20.274117 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.275812 30867 leader_election.cc:400] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:20.276198 30867 leader_election.cc:403] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:20.273160 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:20.229882  2298 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:20.274824 31615 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
W20260709 12:25:20.265478  2310 log.cc:927] Time spent T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:20.283636 31045 raft_consensus.cc:2393] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:20.286559 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.287273 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:20.268689  2278 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:25:20.288700  1944 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.289695  2076 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:20.319621 30867 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:20.330709 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800385e40 after lost signal to thread 2032
W20260709 12:25:20.331040 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3620 after lost signal to thread 2033
W20260709 12:25:20.331282 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002f25c0 after lost signal to thread 2037
W20260709 12:25:20.331522 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb400 after lost signal to thread 2096
W20260709 12:25:20.331753 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800121020 after lost signal to thread 2105
W20260709 12:25:20.332018 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd120 after lost signal to thread 2131
W20260709 12:25:20.332289 30997 debug-util.cc:398] Leaking SignalData structure 0x7b080040c5a0 after lost signal to thread 2138
W20260709 12:25:20.332527 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800409700 after lost signal to thread 2143
W20260709 12:25:20.332748 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08002bed20 after lost signal to thread 2147
I20260709 12:25:20.332643 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:20.333086 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800357200 after lost signal to thread 2179
W20260709 12:25:20.333343 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800128b40 after lost signal to thread 2185
I20260709 12:25:20.333410 31615 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
W20260709 12:25:20.333624 30997 debug-util.cc:398] Leaking SignalData structure 0x7b080038c900 after lost signal to thread 2207
W20260709 12:25:20.334932 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.272506  2316 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.339778 30894 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:20.341503 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.342187 31623 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:20.345954 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.330575  2309 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.353184  2134 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:20.355930  2311 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:20.361914 31016 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:20.368387 31623 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:20.369431  2325 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:25:20.370680 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:20.371333 31046 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:20.341104  2139 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:20.335352  2294 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:25:20.413450 31047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.005s	sys 0.014s
W20260709 12:25:20.413861 31047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.005s	sys 0.014s
W20260709 12:25:20.414127 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 612758us
I20260709 12:25:20.404060  1825 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:20.417110 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.303561  2280 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.374541  2327 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:20.414981  2318 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:25:20.406392  2278 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:20.446642 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 118323us
I20260709 12:25:20.397856  2311 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:20.447793  2313 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.452611 30867 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:20.453111 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 204240us
I20260709 12:25:20.454210 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2278) took 1334 ms. Trace:
I20260709 12:25:20.458720 31047 rpcz_store.cc:276] 0709 12:25:19.117155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.118113 (+   958us) service_pool.cc:224] Handling call
0709 12:25:19.118393 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.121813 (+  3420us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:19.132429 (+ 10616us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.448737 (+1316308us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.448796 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:20.450853 (+  2057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.450925 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.451027 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34467,"prepare.queue_time_us":8605,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":34728,"thread_start_us":1281375,"threads_started":1,"wal-append.queue_time_us":779791}
I20260709 12:25:20.450842  2278 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:20.461763 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 213581us
I20260709 12:25:20.463244 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:20.464425 31049 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.462518 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:20.466003 31588 leader_election.cc:336] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.542s (SENT)
W20260709 12:25:20.466524 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 104680us
I20260709 12:25:20.467324 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:20.451083  2125 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.452247  2298 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:20.475478 31588 leader_election.cc:336] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.715s (SENT)
I20260709 12:25:20.466131  2278 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:20.483495 30867 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:20.455034  2311 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:20.476593  2139 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:20.519928 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 44475.9us
W20260709 12:25:20.522013 31588 leader_election.cc:336] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.733s (SENT)
I20260709 12:25:20.526233 31588 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:20.481421  2327 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.528154 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:20.530056 31047 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:20.531080 30942 connection.cc:256] RPC call timeout handler was delayed by -3.6580892020001556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 12:25:20.531525 30942 connection.cc:256] RPC call timeout handler was delayed by -3.6058892020000712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:25:20.531821 30942 connection.cc:256] RPC call timeout handler was delayed by -3.4519892020002771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:25:20.532079 30942 connection.cc:256] RPC call timeout handler was delayed by -3.2773892019999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 12:25:20.532346 30942 connection.cc:256] RPC call timeout handler was delayed by -3.1887002250000478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 12:25:20.532634 30942 connection.cc:256] RPC call timeout handler was delayed by -3.1630645800000821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 12:25:20.532883 30942 connection.cc:256] RPC call timeout handler was delayed by -3.0439288560000932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 12:25:20.533129 30942 connection.cc:256] RPC call timeout handler was delayed by -2.7034534100002929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 12:25:20.533445 30942 connection.cc:256] RPC call timeout handler was delayed by -2.2135892020000938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3168s for a response
I20260709 12:25:20.464531  2313 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.478258  1688 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:20.520362  2298 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:20.541644 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.545228 31588 leader_election.cc:336] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.758s (SENT)
I20260709 12:25:20.518277  2309 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:25:20.552258 31588 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:20.549105 31049 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:20.527017  2076 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:20.555085 30942 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.536443  1944 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:20.552919 30867 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:20.555083  2185 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:20.567148 31047 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:20.561947  2185 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.568298  1944 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:20.568748  1944 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:20.569126  1944 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:20.570092  2311 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:20.571383 30942 leader_election.cc:400] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:20.571697 30942 leader_election.cc:403] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:20.571816  2337 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:20.574440 31588 leader_election.cc:336] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.763s (SENT)
I20260709 12:25:20.576057 31588 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:20.577709 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:20.578912 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:20.553333  2343 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:20.579988  2207 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:20.580646  2266 raft_consensus.cc:2804] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:20.581142  2266 raft_consensus.cc:697] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:20.582141  2266 consensus_queue.cc:237] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.572260  2298 raft_consensus.cc:3055] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:25:20.584481  2326 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:25:20.585007  2316 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.586217 31049 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:20.555043  2332 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.589502 30942 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:20.584429  2298 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:20.593040  2298 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.593732  2313 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.594226  2298 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:20.594786  2341 log.cc:927] Time spent T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:25:20.606681 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.591836 31588 leader_election.cc:336] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.764s (SENT)
I20260709 12:25:20.630538 30897 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:20.575004  2238 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:20.556540  2323 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:25:20.583894  2270 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.587095  2134 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.581091  2343 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.677804 31047 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:20.679804 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 126956us
I20260709 12:25:20.682438 30867 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:20.682112 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:20.682137  2278 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.692747 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:20.733074 30898 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.680290  2238 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:20.690519 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:20.683441 31045 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 12 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:20.693147  2134 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:20.693929 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 102121us
I20260709 12:25:20.688656 30892 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:20.683221  2337 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.684110 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:20.679667  2268 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.693404 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:20.737725 30899 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:20.702533 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 114182us
W20260709 12:25:20.709309 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.692811 30900 raft_consensus.cc:3055] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:20.738852 30900 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:20.697471 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:20.714753  2274 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.525s	user 0.017s	sys 0.000s
I20260709 12:25:20.687605  2125 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:20.682976 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 268182us
I20260709 12:25:20.722412  2185 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.682217  2317 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:20.753118  2142 consensus_meta.cc:287] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.006s
I20260709 12:25:20.753578  2142 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.753870  2317 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:20.737951 31588 leader_election.cc:336] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.052s (SENT)
W20260709 12:25:20.745575 31014 leader_election.cc:336] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.904s (SENT)
I20260709 12:25:20.754576 31588 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:20.747879  1825 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:25:20.739567 30901 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
W20260709 12:25:20.755694 31588 leader_election.cc:336] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.088s (SENT)
I20260709 12:25:20.754565 31051 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.761371 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:20.758307 30942 leader_election.cc:400] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:20.763715 30942 leader_election.cc:403] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:20.761229 31588 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:20.764444 30899 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
W20260709 12:25:20.765312 31588 leader_election.cc:336] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.104s (SENT)
I20260709 12:25:20.766956 30898 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:20.794585 31588 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:20.805801 30896 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:20.737310  2238 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:20.807425 31588 leader_election.cc:336] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.125s (SENT)
I20260709 12:25:20.809629 31587 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:20.810622 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:20.811336 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 45438us
W20260709 12:25:20.757077  2282 consensus_meta.cc:287] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.001s
W20260709 12:25:20.813269 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.815052 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 69506.7us
I20260709 12:25:20.757556  2134 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:20.820119 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.820827 31617 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:20.822791  2142 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.823122 31620 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:20.761216  2274 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.824813 31615 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.760784  1825 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:20.825681  2274 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:20.817960  2282 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:20.827041  2355 log.cc:927] Time spent T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:25:20.818193  2259 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.806217  2317 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.829469 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:20.830093 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 71910.1us
W20260709 12:25:20.831820 30939 leader_election.cc:336] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.711s (SENT)
I20260709 12:25:20.817698  2268 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.833689  2142 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:20.743678  1944 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.827996  2332 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:20.812258  2343 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.813536  2323 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.840119  2351 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.860399  2351 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.814145  2327 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:20.862362  2327 raft_consensus.cc:697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:20.864435  2238 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.865804  2351 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:20.867164  2238 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.843920 31621 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.847950  1944 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.848238 31617 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:20.849427 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:20.858050  2278 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.835704  2232 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.828101  2259 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:20.859817 30939 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.743s (SENT)
I20260709 12:25:20.870536 31620 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:20.863346  2327 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.876521  2282 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:20.871858  2232 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.867424  2266 consensus_queue.cc:1059] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:25:20.878886  2232 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.884213 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:20.879449  2125 consensus_queue.cc:1059] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:25:20.889176  2238 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:20.889885  2238 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:20.890839  2238 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.891973 30942 leader_election.cc:400] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:20.893435 30942 leader_election.cc:403] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:25:20.893798  2125 raft_consensus.cc:3055] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:20.894196  2267 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.894752  2259 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:20.897710 30939 leader_election.cc:336] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.763s (SENT)
I20260709 12:25:20.898150 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.898835  2266 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:20.905642 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.905997  2353 log.cc:927] Time spent T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.066s	user 0.002s	sys 0.002s
I20260709 12:25:20.894230  2125 raft_consensus.cc:740] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:20.908198  2125 consensus_queue.cc:260] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:20.911743 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.911352  2125 raft_consensus.cc:3060] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:20.923911 30939 leader_election.cc:336] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.792s (SENT)
I20260709 12:25:20.924528 30939 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:20.932286 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.931591  2266 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.935602 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.936259 30975 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.938339  2232 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:20.942867  2268 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:20.944111 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:20.945412 30864 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:20.946309  2349 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:20.949215 30975 raft_consensus.cc:2410] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:20.946808 30864 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:20.946877  2349 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:20.954839 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.955331 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.955477 30969 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:20.955929 30975 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:20.956866 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.957398 30975 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:20.958174 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.959122 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.959334 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.960086 30976 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 11: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:20.960561 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.960883 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.961484 30976 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:20.962284 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.962894 30976 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 11: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:20.962778 30969 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:20.947031  2337 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.963660 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:20.964363 30939 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.872s (SENT)
I20260709 12:25:20.964617 30969 raft_consensus.cc:2410] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:20.965550 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.966508  2232 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:20.966660 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.967237 30974 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
W20260709 12:25:20.965641 30939 leader_election.cc:336] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 1.902s (SENT)
I20260709 12:25:20.959944 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.972637 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:20.958698 30975 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:20.973030 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:20.967968 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.969592 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.949800  2317 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:20.970481 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.970793 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.971364 30973 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.973630 30864 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:20.973582 30974 raft_consensus.cc:2376] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8. Re-sending same reply.
I20260709 12:25:20.967514 30969 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:20.996657 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.964156  2337 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.999578 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.001248 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.001883 30975 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.003599 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.955112  2349 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:21.004061  2125 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:21.020001 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.021183 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.021713 30976 raft_consensus.cc:2376] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6. Re-sending same reply.
I20260709 12:25:21.001947  2337 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.022477 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.992240  2294 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:21.023659 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.025498 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:20.998720  2298 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:21.012192 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:20.997083  2323 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.046334 30974 raft_consensus.cc:2410] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:21.023102 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.047048 30971 raft_consensus.cc:2393] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:21.016390 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.041751 30973 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:21.042877 30901 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.044333 30867 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:21.036520 30976 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
W20260709 12:25:21.016049 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 50434us
I20260709 12:25:21.057502 30975 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:21.047600 30967 raft_consensus.cc:2376] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10. Re-sending same reply.
I20260709 12:25:21.059448 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.060770 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.061383 30969 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 5.
I20260709 12:25:21.047832  2294 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:21.063791 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.001521  2240 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:25:21.065418 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.065573 30973 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:21.066238 30976 raft_consensus.cc:2410] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:21.066074  2294 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:21.066609 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.066989 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.067162 30973 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.068040 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.068809 30972 raft_consensus.cc:2410] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:21.071930  2076 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.072147 30975 raft_consensus.cc:2410] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:21.072417  2076 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:21.074537  2076 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:21.075235 30973 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:21.045573  2350 consensus_queue.cc:1059] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:21.050606  2298 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:21.076299  2350 raft_consensus.cc:3055] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:21.076635  2350 raft_consensus.cc:740] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:21.059533  2342 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:21.076648  2298 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:21.062389  2317 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.077508  2350 consensus_queue.cc:260] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.077885  2317 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.035413  2337 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:21.079627 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:21.062742  2267 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:21.078704  2350 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:21.091176 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.083649  2270 raft_consensus.cc:3055] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:21.091948 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.061120  2323 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.097718 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.098285 30901 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:21.098910 30974 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:21.077400  2342 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.099892 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.100591 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.100971 30971 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:21.099586 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:21.101120 30975 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:21.099944 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.101517 30901 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:21.103365 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.103922 30972 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:21.105388 30974 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:21.097044  2270 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:21.108633 30974 raft_consensus.cc:1240] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:21.097503  1944 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:25:21.114027  1944 consensus_queue.cc:1243] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 9f38f761eded4f28b9d802f6570ee71e log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:21.109244 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:21.103693  2317 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:21.116935 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.118749 30972 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:21.119656 30976 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:25:21.120417 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:21.123360 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.124053  2270 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.102771  2342 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.125249  2270 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.125962  2280 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.126431  2342 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:21.127839 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:21.128437 31050 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:21.129765 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:21.131263 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:21.131973 30901 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:21.132299 30970 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:21.132972 30975 raft_consensus.cc:2410] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:25:21.134033 30939 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Timed out: RequestConsensusVote RPC to 127.29.9.3:38505 timed out after 2.358s (SENT)
I20260709 12:25:21.135901 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.136715 30975 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:21.138504 31050 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:21.140520 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.141315 30972 raft_consensus.cc:2410] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:21.142019 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.143132 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.143414  2313 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:21.144485  2313 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:21.145166 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.145437  2313 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:21.145857  2313 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:21.128441  2323 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:21.147578  2313 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.148744 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.148947  2313 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.149441 30971 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:21.150656 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.151686 30971 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:21.133212  2342 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:21.152679  2342 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.152791 30971 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:21.153062  2342 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:21.155675 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.156188 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.156877 30976 raft_consensus.cc:2368] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:21.158135  2337 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:21.150490 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.155190 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:21.165998 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:21.167622 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.168437 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.168627 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:21.165927 30892 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:21.173990 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:21.174579 31050 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.176930 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:21.178637 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:21.179188 30892 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:21.179896 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.180500 30973 raft_consensus.cc:2410] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:21.181073 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:21.182526 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:21.182994 31048 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:21.184325 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.184800 30968 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:21.185515 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:21.185735 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:21.186331 30895 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:21.186643 31045 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:21.188098 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:21.172904  2139 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.171762  2317 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:21.193871 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.192821  2139 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.196833  2139 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:21.191694 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:21.171761  2323 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:21.204120 31050 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:21.205684 30864 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:21.205863 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:21.208001 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:21.208570 30898 raft_consensus.cc:2376] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9. Re-sending same reply.
I20260709 12:25:21.208930 31587 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:21.211052 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.211655 30974 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:21.216069 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.216921 30973 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:21.217437 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:21.223294 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:21.223986 31622 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.224745 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:21.225258 31616 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:21.226790 30892 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:21.209532  2278 raft_consensus.cc:3055] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:21.210039  2294 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:21.213069  2327 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:21.237574 30901 raft_consensus.cc:2410] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:21.232596 30788 maintenance_manager.cc:419] P 68e5ef8bf7224b3eb4f5bc33c89543d4: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033380
I20260709 12:25:21.244207 30968 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:21.216662  2317 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:21.238384 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.256176 31616 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:21.265108 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:21.263581 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.265810 30976 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:21.233705 31622 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:21.272557 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:21.273370 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.273594 31016 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:21.274394  2370 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:21.275121  2323 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:21.282835  2370 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:21.283980  2370 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.238233  2278 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:21.291122 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:21.263464  2327 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.292884 30976 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:21.293803 30973 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:21.264202  2317 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.287696  2139 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:21.286010  2294 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:21.293568 31620 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:21.298623 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.299526 30974 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:21.293921  2327 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.302440 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.304634 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.305954 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.306042 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.301249 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.308844 30967 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:21.297848  2317 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.309635 31016 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:21.310446 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.310456 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.311035 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.310658 30973 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:21.313196 30967 raft_consensus.cc:2368] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:21.313220 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.313282 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:21.314173 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.314278 30971 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:21.315884  2331 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:21.316298  2331 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.316614  2331 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:21.318250 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.318408  2259 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.298995  2323 raft_consensus.cc:697] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:21.318943  2259 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.320734 30973 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:21.320778 30974 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:25:21.321471 30974 pending_rounds.cc:85] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 6
I20260709 12:25:21.321748 30974 pending_rounds.cc:107] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:25:21.321942 30974 raft_consensus.cc:2889] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:21.324159  2259 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:21.326040 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:21.326694 30892 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:21.321412 30973 pending_rounds.cc:85] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 6
I20260709 12:25:21.327536 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:21.327971  2294 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:21.328429 31045 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:21.312150  2278 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.328166 30973 pending_rounds.cc:107] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:21.335052 30973 raft_consensus.cc:2889] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:21.330013  2278 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.369837 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 1946) took 1338 ms. Trace:
I20260709 12:25:21.370289 30894 rpcz_store.cc:276] 0709 12:25:20.021742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.028992 (+  7250us) service_pool.cc:224] Handling call
0709 12:25:21.333825 (+1304833us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400098654. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:21.360077 (+ 26252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712367360}
I20260709 12:25:21.372815 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.373574 30971 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:21.373776 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.374351 30967 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:21.376966 30976 raft_consensus.cc:1240] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:21.388880 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.390309 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.390964 30975 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:21.394647 30967 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:21.395702 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.389683 30973 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:21.400429 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.399873 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.405797 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.406635 30973 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:21.407984 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.408713 30968 raft_consensus.cc:2393] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:21.409358 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.410616 30973 raft_consensus.cc:2393] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:21.409389 30894 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:21.422063 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:21.425060 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.425711 30967 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:21.427793 30896 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:21.427920 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.440008 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.444545 30973 raft_consensus.cc:1240] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:21.319757  2323 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.449733 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.460314 30894 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:21.468390 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.475905 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.504161 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.505050 30967 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
W20260709 12:25:21.530002 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.533896 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.542258 31050 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:21.552557  2313 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:21.554661  2375 log.cc:927] Time spent T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:21.582237 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.583137 30967 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:21.584995 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:21.585556 30967 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.586896 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:21.590960 30969 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:21.597474 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.608834 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.615336  2259 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.615981  2259 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.621181  2328 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.621802  2328 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:21.638182  2374 log.cc:927] Time spent T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.002s
W20260709 12:25:21.648082 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.655432 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:21.674777 31588 leader_election.cc:336] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 3.146s (SENT)
I20260709 12:25:21.675311 31588 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:21.676234  2332 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:21.698171  2332 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:21.698793  2332 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:21.744943 31014 leader_election.cc:336] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.905s (SENT)
I20260709 12:25:21.745566 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:21.746872  2373 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:21.745620 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 70884.8us
W20260709 12:25:21.748631  2342 consensus_meta.cc:287] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.012s
I20260709 12:25:21.749045  2342 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.749505 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:21.753270  2373 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:21.753823  2373 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:21.754715  2373 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:21.767766 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.771831  2350 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.772487  2350 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:21.781234 30865 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.739s (SENT)
I20260709 12:25:21.781805 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:21.783376  2331 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:21.788707  2348 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:21.789688  2337 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.790205  2337 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:21.797338 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.823580 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.852484  2351 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.853175  2351 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:21.870575 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.946511 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.988514  2332 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:21.997987  2350 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:21.999401  2351 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:22.000299 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 217425us
W20260709 12:25:22.001820 30865 leader_election.cc:336] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.750s (SENT)
I20260709 12:25:22.002260 30865 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:22.003173 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.004609 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.005105 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:22.005748 31615 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:22.039685 30865 leader_election.cc:336] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.814s (SENT)
W20260709 12:25:22.041154 30865 leader_election.cc:336] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.931s (SENT)
W20260709 12:25:22.102545 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.013150  2370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.004s	sys 0.006s
W20260709 12:25:22.106994  2370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.004s	sys 0.006s
W20260709 12:25:22.107614 30899 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.018s	sys 0.035s
W20260709 12:25:22.107973 30899 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.018s	sys 0.035s
I20260709 12:25:21.676307 30794 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
W20260709 12:25:22.121014 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.105238 30900 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.120144 30794 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.137929 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.142058 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.142606 30971 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:22.144853 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.145372 30971 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:22.129038  2372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.002s	sys 0.010s
I20260709 12:25:22.154748 30794 catalog_manager.cc:5697] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 5 to 6, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:22.150058  2372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.002s	sys 0.010s
I20260709 12:25:22.174312 30794 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 3 to 5, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 5 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:22.177754 30794 catalog_manager.cc:5697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:22.194051 30794 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:22.202128 30799 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48640 (request call id 261) took 23742 ms (client timeout 15000 ms). Trace:
I20260709 12:25:22.214308  2396 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.215884 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.215412  2396 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:22.222930 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.340816  2393 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:22.337500 30794 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 7, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 7 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.345893 30794 catalog_manager.cc:5697] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:22.202572 30799 rpcz_store.cc:269] 0709 12:24:58.425269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.425406 (+   137us) service_pool.cc:224] Handling call
0709 12:25:22.159396 (+23733990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:12.896565 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:12.934815 (+ 38250us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:12.934851 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:25:12.934868 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:12.969524 (+ 34656us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:12.969582 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:12.969609 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:25:12.970638 (+  1029us) tablet.cc:701] Row locks acquired
0709 12:25:12.970656 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:25:12.970802 (+   146us) write_op.cc:270] Start()
0709 12:25:12.970911 (+   109us) write_op.cc:276] Timestamp: P: 1783599912970755 usec, L: 0
0709 12:25:12.970928 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:25:12.971514 (+   586us) log.cc:844] Serialized 5012 byte log entry
0709 12:25:16.163954 (+3192440us) op_driver.cc:464] REPLICATION: finished
0709 12:25:16.193574 (+ 29620us) write_op.cc:301] APPLY: starting
0709 12:25:16.193680 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:16.193949 (+   269us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:16.194076 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:16.272165 (+ 78089us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:16.272413 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:25:16.272461 (+    48us) write_op.cc:312] APPLY: finished
0709 12:25:16.272694 (+   233us) log.cc:844] Serialized 95 byte log entry
0709 12:25:16.272860 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:16.272996 (+   136us) write_op.cc:454] Released schema lock
0709 12:25:16.273042 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:16.273421 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:16.273442 (+    21us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":853722,"reported_tablets":34,"spinlock_wait_cycles":19712,"child_traces":[["op",{"apply.queue_time_us":29364,"apply.run_cpu_time_us":3957,"apply.run_wall_time_us":79843,"num_ops":13,"prepare.queue_time_us":634226,"prepare.run_cpu_time_us":15728,"prepare.run_wall_time_us":889648,"raft.queue_time_us":1523480,"raft.run_cpu_time_us":993,"raft.run_wall_time_us":33113,"replication_time_us":3192866,"thread_start_us":2531681,"threads_started":4,"wal-append.queue_time_us":711032,"wal-append.run_cpu_time_us":17537,"wal-append.run_wall_time_us":3577825}]]}
I20260709 12:25:22.349231 30794 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 4 to 8, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 8 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:22.360237  2384 log.cc:927] Time spent T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:25:22.367074 30971 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:22.376204 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.376758 30971 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:22.377473 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.377879 30971 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:22.381354  2392 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:22.381812  2392 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:22.382618  2392 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:22.393570  2327 consensus_meta.cc:287] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 1.080s	user 0.011s	sys 0.009s
I20260709 12:25:22.373282  2396 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.372323 30794 catalog_manager.cc:5697] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 2 to 3, term changed from 1 to 6, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to <none>, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:22.394426 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 190338us
I20260709 12:25:22.394183  2327 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.397744  2396 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:22.396719 30794 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 8, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 8 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:22.401635 30794 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.403957  2327 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:22.413558 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.415796 31615 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:22.405308 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:22.420463 30971 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:22.421921 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.422516 30971 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:22.423256  2259 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:22.423884 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.434461 30974 raft_consensus.cc:3055] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:22.434887 30974 raft_consensus.cc:740] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:22.435575 30974 consensus_queue.cc:260] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.436072 30971 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:22.436450 30974 raft_consensus.cc:3060] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:22.437034 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.438090 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.438740 30971 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:22.439406 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.440439 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.440726 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.441452 30971 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:22.441006 30969 raft_consensus.cc:2376] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7. Re-sending same reply.
I20260709 12:25:22.442739 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.445102 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.444236  2396 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.446769  2396 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:22.447129  2396 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.448071 30974 raft_consensus.cc:1275] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:25:22.448475 30974 pending_rounds.cc:85] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 8
I20260709 12:25:22.448742 30974 pending_rounds.cc:107] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:25:22.449039 30974 raft_consensus.cc:2889] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:22.450245 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.450472 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.451057 30969 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:22.624509 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.624914  2395 consensus_queue.cc:1059] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:22.627629 31616 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:22.628058 30969 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:22.629060 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.629649 30969 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 6.
I20260709 12:25:22.630443 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.631110 30969 raft_consensus.cc:2393] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:22.632107 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 1004) took 1410 ms. Trace:
I20260709 12:25:22.633808 31621 rpcz_store.cc:276] 0709 12:25:21.221384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.221508 (+   124us) service_pool.cc:224] Handling call
0709 12:25:21.221833 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:21.222229 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.222258 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:21.227572 (+  5314us) log.cc:844] Serialized 52 byte log entry
0709 12:25:21.621635 (+394063us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b18003e39e0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:25:21.881095 (+259460us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:21.881141 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.881234 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.631809 (+750575us) raft_consensus.cc:1685] finished
0709 12:25:22.631829 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.632047 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12915,"spinlock_wait_cycles":35842304,"thread_start_us":259225,"threads_started":1,"wal-append.queue_time_us":905553}
I20260709 12:25:22.452759 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:22.468083 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.579694 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.639042  2396 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:22.651440 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.451267 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.654552 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.657135  2396 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:22.664951  2396 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.665457  2396 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.667024  2401 raft_consensus.cc:2764] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:25:22.667510  2396 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.667764  2401 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:22.663940 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.668251  2401 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:22.669337 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.670320  2401 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:22.671085 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 218405us
I20260709 12:25:22.670457 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.671813 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:22.672099 30974 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 6.
I20260709 12:25:22.672654 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:22.673053 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.673348  2396 raft_consensus.cc:2764] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:22.673801 30974 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:22.674026  2396 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:22.674391  2396 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.674705  2396 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.674880 30974 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:22.678078 30974 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:22.681771  2390 log.cc:927] Time spent T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.317s	user 0.005s	sys 0.000s
W20260709 12:25:22.685160 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.685984 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.687565  2396 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:22.689070  2395 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:22.689572  2373 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:22.677948  2392 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.695025  2328 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.696915 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:22.699621  2370 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:22.700075  2370 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.700423  2370 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:22.708953 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:22.711035  2396 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:22.687767  2399 consensus_queue.cc:1059] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:22.712311  2403 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:22.713188  2370 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.713629 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:22.713281  2399 raft_consensus.cc:3055] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:22.717690 30969 raft_consensus.cc:2410] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:25:22.717592  2373 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:22.721930  2399 raft_consensus.cc:740] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:22.722821  2399 consensus_queue.cc:260] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.724198  2399 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:22.718210  2282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.320s	user 0.008s	sys 0.005s
I20260709 12:25:22.725266  2370 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:22.725858  2282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.010s	sys 0.006s
I20260709 12:25:22.719396 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:22.729549  2294 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:22.720328 31013 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:22.731460  2373 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:22.731976  2373 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:22.732749  2373 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.742573 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.744390 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.744962 31050 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:22.746117 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:22.746800 31050 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:22.747910 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.748421 31050 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:22.751844  2401 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:22.752413  2401 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.754554  2401 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.757666 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:22.760896 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.761695 31050 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:22.762295 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.763019 31045 raft_consensus.cc:2368] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11.
I20260709 12:25:22.762945  2372 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.763788  2372 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:22.764232 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.765064 31051 raft_consensus.cc:2410] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:25:22.763831 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.766001  2372 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:22.767570 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:22.768049 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.768301 31045 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:22.768653 31049 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:22.769543 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:22.770294 31051 raft_consensus.cc:2368] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:22.771096 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.771629 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.777706 31049 raft_consensus.cc:2368] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11.
W20260709 12:25:22.781634 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.781687 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 678) took 2013 ms. Trace:
I20260709 12:25:22.782671 30899 rpcz_store.cc:276] 0709 12:25:20.763781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.026685 (+262904us) service_pool.cc:224] Handling call
0709 12:25:21.027032 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:21.027484 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:21.027512 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:21.034885 (+  7373us) log.cc:844] Serialized 52 byte log entry
0709 12:25:21.100494 (+ 65609us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:22.108304 (+1007810us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.776368 (+668064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.776440 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.776478 (+    38us) raft_consensus.cc:1685] finished
0709 12:25:22.776490 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.776607 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":945316,"prepare.queue_time_us":296822,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":676447,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":783687,"threads_started":2,"wal-append.queue_time_us":96989}
I20260709 12:25:22.816370 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:22.818079 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1971) took 1611 ms. Trace:
I20260709 12:25:22.818467 30895 rpcz_store.cc:276] 0709 12:25:21.206931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.207090 (+   159us) service_pool.cc:224] Handling call
0709 12:25:21.213303 (+  6213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.213472 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:21.746375 (+532903us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.817737 (+1071362us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:22.817790 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:22.817832 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.817891 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.818004 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757020,"prepare.queue_time_us":184037,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":28,"thread_start_us":474941,"threads_started":3,"wal-append.queue_time_us":454451}
I20260709 12:25:22.827509  2414 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:22.828183  2414 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.830340  2414 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.833345 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:22.835402 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.839085 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.839949 30893 raft_consensus.cc:2410] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:22.842401 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.843212 30895 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:22.844297 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.845384 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.845875 30895 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:22.849071 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.850252 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.850994 30899 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 6: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:22.853166 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.854049 30893 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:22.859185 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.860766 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.861431 30899 raft_consensus.cc:2368] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:22.862504 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.863628 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.817101  1944 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.864745 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.868813 30898 raft_consensus.cc:2393] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 11: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:22.866140 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:22.869747 31049 raft_consensus.cc:2376] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11. Re-sending same reply.
I20260709 12:25:22.866441 31051 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:22.858736  2323 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.834249  2393 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.872243 30895 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
W20260709 12:25:22.873193 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.875280 30865 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.111s (SENT) [suppressed 79 similar messages]
I20260709 12:25:22.875530 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.878612 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:22.879662 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.880533  2297 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:22.883503  2297 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.882453 30898 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:22.883812 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.884981 30892 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.885841  2297 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.881924  2350 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.874954  2323 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:22.875128  2393 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.886725  2350 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.888892  2393 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.888859  2350 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.886343  2297 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.874012  1944 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.890166  2297 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.890686 30901 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:22.890765  2342 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.891672  1944 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.892850 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.893435 31051 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:22.893924  2337 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.894295 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.894702 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:22.895505 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.896553 31047 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:25:22.897066  2398 raft_consensus.cc:3055] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:22.897455  2398 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:22.898257  2398 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.895874 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:22.900463 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:22.899232  2398 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.900471 30894 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:25:22.901764 30939 leader_election.cc:400] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11.
I20260709 12:25:22.904165 30895 raft_consensus.cc:2376] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11. Re-sending same reply.
I20260709 12:25:22.904505 30892 raft_consensus.cc:2468] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:22.905481  2337 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:22.904915 30939 leader_election.cc:403] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:22.906023  2337 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.907785 30939 leader_election.cc:400] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:22.907924  2393 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11.
I20260709 12:25:22.908572  2337 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.908710 30939 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:22.909549  2393 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:22.910429 30939 leader_election.cc:400] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11.
I20260709 12:25:22.911314 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:22.879161  2406 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:25:22.913471 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.913702 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.916864 30894 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:22.918938 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.919675 30899 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:22.912065  2393 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:22.921608 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.923576 30895 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:22.922655 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.912274  2412 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.925638 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:22.927562  2401 consensus_queue.cc:1059] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:22.928105  2297 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.928838  2401 raft_consensus.cc:3055] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:22.929215  2401 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:22.929756  2323 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:22.929955  2401 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:22.930917  2401 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.932408 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.932029  2412 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.933128 30970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1968) took 1120 ms. Trace:
I20260709 12:25:22.933486 30970 rpcz_store.cc:276] 0709 12:25:21.812857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.932156 (+1119299us) service_pool.cc:224] Handling call
0709 12:25:22.933071 (+   915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:22.941650 30898 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:22.941944 30895 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:22.943496 30899 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:22.946301 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:22.946985 30892 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.949697 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:22.951157 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:22.941349  2402 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:22.957170  2402 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.957633  2402 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:22.958151 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:22.959013 30972 raft_consensus.cc:2410] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:25:22.959419 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1973) took 1145 ms. Trace:
I20260709 12:25:22.945996  2393 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.925176  2370 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:22.959698 30972 rpcz_store.cc:276] 0709 12:25:21.814270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.957867 (+1143597us) service_pool.cc:224] Handling call
0709 12:25:22.959361 (+  1494us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:22.963491 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1984) took 1146 ms. Trace:
I20260709 12:25:22.960265  2393 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.963944 30969 rpcz_store.cc:276] 0709 12:25:21.817138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.631597 (+814459us) service_pool.cc:224] Handling call
0709 12:25:22.963271 (+331674us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b5400021f54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:22.963419 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112577280}
I20260709 12:25:22.961428  2370 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.966231  2393 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.952320  2412 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.966967  2370 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:22.968070 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.953258 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:22.980739  2393 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:22.984019 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:22.985857 30897 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:22.984779  2259 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:22.988088  2259 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.990145  2259 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:22.990603  2259 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:22.991057  2259 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:22.991880  2278 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 1.638s	user 0.014s	sys 0.010s
I20260709 12:25:22.992355  2342 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.992827  2342 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:22.993898  2413 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:22.994745  2342 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:22.997674 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.998276 30895 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:22.990610 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:23.000568 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:23.001538 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.002056 30939 leader_election.cc:400] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8.
I20260709 12:25:23.002669 30896 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:23.002777 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:22.977273  2401 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.004266 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:22.999893  2408 consensus_queue.cc:1059] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:25:22.996009  2327 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:23.009502 30892 raft_consensus.cc:2410] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:25:23.011338 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 96071.1us
I20260709 12:25:23.014655 31621 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:23.016606 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.017313 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:22.948731  2410 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:25:23.003579  2393 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.018699 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:23.020936 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.024718 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:23.023025 31013 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:23.016474  2294 raft_consensus.cc:2764] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:23.029170 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:23.030478 30865 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.031418 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.022023  2396 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.021783  2411 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.028348  2401 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.034420 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.030107  2373 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:23.039116  2373 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.039474  2373 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.040522  2259 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:23.044392 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.046718  2401 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:23.047292  2401 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:23.036688  2297 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:23.049320  2401 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:23.037830  2403 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:23.051788  2403 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:23.052402 31047 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:23.052714  2403 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.053347 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.054435 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.018282  2327 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.055035 31047 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:23.057957 30967 consensus_meta.cc:287] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 1.472s	user 0.016s	sys 0.003s
I20260709 12:25:23.058440 30967 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:23.063130 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1964) took 1474 ms. Trace:
I20260709 12:25:23.063925 31050 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:23.065188 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.065670 31047 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:23.067807 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.068455 31050 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 12 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:23.063560 30967 rpcz_store.cc:276] 0709 12:25:21.584143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.584751 (+   608us) service_pool.cc:224] Handling call
0709 12:25:23.058871 (+1474120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.068847 30865 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:23.069964 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.072273 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.073634 31050 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:23.070549 31051 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
W20260709 12:25:23.075856 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 44482.2us
I20260709 12:25:23.076170 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:23.077428 31043 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.077994 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.079393 30939 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:23.061240  2399 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:23.085925 30864 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:23.076109  2350 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.087031  2350 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:23.087592  2414 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:23.088096  2414 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:23.076675  2412 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:23.088541  2337 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:23.089073  2412 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:23.089471  2412 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:23.074880  2297 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:23.032953  2393 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:25:23.107103 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.109743 31043 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:23.111056 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:23.118373  2422 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.119056  2425 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:23.119472 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8dc0 after lost signal to thread 29735
I20260709 12:25:23.120352  2396 raft_consensus.cc:2804] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:23.088481  2414 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.123217  2398 consensus_queue.cc:1059] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:23.123386 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:23.125681 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.085830  2327 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:23.127956 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800193de0 after lost signal to thread 30833
W20260709 12:25:23.144200 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa6c0 after lost signal to thread 30925
W20260709 12:25:23.144550 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4ca0 after lost signal to thread 30926
I20260709 12:25:23.130650 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:23.075435  2410 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:25:23.151353 30892 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:23.151597 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:23.152314 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:23.154191 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:23.155018 30967 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:23.155169  2278 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:23.156387 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.157040 30967 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:23.158391 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.158982 30967 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:23.160482 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.161151 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.161635 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.163456 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.164106 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.164434 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.164705 30967 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:23.164111 30972 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:23.165753 30970 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:23.122176  2401 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.142915  2313 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:23.142381  2408 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.168643  2433 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:23.169544  2327 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:23.169530  2434 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.169971  2393 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:23.170365 30975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.638s	user 0.020s	sys 0.020s
I20260709 12:25:23.182458 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.171093  2401 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:23.180030  2433 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.192552  2327 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:23.136564  2402 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.126533  2422 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:23.211870 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 50834.6us
I20260709 12:25:23.212222 30967 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:25:23.212587 30967 pending_rounds.cc:85] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 4
I20260709 12:25:23.179665  2313 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.212937 30967 pending_rounds.cc:107] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:25:23.212677 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:23.213208 30967 raft_consensus.cc:2889] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:23.214428 31587 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:23.199958  2401 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.216114 30970 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:23.221484 30865 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:23.208190  2433 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.138953  2425 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.231566 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.232275 30968 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:23.217617  2434 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.237295  2434 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:23.238445  2434 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.239249  2422 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:23.239862  2422 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:23.240197  2422 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.240523  2422 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.231086  2410 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.245332  2410 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:23.245687  2410 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.246881  2412 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:23.248478 31618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.663s	user 0.005s	sys 0.013s
I20260709 12:25:23.248780 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2319) took 1409 ms. Trace:
I20260709 12:25:23.250104 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:23.250698 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.214823  2396 raft_consensus.cc:697] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:23.229875 30865 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:23.241856 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.253787 30865 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:23.251932 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:23.255695 31618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.671s	user 0.005s	sys 0.013s
I20260709 12:25:23.253605 30976 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:23.256990 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1971) took 1443 ms. Trace:
I20260709 12:25:23.260367  2396 consensus_queue.cc:237] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:23.257303 30976 rpcz_store.cc:276] 0709 12:25:21.813740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.241584 (+1427844us) service_pool.cc:224] Handling call
0709 12:25:23.256929 (+ 15345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:23.249133 31045 rpcz_store.cc:276] 0709 12:25:23.046171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.051673 (+  5502us) service_pool.cc:224] Handling call
0709 12:25:23.071029 (+ 19356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:23.076472 (+  5443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:23.076501 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:23.076952 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:25:23.177875 (+100923us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:23.177920 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.177995 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:23.248571 (+ 70576us) raft_consensus.cc:1685] finished
0709 12:25:23.248592 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.248725 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5102,"raft.queue_time_us":5255,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":42116,"thread_start_us":97110,"threads_started":1,"wal-append.queue_time_us":135198}
I20260709 12:25:23.273980 30865 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.288859 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 1958) took 1882 ms. Trace:
I20260709 12:25:23.290927 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1154) took 2431 ms. Trace:
I20260709 12:25:23.291154 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.289322 30975 rpcz_store.cc:276] 0709 12:25:21.406532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.426341 (+ 19809us) service_pool.cc:224] Handling call
0709 12:25:21.439411 (+ 13070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.447060 (+  7649us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:21.465988 (+ 18928us) log.cc:844] Serialized 14 byte log entry
0709 12:25:23.257813 (+1791825us) log.cc:844] Serialized 14 byte log entry
0709 12:25:23.288496 (+ 30683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:23.288551 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:23.288598 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.288671 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.288800 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37231,"prepare.queue_time_us":19979,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":7175,"raft.run_wall_time_us":12217,"spinlock_wait_cycles":5957888,"thread_start_us":1718532,"threads_started":2,"wal-append.queue_time_us":1709614}
I20260709 12:25:23.292428 31051 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:23.291385 31618 rpcz_store.cc:276] 0709 12:25:20.844169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.844276 (+   107us) service_pool.cc:224] Handling call
0709 12:25:20.844589 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.844964 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:20.844991 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:20.845434 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:25:21.584881 (+739447us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800416a40. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53fc02 00007f03301c720b 00007f03301ccd23 00007f03301cd0d1 00007f03305e8a0f
0709 12:25:23.256335 (+1671454us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:23.256381 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.256444 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:23.256489 (+    45us) raft_consensus.cc:1685] finished
0709 12:25:23.256500 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.275668 (+ 19168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":684,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":25431424,"thread_start_us":1671115,"threads_started":1,"wal-append.queue_time_us":1314613,"wal-append.run_cpu_time_us":1695,"wal-append.run_wall_time_us":1007000}
W20260709 12:25:23.300774  2317 consensus_meta.cc:287] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 1.978s	user 0.021s	sys 0.022s
I20260709 12:25:23.291960  2337 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.291800  2342 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.287930  2350 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.291014  2392 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.252583  2373 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.346649  2342 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.353366  2342 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.343752  2337 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:23.357865 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 82916.9us
I20260709 12:25:23.339784  2317 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.360411 31044 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:23.357355  2430 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:25:23.366707 31624 raft_consensus.cc:2368] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10.
I20260709 12:25:23.301167  2327 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.342192  2436 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:23.375919  2297 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:23.376317  2412 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:23.377429  2425 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:23.360265  2337 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:23.389978 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 171993us
W20260709 12:25:23.390480 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 138696us
I20260709 12:25:23.392071 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.392438 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:23.395269 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.397168 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.397506 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.398239 31620 raft_consensus.cc:2393] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:23.395529 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.399191 31618 raft_consensus.cc:2393] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:23.400410 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.401542  2372 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.401684 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.398340  2297 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:25:23.403191  2401 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:23.404815  2373 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.405368  2401 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:23.406584 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:23.407178 30897 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.407691  2410 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.409807  2410 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.411746 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:23.413101 30893 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:23.413201 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.413785 31621 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 5.
I20260709 12:25:23.414103 30897 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:23.414877 31621 raft_consensus.cc:1240] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:23.415011 31623 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:23.416033  2428 log.cc:927] Time spent T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:25:23.405555 30969 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:23.419611 31621 raft_consensus.cc:1240] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:23.424588 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:23.425282 31622 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.368005  2350 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:25:23.402231  2317 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:23.434298 31014 leader_election.cc:336] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 3.093s (SENT)
I20260709 12:25:23.437191 31016 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.439000 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:23.440279 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:23.449553 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.442950 30942 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.449963 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:23.450065 30895 raft_consensus.cc:2368] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
W20260709 12:25:23.445047  2298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.004s	sys 0.008s
I20260709 12:25:23.445560 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.443456 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.444710 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.451184 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.451646 31622 raft_consensus.cc:2468] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:23.456478 31620 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.453898 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.453186 30942 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.466913 31621 raft_consensus.cc:2410] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:23.482084 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:23.482949 31051 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.468086 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.460039  2373 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:23.484649 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:23.467223 31050 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:23.445437  2414 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:23.485586 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 51340.2us
I20260709 12:25:23.467713 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:23.488160 31622 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.487267 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:23.432417  2313 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.488657 30939 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:23.497942  2435 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:25:23.491568  2403 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:23.499648  2403 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:23.500057  2403 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:23.502732  2422 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.503944 31618 raft_consensus.cc:2368] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12.
W20260709 12:25:23.504990 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 51892.9us
I20260709 12:25:23.505084 31622 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:23.460570  2437 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:23.516952 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.492740  2393 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.445392  2431 consensus_queue.cc:1059] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:25:23.491904  2449 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:23.437736  2337 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:23.573889 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 130500us
W20260709 12:25:23.509985  2298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.430s	user 0.011s	sys 0.014s
I20260709 12:25:23.525612 30942 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.611583 31016 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:23.559615 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.575079  2313 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:23.576144  2414 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.565759  2396 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.585590 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:23.586922 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:23.608530 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.600710 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 241818us
I20260709 12:25:23.613552 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:23.626325 31045 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:23.626046 30865 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:23.629035 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 140583us
W20260709 12:25:23.630599 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 124851us
I20260709 12:25:23.580098  2433 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:23.635682 31014 connection.cc:256] RPC call timeout handler was delayed by -1.4132150539999202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 12:25:23.615494  2373 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:23.624732  2396 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.641841 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:23.644348 30974 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.634780  2414 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.632637  2431 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.631381  2449 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:23.648860 31623 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:23.645993 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.643622 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:23.651733 30972 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:23.654655 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 67820us
I20260709 12:25:23.626004  2313 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.655911 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:23.646387  2396 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.657650 31587 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:23.645097  2414 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:23.655519 31014 connection.cc:256] RPC call timeout handler was delayed by -1.1711150539999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
I20260709 12:25:23.636121  2437 consensus_queue.cc:1059] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:25:23.675572 30898 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:23.675439 30942 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.659896  2461 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.677985  2461 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:23.680744  2433 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:23.681991  2422 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:23.682847 31620 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:23.683939  2332 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.684393  2332 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.684720  2332 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.685794  2413 raft_consensus.cc:3055] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:23.686195  2413 raft_consensus.cc:740] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:23.651933  2373 raft_consensus.cc:697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:23.686933  2413 consensus_queue.cc:260] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.658200  2455 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.688033  2373 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:23.688674 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.661051  2313 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.690433  2342 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.671183  2425 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:23.691460  2425 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.691830  2425 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.672467  2414 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.695987  2461 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:23.697142  2413 raft_consensus.cc:3060] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:23.698742 31616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44888 (request call id 1010) took 2470 ms (client timeout 1961 ms). Trace:
I20260709 12:25:23.683861  2458 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.699560  2458 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.699919  2458 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.703833  2449 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.704548 31051 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:23.699081  2337 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.709949 30972 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:23.714673 31045 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
W20260709 12:25:23.699128 31616 rpcz_store.cc:269] 0709 12:25:21.228252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.264869 (+ 36617us) service_pool.cc:224] Handling call
0709 12:25:23.698558 (+2433689us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540065e5d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:23.698679 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3122208512}
I20260709 12:25:23.725067 31617 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:23.725754  2458 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.725704 31617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 1020) took 1721 ms. Trace:
I20260709 12:25:23.726857 31617 rpcz_store.cc:276] 0709 12:25:22.004682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.724431 (+1719749us) service_pool.cc:224] Handling call
0709 12:25:23.724742 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.725470 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.725653 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:23.671902 31014 connection.cc:256] RPC call timeout handler was delayed by -1.1594150539999646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 12:25:23.728524 31014 connection.cc:256] RPC call timeout handler was delayed by -1.1234150539999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:25:23.728801 31014 connection.cc:256] RPC call timeout handler was delayed by -1.115315054000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 12:25:23.729075 31014 connection.cc:256] RPC call timeout handler was delayed by -1.0847150540002986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 12:25:23.730384 31014 leader_election.cc:336] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.708s (SENT)
I20260709 12:25:23.730690 31014 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:23.733814 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 58477.1us
I20260709 12:25:23.734612 30942 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:23.737350 31014 leader_election.cc:336] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.854s (SENT)
I20260709 12:25:23.737860 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:23.739097 31014 leader_election.cc:336] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.977s (SENT)
I20260709 12:25:23.739667 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.739938 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.742372 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.744799 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.745443 30972 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:23.739468 31014 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.747476 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.748044 31616 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
W20260709 12:25:23.749400 31014 leader_election.cc:336] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 1.990s (SENT)
I20260709 12:25:23.749866 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:23.750936 31014 leader_election.cc:336] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.030s (SENT)
I20260709 12:25:23.751700 31622 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:23.753378 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.751708  2398 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:25:23.755076  2451 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.754446  2232 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.751663  2393 raft_consensus.cc:2804] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:23.757793  2393 raft_consensus.cc:697] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:23.751632  2323 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.758674  2393 consensus_queue.cc:237] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.751974  2370 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:23.762317 31014 leader_election.cc:336] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.039s (SENT)
I20260709 12:25:23.762414 30939 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.762873 31014 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:23.753146 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 143355us
I20260709 12:25:23.764452 30969 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:23.764868 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.765419 30971 raft_consensus.cc:2376] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7. Re-sending same reply.
I20260709 12:25:23.765828 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.767405 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:23.768523 30942 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.776206 31587 leader_election.cc:400] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:25:23.776535 30974 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:23.776733 31587 leader_election.cc:403] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:23.779413 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:23.747195  2437 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.787204 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:23.732759  2342 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.791042 30967 raft_consensus.cc:2376] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11. Re-sending same reply.
W20260709 12:25:23.792984 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 158024us
I20260709 12:25:23.662086  2434 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.794965 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.776217  2451 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:23.798190 31014 leader_election.cc:336] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.073s (SENT)
W20260709 12:25:23.798942 31014 leader_election.cc:336] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.093s (SENT)
I20260709 12:25:23.799212 31014 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:23.801285 31014 leader_election.cc:336] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.145s (SENT)
I20260709 12:25:23.801710 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:23.802592 31014 leader_election.cc:336] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.188s (SENT)
W20260709 12:25:23.803297 31014 leader_election.cc:336] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Timed out: RequestConsensusVote RPC to 127.29.9.2:39975 timed out after 2.235s (SENT)
I20260709 12:25:23.803515 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.804524 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:23.790261  2398 raft_consensus.cc:2764] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:23.807781 30898 raft_consensus.cc:1240] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:23.809342 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.809536 31615 raft_consensus.cc:1240] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:23.810660 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:23.812511 30899 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.777355  2396 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.799803  2327 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8.
I20260709 12:25:23.806546  2323 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.806778  2232 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.824599 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:23.807655  2466 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.823709 30865 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:23.814839  2451 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:23.804867  2370 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:25:23.849762 30899 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:23.838233 30865 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:23.852537  2350 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:23.837778  2468 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.852149  2399 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.831037  2403 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.867482  2473 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.868541  2456 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.869217  2456 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:23.870539  2403 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.870872  2460 consensus_queue.cc:1059] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:25:23.874977  2460 raft_consensus.cc:3055] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:23.875344  2460 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:23.876219  2460 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.871734  2464 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:25:23.876863  2425 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.873986  2396 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:23.879942  2401 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:23.880378  2401 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:23.881186  2401 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.882465  2401 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.884276  2460 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.858355  2451 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:25:23.866115  2297 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.885214  2414 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.880021 31616 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.893042 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:23.899219 30899 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:23.900089 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:23.901320  2468 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:23.904258 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.904259 30898 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.906638 31587 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:23.913102 30893 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:23.915297 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 46908.8us
I20260709 12:25:23.915428 30895 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:25:23.862910 30865 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:23.917227  2297 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.864100  2465 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.924407 30898 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:23.924916 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 91687.8us
W20260709 12:25:23.924379 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 61549.5us
I20260709 12:25:23.879489  2332 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:23.914939  2458 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:23.932291 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 108748us
I20260709 12:25:23.867094  2399 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:23.935786 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:23.918696  2468 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:23.988437 31615 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:23.891865  2479 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:25:24.004207 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.004904 31617 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.007874  2331 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.008628  2332 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:24.009249  2477 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:25:24.009496 31619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.477s	user 0.023s	sys 0.028s
I20260709 12:25:24.009716  2470 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:24.010316  2470 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:24.011233  2470 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.013209  2425 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:24.014622  2469 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:25:24.015887  2476 log.cc:927] Time spent T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:25:24.017477 31615 raft_consensus.cc:2468] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 6.
I20260709 12:25:24.019232 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:24.020324 30942 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:24.024524 31619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.492s	user 0.024s	sys 0.029s
I20260709 12:25:24.038622 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:24.031033  2396 raft_consensus.cc:2804] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:24.026275  2468 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:24.017458  2373 consensus_queue.cc:1059] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:25:24.056941 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.057715 31622 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:24.045243  2403 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.049607  2350 raft_consensus.cc:697] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:24.109155 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:24.107409 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 187462us
I20260709 12:25:24.111095 31615 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:24.107843 31623 raft_consensus.cc:1240] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:24.107905 31621 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:24.113663 31617 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
W20260709 12:25:24.115438  2478 log.cc:927] Time spent T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:24.121448 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:24.122816 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.130053 30942 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:24.060952  2396 raft_consensus.cc:697] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:24.133167 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:24.135969 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.140480 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.155267 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 235040us
I20260709 12:25:24.157618 31619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 1015) took 2626 ms. Trace:
I20260709 12:25:24.159320 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.159943 31046 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.133854  2473 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:24.165359 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.155580  2142 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:25:24.165850  2473 raft_consensus.cc:697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:24.166153 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.166931 31617 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:24.167284  2434 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.166023 31623 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:24.170251 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.170842 31047 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.157495  2259 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:24.158224 31619 rpcz_store.cc:276] 0709 12:25:21.531342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.531491 (+   149us) service_pool.cc:224] Handling call
0709 12:25:21.531849 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.532040 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:24.029861 (+2497821us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.157283 (+127422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:24.157332 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:24.157375 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.157451 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:24.157567 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":465973,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":78,"thread_start_us":2619623,"threads_started":2}
I20260709 12:25:24.173403 31046 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:24.173622 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.114673  2403 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.175240 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.136917  2232 consensus_queue.cc:1059] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:25:24.177609 31049 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:24.178120 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.178694 31043 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.179270 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.178835 31014 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:24.180413 31587 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:24.183425 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:24.184228  2457 raft_consensus.cc:3055] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:24.184688  2457 raft_consensus.cc:740] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:24.185863  2486 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:24.185519  2457 consensus_queue.cc:260] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.186702  2457 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.190618 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.171478  2414 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.191784 31043 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:24.196048 31047 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:24.191358 31617 raft_consensus.cc:2393] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:24.204589 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c42f8452db3546feaba1bef22141480f"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:24.209024 30901 raft_consensus.cc:606] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:24.211961 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 286386us
I20260709 12:25:24.213250 31014 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.203917  2458 raft_consensus.cc:2804] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:24.178586  2259 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.201386  2401 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:24.220624 31624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 930) took 2223 ms (client timeout 1838 ms). Trace:
W20260709 12:25:24.221030 31624 rpcz_store.cc:269] 0709 12:25:21.996919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.757385 (+760466us) service_pool.cc:224] Handling call
0709 12:25:24.220443 (+1463058us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54006bb554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:24.220564 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396401536}
I20260709 12:25:24.219215 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:24.218343 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.171321  2468 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.222476  2142 consensus_queue.cc:1059] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:24.225412 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.228976 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.229772 31615 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:24.217922 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.230123 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.231173  2403 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.205266  2396 consensus_queue.cc:237] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.231196 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.247149 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.231895 30901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
W20260709 12:25:24.232606 31588 connection.cc:256] RPC call timeout handler was delayed by -2.1189312699998482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 12:25:24.247423 31014 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:24.234746 30973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41634 (request call id 1969) took 2421 ms (client timeout 1708 ms). Trace:
I20260709 12:25:24.248211 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:24.248590 30973 rpcz_store.cc:269] 0709 12:25:21.813157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.234552 (+2421395us) service_pool.cc:211] Skipping call since client already timed out
0709 12:25:24.234665 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:25:24.235783 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.249327 31620 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:24.249433 30976 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:24.236055 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.237027 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.218772  2323 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:24.250725 30974 raft_consensus.cc:2410] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:24.236137  2402 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.250535  2473 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.238611 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.215243  2373 consensus_queue.cc:1048] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:24.240025 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.241102 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.238232 30900 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:24.243521 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.252085 30969 raft_consensus.cc:3060] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.214941  2328 raft_consensus.cc:2804] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:24.211922  2399 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.247808 30901 raft_consensus.cc:606] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:24.264811 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08000b04a0 after lost signal to thread 31000
I20260709 12:25:24.218147  2491 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.237998 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.266395  2323 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:24.266607 30972 raft_consensus.cc:3060] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.245075  2458 raft_consensus.cc:697] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 12 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:24.266646  2491 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:24.242877 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.265924 30969 raft_consensus.cc:2468] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:24.253466 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.269152 31616 raft_consensus.cc:2376] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7. Re-sending same reply.
I20260709 12:25:24.182796  2490 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:25:24.257222 31621 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 12: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:24.251366  2464 consensus_queue.cc:1059] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:24.259516 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.268507 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:24.277307 31622 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:24.270380 30900 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:24.272037 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.279067 31616 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:24.271572 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800412280 after lost signal to thread 31075
I20260709 12:25:24.272387 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:24.279148 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 673) took 3592 ms. Trace:
I20260709 12:25:24.242472 31624 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:24.278043 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.278358 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:24.280354 30922 debug-util.cc:398] Leaking SignalData structure 0x7b080029ec20 after lost signal to thread 31649
W20260709 12:25:24.280920  2112 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:25:24.267876  2458 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.281298  2409 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.281764  2409 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:24.280659 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800429220 after lost signal to thread 31650
I20260709 12:25:24.182672  2350 consensus_queue.cc:237] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:24.283901 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800373ee0 after lost signal to thread 1825
W20260709 12:25:24.284235 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08000ab180 after lost signal to thread 2076
W20260709 12:25:24.284575 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800195f00 after lost signal to thread 2267
W20260709 12:25:24.284781 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08002de7e0 after lost signal to thread 2268
W20260709 12:25:24.285104 30922 debug-util.cc:398] Leaking SignalData structure 0x7b080034eb00 after lost signal to thread 2305
W20260709 12:25:24.285377 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800398000 after lost signal to thread 2322
W20260709 12:25:24.285585 30922 debug-util.cc:398] Leaking SignalData structure 0x7b080028e620 after lost signal to thread 2326
W20260709 12:25:24.285802 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa7a0 after lost signal to thread 2330
W20260709 12:25:24.286024 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800310780 after lost signal to thread 2333
W20260709 12:25:24.286258 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2e80 after lost signal to thread 2338
I20260709 12:25:24.270972  2323 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:24.286465 30922 debug-util.cc:398] Leaking SignalData structure 0x7b080032b740 after lost signal to thread 2341
W20260709 12:25:24.286877 30922 debug-util.cc:398] Leaking SignalData structure 0x7b0800351640 after lost signal to thread 2349
W20260709 12:25:24.287168 30922 debug-util.cc:398] Leaking SignalData structure 0x7b08003327e0 after lost signal to thread 2355
I20260709 12:25:24.280627  2419 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:25:24.256304  2460 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.287989 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:24.289529 31587 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:24.290686  2464 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:24.291080  2464 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:24.276628  2370 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.293304  2433 raft_consensus.cc:2804] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:24.293819  2433 raft_consensus.cc:697] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:24.286688  2323 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.294659  2433 consensus_queue.cc:237] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:24.296972 31048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46192 (request call id 2278) took 1529 ms (client timeout 1791 ms). Trace:
W20260709 12:25:24.297412 31048 rpcz_store.cc:269] 0709 12:25:22.767439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.277780 (+1510341us) service_pool.cc:224] Handling call
0709 12:25:24.296903 (+ 19123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:24.297183 31621 raft_consensus.cc:2393] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:24.279673 30900 rpcz_store.cc:276] 0709 12:25:20.686742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.692415 (+  5673us) service_pool.cc:224] Handling call
0709 12:25:20.692686 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.589206 (+896520us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b4c003ce6c0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032e8f9a20 00007f032e90aa29 00007f032e8d0644 00007f032e8f7f2d 00007f032e8f7b93 00007f033062818b 00007f0330628cb5 00007f0330623f30 00007f03306257de 00007f033062fb49 00007f0330630416
0709 12:25:24.237876 (+2648670us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b58006623d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03305890aa 00007f033060b447 00007f0330623fe7 00007f03306257de 00007f033062fb49 00007f0330630416 00007f033062cd8f 00007f033062c83e 00007f03355f1419 00007f032eb68bd4
0709 12:25:24.278910 (+ 41034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.279096 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4579560576}
I20260709 12:25:24.300987 31047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:24.301640 31047 raft_consensus.cc:606] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.301693 31616 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:24.305411 31043 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:24.308092 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.308684 30971 raft_consensus.cc:2376] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7. Re-sending same reply.
I20260709 12:25:24.309475 30970 raft_consensus.cc:1240] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:24.309928 30976 raft_consensus.cc:1240] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:24.310645 30972 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:24.307776 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.312294 30969 raft_consensus.cc:2376] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11. Re-sending same reply.
I20260709 12:25:24.325953 31620 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
W20260709 12:25:24.328071 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 80059.8us
I20260709 12:25:24.328167 30974 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 12:25:24.331425 31588 connection.cc:256] RPC call timeout handler was delayed by -1.9101312699999653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
I20260709 12:25:24.328102 30942 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:24.342996 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 124958us
I20260709 12:25:24.305191  2332 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:24.347143 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.347216 31621 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:25:24.351423 31588 connection.cc:256] RPC call timeout handler was delayed by -1.7665544920000684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:25:24.351830 31588 connection.cc:256] RPC call timeout handler was delayed by -1.5676854899998034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 12:25:24.352283 31588 connection.cc:256] RPC call timeout handler was delayed by -1.4098744309999347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 12:25:24.353097 31588 connection.cc:256] RPC call timeout handler was delayed by -1.353031269999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23750000000000002s for a response
W20260709 12:25:24.353380 31588 connection.cc:256] RPC call timeout handler was delayed by -1.3287791339998876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:25:24.353729 31588 connection.cc:256] RPC call timeout handler was delayed by -1.229570333999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 12:25:24.354140 31588 connection.cc:256] RPC call timeout handler was delayed by -1.1266544919999433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2506s for a response
I20260709 12:25:24.347662 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:24.317224  2232 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:24.355082 31616 raft_consensus.cc:3060] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.288125  2460 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.349140  2436 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.319324  2425 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 12:25:24.377358 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.355782  2465 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.379421 31047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:24.383409 31047 raft_consensus.cc:606] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:24.383759 31047 raft_consensus.cc:614] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:24.380566 31588 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:24.381521 30897 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:24.368633  2432 raft_consensus.cc:3055] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:24.364864  2328 raft_consensus.cc:697] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:24.356554  2399 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:24.387950 31588 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.359516  2142 consensus_queue.cc:1059] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:25:24.370904  2232 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:24.385551  2432 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:24.395687 30900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:24.396296 30900 raft_consensus.cc:606] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:24.396615 30900 raft_consensus.cc:614] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:24.385366 31616 raft_consensus.cc:2468] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:24.409812  2434 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.411878 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:24.392287  2468 raft_consensus.cc:2764] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:25:24.395044  2399 raft_consensus.cc:697] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:24.327961  2464 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.386123  2419 consensus_queue.cc:1059] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:25:24.398102  2282 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.379069  2436 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.425062  2232 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.427825  2328 consensus_queue.cc:237] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.430763  2436 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.386479  2465 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.422152  2497 raft_consensus.cc:3055] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:24.450342 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.452061  2432 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.452679 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.453454  2432 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:24.456310  2399 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.460181 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.460076 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.461006 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:24.443363 30864 connection.cc:256] RPC call timeout handler was delayed by -1.0470664909998959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 12:25:24.461730 31618 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:24.462827 30864 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.467783 30864 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:24.471478 31049 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:24.472517  2350 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:24.467558  2401 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.475152 30967 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.471571  2411 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:24.476111  2411 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.476436  2411 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.480643  2460 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.448252  2497 raft_consensus.cc:740] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:24.481426  2485 raft_consensus.cc:3055] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:24.481854  2497 consensus_queue.cc:260] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.482414 30967 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:24.483129  2497 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:24.483503 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 95634.7us
I20260709 12:25:24.438135  2282 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.484828 31588 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:24.485009  2350 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:24.485435  2259 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.485800  2282 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.485940  2350 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.489513  2332 raft_consensus.cc:2764] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:24.490378 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.490970 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.491562 31045 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:24.490448 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.492995 31587 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:24.494609  2498 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:24.499163 30864 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:24.468910  2464 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.480903  2408 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:24.507397 31588 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.481808  2485 raft_consensus.cc:740] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:24.517138 31588 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:24.523772 31588 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.503676  2415 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:24.503894  2282 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.514720  2408 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.517409  2259 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.508701  2491 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:24.526685  2460 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.546089  2282 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.573253 31588 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.580341 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.581100 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:24.581744 31051 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.582695 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.584398 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:24.557157  2415 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:24.557951  2458 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.585283 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:24.592979 31588 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.602038 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.602703 30969 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:24.604089 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.592182 30892 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:24.600872 30894 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:24.596727 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:24.572707  2460 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:24.577028  2282 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.640163 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.591744  2401 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.644754 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 51851.5us
I20260709 12:25:24.644073 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.648403 31051 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:24.647200 30969 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
W20260709 12:25:24.651247 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 54608.6us
I20260709 12:25:24.590847  2259 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.590334  2437 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:24.657029 31588 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:24.659457 30939 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:24.662204 31588 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.672377 30968 raft_consensus.cc:2410] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:25:24.590539  2395 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:24.675400 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:24.676184 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.676860 30969 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.675196 30865 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:24.673786 31588 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.684506 30969 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:24.654011  2460 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.652324  2431 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.643185  2514 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:24.708581 30865 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.676891  2393 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.676446  2294 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:24.683292  2425 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:24.695680  2402 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.676605  2457 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:24.749833  2399 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:24.713768  2481 log.cc:927] Time spent T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:25:24.672968  2323 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.697804  2458 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.697482  2414 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:24.787555 31049 raft_consensus.cc:3055] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:24.787972 31049 raft_consensus.cc:740] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:24.789042  2323 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:24.790916 31042 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:24.786252  2399 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.792948  2399 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.765388 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.641160  2485 consensus_queue.cc:260] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.751699  2393 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.680757  2401 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.715641  2446 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.755864  2294 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.788771 31049 consensus_queue.cc:260] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.684108  2433 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:25:24.856359  2510 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:25:24.696673  2436 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.852169  2399 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:24.857920  2399 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.858251 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.858897 30976 raft_consensus.cc:2376] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8. Re-sending same reply.
W20260709 12:25:24.860190  2517 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.067s	user 0.001s	sys 0.004s
W20260709 12:25:24.861235  2521 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:25:24.862237  2489 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:25:24.862928 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:24.863219  2508 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:25:24.864146 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.868681 30976 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.866487  2465 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.876523 30976 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:24.877349  2401 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.877591 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.835336  2414 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:24.880492  2414 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.682921  2437 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.687510  2395 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.743736  2425 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:24.822211  2507 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 12:25:24.822777  2509 log.cc:927] Time spent T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 12:25:24.820112  2511 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:25:24.743376  2415 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.707499  2396 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 12:25:24.846282 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.912439 30975 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:24.883749 30968 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:24.884884 31588 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.840373  2298 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:24.920099  2298 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.922262 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.923059 30967 raft_consensus.cc:2368] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11.
I20260709 12:25:24.923830 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:24.926847  2331 raft_consensus.cc:3055] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:24.927281  2331 raft_consensus.cc:740] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:24.784161  2457 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:24.867871  2512 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:25:24.929975 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:24.898200  2392 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:24.868077  2431 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:24.883313  2464 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.854777 31049 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:24.914804  2396 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:24.910264  2399 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.916105  2259 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:24.899189  2401 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:24.952523  2401 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.900517  2425 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:24.954475  2396 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.956748  2396 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.915256  2465 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:24.935874  2331 consensus_queue.cc:260] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.957620  2331 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.932767  2402 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:24.954561  2401 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.937760  2431 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.935885  2392 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:24.964759  2516 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:24.965210  2392 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.943248  2437 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.867070  2411 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.966256  2457 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.967602  2411 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.854902  2393 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:24.968668 30976 raft_consensus.cc:2410] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:24.944161 31049 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:25:24.969298  2373 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:25:24.951500 30973 raft_consensus.cc:1240] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:24.970438 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:24.970950 30973 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.908624  2446 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:25:24.922204  2298 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.979450 31588 leader_election.cc:400] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11.
I20260709 12:25:24.980728 31588 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:24.984562  2392 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.990489  2392 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:24.967527  2395 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.969594  2393 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:24.964720  2431 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:24.997711 30973 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:24.984690  2259 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:24.976207  2464 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.010139  2537 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:24.999279  2425 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.018626 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:25.035898 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.019755  2414 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.008927  2282 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.046898  2392 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:25.067947  2540 log.cc:927] Time spent T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:25.071197 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.021353 31620 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:25:25.078246 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.082041  2470 consensus_queue.cc:1059] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:25.082490 30867 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.083153  2470 raft_consensus.cc:3055] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:25.083531  2470 raft_consensus.cc:740] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:25.083895  2350 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.084399  2470 consensus_queue.cc:260] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.085656  2470 raft_consensus.cc:3060] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.087241 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.088523  2464 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.088698  2447 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:25.087553  2542 log.cc:927] Time spent T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:25:25.085549  2337 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:25.090252  2337 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:25.015254  2537 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:25.087978  2480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.005s
W20260709 12:25:25.091391  2480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.005s
I20260709 12:25:25.076790 31619 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:25.093369 30867 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.095865 30867 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:25.096791 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.098099 30867 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:25.015331  2460 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.099658  2410 raft_consensus.cc:2749] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.092810  2537 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.104152  2537 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.104734  2537 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.106534  2282 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:25.107385  2537 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.107280 30967 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:25.108721 30967 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:25.074528  2414 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.066135  2408 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:25.118880 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:25.120481 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:25.112913  2350 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.091066  2337 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:25.123049  2337 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.124552  2414 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.116722  2465 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:25:25.126700 30974 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:25.127421  2460 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:25.127940 30974 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:25.122257 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:25.129444  2350 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.129801  2350 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:25.130154  2350 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.130507 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:25.122170  2461 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:25.131935  2461 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:25.132759  2461 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.115247  2446 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:25.128679 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 1997) took 1225 ms. Trace:
I20260709 12:25:25.134703 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.154953 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:25.156575 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.135273 30897 rpcz_store.cc:276] 0709 12:25:23.903234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.904330 (+  1096us) service_pool.cc:224] Handling call
0709 12:25:23.923355 (+ 19025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:24.384546 (+461191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.128466 (+743920us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540009a954. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:25.128626 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053201152}
I20260709 12:25:25.166476 30898 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:25.166673 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.167116 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.167285 30892 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:25.167631 30901 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:25.124833  2408 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:25.117424  2282 consensus_queue.cc:1059] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:25:25.169929  2488 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.000s	sys 0.014s
I20260709 12:25:25.171586 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:25.122996  2410 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:25:25.166194  2446 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:25.165175  2460 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:25:25.170002  2348 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:25:25.176018 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:25.177114 30897 raft_consensus.cc:1240] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:25.179890  2425 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:25:25.182854 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:25.183869 31042 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:25.184718 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:25.174952  2488 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.015s
W20260709 12:25:25.189481  2538 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:25:25.186664 30974 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:25.196604 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:25.192894  2350 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.197871  2446 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.198853  2350 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:25.202718 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.203656 30897 raft_consensus.cc:1240] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.206521 30892 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.211683 30892 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.212605 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:25.200740  2433 raft_consensus.cc:3055] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:25.220222 30892 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:25.222283 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:25.224368  2499 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.815s	user 0.001s	sys 0.001s
I20260709 12:25:25.214442  2433 raft_consensus.cc:740] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:25.226534  2433 consensus_queue.cc:260] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.227319  2409 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.227675  2433 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.213599  2350 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:25:25.263618 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.268676 30970 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:25:25.276067 30892 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.277491 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.278180 31620 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:25.281893 30894 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:25.282460 30970 pending_rounds.cc:85] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 9
I20260709 12:25:25.284967 30970 pending_rounds.cc:107] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:25:25.285269 30970 raft_consensus.cc:2889] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.288388 31619 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:25.291038  2537 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:25.305985  2537 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:25.309569 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:25.310561  2537 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:25.306136  2527 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:25:25.313406  2474 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:25.314222  2474 consensus_queue.cc:1243] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer 5e9d2b069edc4166802ee0456ebcb706 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:25.314704  2474 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:25.315018  2474 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:25.317097 30968 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:25:25.317545 30968 pending_rounds.cc:85] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 4
I20260709 12:25:25.317633 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.318836 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.319463 31049 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:25.320387 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.321471 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.327049 30968 pending_rounds.cc:107] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:25:25.327390 30968 raft_consensus.cc:2889] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.292589  2456 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:25:25.292707  2497 consensus_queue.cc:1059] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:25.396632 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.397251 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:25.398187  2313 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.398613  2313 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.398955  2313 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.300195  2480 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:25.352203 31051 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:25.355379 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.353566 30968 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:25.400048  2480 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:25.356482 30939 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:25.400475  2480 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:25.400882 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44471.2us
I20260709 12:25:25.401294  2480 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:25.402422 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:25.358904  2546 log.cc:927] Time spent T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:25:25.403095 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.403468 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.359894  2294 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:25.362237  2550 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:25:25.360788  2548 log.cc:927] Time spent T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:25:25.405298 31616 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:25.364048  2552 log.cc:927] Time spent T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
W20260709 12:25:25.367835  2554 log.cc:927] Time spent T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:25.365684 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:25.407224 31619 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.370819  2474 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:25.372840 31588 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:25.374856  2496 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:25.375989  2531 raft_consensus.cc:993] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:25.438320 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.376441  2456 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:25.380131 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.381147 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.382140 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.382510 30865 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.383513 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.385685  2298 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:25.386299 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.444362 31045 raft_consensus.cc:2410] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:25.387831 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.391950  2411 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:25.394464  2470 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.395416 30894 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:25.462149 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.395319 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.395990 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.396251 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.398955  2112 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:25.460942  2328 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:25:25.466759  2112 raft_consensus.cc:3055] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:25.467118  2112 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:25.467852  2112 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.468958  2112 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.402529  2464 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.471915  2464 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.472301  2464 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:25.474186  2551 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 12:25:25.402055 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.407487 31621 raft_consensus.cc:1240] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.358150  2436 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.414615 30969 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:25.402559  2480 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.435068 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:25.438200 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 65449us
W20260709 12:25:25.452059 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 69643.6us
I20260709 12:25:25.464371 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:25.465368 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.363842 30976 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:25.479238 30942 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.493472 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.494946 31616 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:25.479755 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:25.498198 30967 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:25.481371 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.499826 30867 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.450656  2282 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:25.496302  2460 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.514163  2460 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.500937  2431 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:25.503429  2490 raft_consensus.cc:1081] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:25.518110  2460 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:25.488586 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:25.502947  2436 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.521229  2436 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:25.483032 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:25.523311  2431 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.522734 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:25.523756  2491 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:25.526561 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:25.331848 30787 maintenance_manager.cc:643] P 68e5ef8bf7224b3eb4f5bc33c89543d4: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.037s	user 0.159s	sys 0.071s Metrics: {"bytes_written":29703,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":106889,"dirs.run_cpu_time_us":445,"dirs.run_wall_time_us":15346,"drs_written":1,"lbm_read_time_us":243,"lbm_reads_lt_1ms":4,"lbm_write_time_us":131120,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":196545,"threads_started":2,"update_count":12,"wal-append.queue_time_us":116275}
I20260709 12:25:25.502580 30898 raft_consensus.cc:2393] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:25.482407 30894 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:25.460783  2537 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:25:25.450846  2456 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:25.440508  2298 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.464370  1944 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:25.540895 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 57941.1us
I20260709 12:25:25.541426  2436 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.526008  2431 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:25.548157 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48433.1us
W20260709 12:25:25.549182 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 53135.1us
I20260709 12:25:25.546116 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:25.479177  2470 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:25.501403  2392 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.613752  2474 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.463913  2457 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:25:25.608112 30788 maintenance_manager.cc:419] P 68e5ef8bf7224b3eb4f5bc33c89543d4: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10567 bytes on disk
I20260709 12:25:25.609031  2537 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:25.611173  2510 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:25.565806 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.612151 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:25.610617  2298 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.480405  2411 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.634233  2425 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.542984  2328 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.501704  2473 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
W20260709 12:25:25.618901 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.549070  2409 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:25.627712 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 81680.5us
I20260709 12:25:25.551656 31618 raft_consensus.cc:1275] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:25.632705 30893 raft_consensus.cc:2410] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:25.605127  2460 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:25:25.639452  2392 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.647208 30787 maintenance_manager.cc:643] P 68e5ef8bf7224b3eb4f5bc33c89543d4: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.011s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":335,"lbm_reads_lt_1ms":4}
I20260709 12:25:25.647445 31016 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.649856 30865 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:25.650887  2431 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:25.687796 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 190310us
I20260709 12:25:25.637704  2294 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:25.640025  2490 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:25:25.649271  2425 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:25.691596 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.704149 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 54367.6us
I20260709 12:25:25.716861 31623 raft_consensus.cc:1275] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:25.717994 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.717065  2282 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:25:25.720611 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.722004 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.722647 31624 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 7: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:25:25.722702 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 75351.9us
I20260709 12:25:25.723336  2232 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.723990  2232 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:25.724433  2232 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.726475  2232 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.728736  2535 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:25.729166  2535 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:25.729564  2535 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.729923 31045 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:25.731487  2496 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.692133  2328 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.732033  2496 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.733706  2328 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:25.724375 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.539553 30967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:41634
W20260709 12:25:25.705669 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 57245.4us
I20260709 12:25:25.736738 30967 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.737128 30967 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.692428 30901 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:25.739137 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:25.704427 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.707517 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:25.672649  2298 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:25.741629 30867 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.743439 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.744046 31045 raft_consensus.cc:1275] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:25.747691 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.734082  2496 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.748734 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.749552 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:25.749720 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.749869  2460 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:25.750254 31623 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:25.750445  2460 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.745267 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:25.751071 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.750105 31044 raft_consensus.cc:3060] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.752045 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.752631  2460 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:25.753154 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.754201 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.754715 31624 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:25.755679 31016 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:25.756434  2451 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:25.756807  2451 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.757098  2451 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.702960  2259 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:25:25.764653  2535 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.766462 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:25.713466  2431 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.768343  2535 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.768791 31051 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:25.770386  2431 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.770913 30969 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:25.717234  2294 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.772006 31013 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:25.772871  2497 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:25.773329  2497 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:25.774109  2497 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:25.776733 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:25.755472 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.697717  2414 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:25:25.642455  2456 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.708657  2408 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.784171 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.784473 31044 raft_consensus.cc:2468] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:25.793440 31045 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 12: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:25.739837  2425 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.797266 31619 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:25.798130 31617 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:25:25.795025 31623 raft_consensus.cc:1275] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:25.746330  2447 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.774115  2294 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.800308 31624 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:25.830308 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:25.832665 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.804366 30942 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.809145 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:25.800575 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 274075us
I20260709 12:25:25.835047 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:25.835354 30942 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:25.801065 30967 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.817492 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:25.778550  2331 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.827098 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:25.839401 31623 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 12: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:25.713009  2468 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:25:25.732019  2348 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:25:25.847975  2470 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:25.833364 31624 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:25.827694 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:25.852193 31051 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:25.712782  2392 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.792330  2337 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.782898  2298 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:25.839411 30942 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:25.846313 30967 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:25.847469 31046 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:25.850214  2573 consensus_queue.cc:1048] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:25.873457 31044 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:25.828171  2431 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:25.934903  2419 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:25:25.939316  2313 consensus_meta.cc:287] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:25:25.830022  2473 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:25.840293  2537 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.839519  1944 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:25.950305 31619 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:25.827000  2409 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:25:25.947268 31587 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:25.850917  2567 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.831733  2436 consensus_queue.cc:1048] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:25:25.982031  2433 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:25:26.003161 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 56162.3us
I20260709 12:25:26.018023 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:26.018698 30894 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 6.
I20260709 12:25:26.003818  2465 raft_consensus.cc:2804] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:25.948359  2419 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:25.832197  2447 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.022710 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:26.026957 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:26.021862 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:26.038079 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:25.995712  2490 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:25.959664  2473 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.039278 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:26.004729  2278 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:26.034207  2499 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:25.955996  2313 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:25.952912  2431 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.024590  2411 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.054186 31619 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.033103  2574 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:26.062831 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:26.068056 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 228714us
I20260709 12:25:26.079324 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:26.046905  2485 raft_consensus.cc:3060] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.046725  2572 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.085857 30970 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:25:26.086630 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:26.056842  2465 raft_consensus.cc:697] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:26.057371  2573 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.085004 30967 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:26.089854 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:26.087699 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:26.095372 31046 raft_consensus.cc:3055] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:26.093526 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:26.093889 30899 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:26.095746 31046 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:26.064671  2567 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:26.028790  2451 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.127341 31046 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.137598 31046 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.139277 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:26.045994  2298 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.139987 30967 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:26.063578  2278 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.092360  2446 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:26.146451 31045 raft_consensus.cc:1240] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:25:26.065130  2490 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.145533 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:26.148603  2563 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:25:26.149178  2491 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.001s
I20260709 12:25:26.074985  2419 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.150451  2392 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.151698  2313 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.152959  2431 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.127137  2567 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.155752 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:26.194898 30967 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
W20260709 12:25:26.148031  2565 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:25:26.156354 31619 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:26.165041 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:26.170836  2112 consensus_meta.cc:287] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.701s	user 0.006s	sys 0.004s
I20260709 12:25:26.171627  2586 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:26.066605  1944 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.172712  2447 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.173038  2451 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.175798  2490 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:26.184904 31046 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:26.187086 30976 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:26.136598  2531 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.198194 31616 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
W20260709 12:25:26.197747 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 176986us
I20260709 12:25:26.092869  2574 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.176779  2446 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:26.207037  2480 consensus_meta.cc:287] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.002s
W20260709 12:25:26.218109 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 128521us
I20260709 12:25:26.218626 31616 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:25:26.218917 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 192034us
I20260709 12:25:26.204424  2419 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.213660 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:26.197561  2567 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:26.210156 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.216212 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:26.231602 31619 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 12: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:26.232429 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:26.232977 31619 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.205446  2586 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.221287 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:26.222927 31616 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
W20260709 12:25:26.248091 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.251214 30900 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:26.235918  2585 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:26.213495  2571 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.245759 30896 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:26.252602 30939 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:26.249486  2480 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.256108  2480 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:26.256453  2278 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.258293  2571 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:26.256558  2480 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.217717  2531 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.211733  2465 consensus_queue.cc:237] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.329026 31048 raft_consensus.cc:1275] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:26.248315  2436 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.282016 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:26.270891 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:26.346531 31049 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:26.266652 31619 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:26.318900 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:26.325486 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 238920us
I20260709 12:25:26.243609  2586 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.346758 31051 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:26.348258 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:26.349630 30942 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:26.261883  2474 consensus_meta.cc:287] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.000s
I20260709 12:25:26.259661  2571 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:26.256198  2596 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:26.287231  2464 consensus_meta.cc:287] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.815s	user 0.006s	sys 0.003s
I20260709 12:25:26.251204  2572 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:26.359481  2598 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:26.365722  2574 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:26.366460  2579 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 12:25:26.367030  2584 log.cc:927] Time spent T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:25:26.359562  2594 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.286717  2259 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.345762  2532 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.374915 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:26.378571 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:26.291222  2587 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.385097 30900 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:26.253371  2425 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.364598  2491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46178 (request call id 91) took 16860 ms. Trace:
W20260709 12:25:26.397784 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 43750.8us
I20260709 12:25:26.401294 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:26.380573  2537 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.376910  2598 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:26.316051  2446 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.377701  2464 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.420768 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:26.423142 30900 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:26.384248  2574 consensus_queue.cc:1048] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:25:26.451916 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.467830 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.413993  2598 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.392493  2259 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.479770  2537 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:26.424417  2594 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 12:25:26.487023  2593 log.cc:927] Time spent T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:25:26.379367  2572 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:26.490947  2601 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:25:26.490742  2537 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.394500  2587 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.499234  2537 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.375955  2596 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.501797  2596 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:26.506213  2559 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.815s	user 0.000s	sys 0.003s
I20260709 12:25:26.506454  2537 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:26.507791  2597 log.cc:927] Time spent T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:25:26.508481  2537 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:26.508684  2602 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:25:26.394485  2532 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.512454  2464 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:26.513429  2577 log.cc:927] Time spent T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260709 12:25:26.515012  2456 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.515420  2572 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.399959  2491 rpcz_store.cc:276] 0709 12:25:09.503888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.504055 (+   167us) service_pool.cc:224] Handling call
0709 12:25:10.287670 (+783615us) log.cc:844] Serialized 480 byte log entry
0709 12:25:26.357573 (+16069903us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":454725,"raft.queue_time_us":480232,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":537,"spinlock_wait_cycles":24448,"thread_start_us":416142,"threads_started":1,"wal-append.queue_time_us":884571,"wal-append.run_cpu_time_us":1697,"wal-append.run_wall_time_us":1001797}
I20260709 12:25:26.526103  2586 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.527410  2587 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.531358  2586 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.535507  2598 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.537611  2567 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:26.538635  2608 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:26.539817  2567 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.540411  2598 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.570133 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2006) took 1364 ms. Trace:
I20260709 12:25:26.570995 30897 rpcz_store.cc:276] 0709 12:25:25.205264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.205384 (+   120us) service_pool.cc:224] Handling call
0709 12:25:25.214490 (+  9106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.214819 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.214845 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.220640 (+  5795us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.414325 (+193685us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:25.414360 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.414418 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.505680 (+1091262us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:26.569451 (+ 63771us) raft_consensus.cc:1685] finished
0709 12:25:26.569490 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.569876 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159991,"raft.queue_time_us":1102,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":83746048,"thread_start_us":181949,"threads_started":1,"wal-append.queue_time_us":397739}
W20260709 12:25:26.576340 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 174977us
I20260709 12:25:26.577734 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:26.583539 30942 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:26.602350 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:26.602977 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:26.603657 31050 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:26.602376 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:26.606801 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:26.609478 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:26.607703 31046 raft_consensus.cc:2393] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:26.618765 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:26.619618 31047 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.609498  2259 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:26.619560  2425 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.632205 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:26.632831  2531 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.641602 31047 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:26.641992  2532 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:26.643175  2573 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:26.642722 31043 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:26.645663  2573 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.646214  2573 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.644167  2585 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:26.645095  2574 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.645439  2586 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:26.659143  2571 raft_consensus.cc:697] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:26.696331  2586 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:26.717980  2586 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.722023 31587 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:26.723881  2567 raft_consensus.cc:2804] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:26.724504  2574 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.724555  2567 raft_consensus.cc:697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:26.726918  2567 consensus_queue.cc:237] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.728657  2571 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.768533  2574 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:26.777170 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 92443.5us
W20260709 12:25:26.780586 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 197298us
I20260709 12:25:26.790537  2480 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.794462  2531 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:26.795341  2531 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.797513  2531 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:26.764775  2585 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:26.818826 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.802886  2480 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.835990  2586 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.838790  2586 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.840557  2586 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.841223  2586 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.843539  2586 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.850231 31042 raft_consensus.cc:2410] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:26.857501  2585 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.833418 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:26.879912  2586 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:26.880730  2586 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.883104  2586 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.898373 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 711) took 1091 ms. Trace:
I20260709 12:25:26.898818 31044 rpcz_store.cc:276] 0709 12:25:25.806835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.816793 (+  9958us) service_pool.cc:224] Handling call
0709 12:25:25.846556 (+ 29763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.944704 (+ 98148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.897871 (+953167us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b54002a6054. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:26.898199 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15169792}
I20260709 12:25:26.905418 31618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44888 (request call id 1061) took 1469 ms. Trace:
I20260709 12:25:26.905892 31618 rpcz_store.cc:276] 0709 12:25:25.435425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.464997 (+ 29572us) service_pool.cc:224] Handling call
0709 12:25:25.468837 (+  3840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.698317 (+229480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.904929 (+1206612us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b540054e554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:26.905228 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189622016}
W20260709 12:25:26.925501 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 108325us
I20260709 12:25:26.928049 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:26.923031  2585 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.929678  2585 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.933506  2337 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:26.937434 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:26.938313 31618 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.938763  2572 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:26.939535  2572 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.942111  2572 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.943887  2621 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:26.944679  2621 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:26.929103 31621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44878 (request call id 957) took 1218 ms. Trace:
I20260709 12:25:26.947858  2392 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:26.948668  2392 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.946923 31621 rpcz_store.cc:276] 0709 12:25:25.710724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.711902 (+  1178us) service_pool.cc:224] Handling call
0709 12:25:26.922462 (+1210560us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b5800003c98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508a22 00007f03364218d9 00007f033557bee0 00007f03356450ab 00007f0335645131 00007f03355f30a0 00007f03355f2984 00007f032eb6d6d4 00007f032eb6d662
0709 12:25:26.929019 (+  6557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10170240}
I20260709 12:25:26.948988  2621 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:26.958685  2572 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:26.973768  2561 log.cc:927] Time spent T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 1.282s	user 0.000s	sys 0.005s
I20260709 12:25:26.978930 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1188) took 1624 ms. Trace:
I20260709 12:25:26.973452  2446 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:25:26.979506 30896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 709) took 1500 ms (client timeout 1940 ms). Trace:
I20260709 12:25:26.974392  2587 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.980325 30865 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:26.981683 30901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2257) took 1573 ms (client timeout 1651 ms). Trace:
I20260709 12:25:26.979364 31620 rpcz_store.cc:276] 0709 12:25:25.354755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.356875 (+  2120us) service_pool.cc:224] Handling call
0709 12:25:25.357184 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.357496 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.357521 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.357936 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.501963 (+144027us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:25.502004 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.502072 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.972838 (+1470766us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:26.978345 (+  5507us) raft_consensus.cc:1685] finished
0709 12:25:26.978364 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.978751 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":956,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":98175744,"thread_start_us":143710,"threads_started":1,"wal-append.queue_time_us":283962}
W20260709 12:25:26.980018 30896 rpcz_store.cc:269] 0709 12:25:25.478940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.479517 (+   577us) service_pool.cc:224] Handling call
0709 12:25:26.979153 (+1499636us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b540033f9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:26.979322 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627365760}
I20260709 12:25:26.982170 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:26.982642  2337 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:26.983892  2465 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.984618  2465 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:26.987033  2465 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:26.987251 30969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 741) took 1280 ms (client timeout 1542 ms). Trace:
W20260709 12:25:26.987663 30969 rpcz_store.cc:269] 0709 12:25:25.707162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.707290 (+   128us) service_pool.cc:224] Handling call
0709 12:25:26.986901 (+1279611us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b54001e6ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:26.987064 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70380288}
I20260709 12:25:26.983577  2337 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.990329  2620 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:26.991082  2620 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:26.992674  2618 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.192s	user 0.000s	sys 0.002s
I20260709 12:25:26.994194  2622 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.993455  2620 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:26.997570 31620 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:26.998252 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:26.998792 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:26.999217 31617 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:26.994992  2622 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.001551 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:27.002081  2622 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.002606  2282 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:27.003044 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.003224  2282 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.005635  2282 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.006625  2461 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.007519 31045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2312) took 1165 ms. Trace:
I20260709 12:25:27.007902 31045 rpcz_store.cc:276] 0709 12:25:25.841914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.842631 (+   717us) service_pool.cc:224] Handling call
0709 12:25:25.922114 (+ 79483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:26.156719 (+234605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.006993 (+850274us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540015b3d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:27.007353 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515400960}
I20260709 12:25:27.008481  2348 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:27.009395  2348 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.009721 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f02e5ab61a44506bdae958f8a275d96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 12:25:27.001667 31042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 705) took 1258 ms. Trace:
I20260709 12:25:27.045401  2348 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.050586 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:27.050942 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.054246  2373 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.055146  2373 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.055631 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.056550 31047 raft_consensus.cc:2410] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:27.057400 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.058136 31620 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:27.058702  2392 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.059511  2586 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:27.059984  2586 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:27.058605  2581 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.887s	user 0.001s	sys 0.001s
I20260709 12:25:27.060415  2586 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.007318  2461 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:27.059876 30893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2255) took 1658 ms (client timeout 2045 ms). Trace:
W20260709 12:25:27.061686 30893 rpcz_store.cc:269] 0709 12:25:25.401083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.402878 (+  1795us) service_pool.cc:224] Handling call
0709 12:25:27.059475 (+1656597us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400032fd4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:27.059684 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525612800}
I20260709 12:25:27.057278  2373 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:27.062414  2461 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.064716  2585 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.065728 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.066463 31049 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:27.067693 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:27.068460 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.067286 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:27.002236 31622 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.067854 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.072139 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2015) took 1331 ms. Trace:
I20260709 12:25:27.072177  2331 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:26.992753  2573 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.075760 30975 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:27.075932  2573 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.072446 31615 raft_consensus.cc:2410] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:27.012413 31042 rpcz_store.cc:276] 0709 12:25:25.743047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.743184 (+   137us) service_pool.cc:224] Handling call
0709 12:25:27.001442 (+1258258us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540013f954. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:27.001600 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2536582400}
I20260709 12:25:27.073632  2331 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:27.045804  2625 log.cc:927] Time spent T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:25:26.982059 30901 rpcz_store.cc:269] 0709 12:25:25.407942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.465153 (+ 57211us) service_pool.cc:224] Handling call
0709 12:25:26.981327 (+1516174us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400099f54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:26.981497 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467949952}
I20260709 12:25:27.076637 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:25.164786 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:27.090252 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.072563 30892 rpcz_store.cc:276] 0709 12:25:25.740695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.740819 (+   124us) service_pool.cc:224] Handling call
0709 12:25:25.741112 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.741408 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.741436 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.741887 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.998872 (+256985us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:25.998914 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.998980 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:27.057805 (+1058825us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:27.068921 (+ 11116us) raft_consensus.cc:1685] finished
0709 12:25:27.068944 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:27.071939 (+  2995us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33482,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":6761856,"thread_start_us":250614,"threads_started":1,"wal-append.queue_time_us":384153}
I20260709 12:25:26.979974  2446 consensus_queue.cc:1243] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer f868402d5ae640e7b362b9fddacbaf44 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:27.095752 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:27.099800 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:27.099957  2332 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.100544  2332 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.101330 31620 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:27.102440 31048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46192 (request call id 2297) took 2523 ms. Trace:
I20260709 12:25:27.102820 31048 rpcz_store.cc:276] 0709 12:25:24.579326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.585937 (+  6611us) service_pool.cc:224] Handling call
0709 12:25:24.590563 (+  4626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.344052 (+1753489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.101997 (+757945us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400163354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:27.102244 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3992449280}
I20260709 12:25:27.110430  2460 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:27.112067  2473 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.102926  2332 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.112067  2451 consensus_queue.cc:1048] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:25:27.113430 30971 raft_consensus.cc:1240] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:27.117115 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:27.117853 30968 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:27.118777  2479 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.119442 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.119506  2479 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.120281 31047 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:27.120790 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:27.123802 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.095361  2465 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:27.125072  2465 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.118852 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:27.124565 31043 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:27.103499 30975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2358) took 1018 ms. Trace:
I20260709 12:25:27.131044 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:27.131363 30899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2256) took 1729 ms (client timeout 2199 ms). Trace:
I20260709 12:25:27.131068 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.132285  2348 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:27.133419 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.134042 31617 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:27.128607 30968 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:27.134878 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.136511 31048 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:27.140643 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:27.134864 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.141474 30972 raft_consensus.cc:2368] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13.
I20260709 12:25:27.124504 31045 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:27.129755 30975 rpcz_store.cc:276] 0709 12:25:26.085159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.086760 (+  1601us) service_pool.cc:224] Handling call
0709 12:25:27.011170 (+924410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.088085 (+ 76915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.102638 (+ 14553us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b54001e6ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:27.103318 (+   680us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54001e6ed0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:27.103429 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272876160}
W20260709 12:25:27.131747 30899 rpcz_store.cc:269] 0709 12:25:25.401354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.403261 (+  1907us) service_pool.cc:224] Handling call
0709 12:25:27.130948 (+1727687us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400208354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:27.131189 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586023680}
W20260709 12:25:27.124732  2419 consensus_meta.cc:287] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.005s
I20260709 12:25:27.157413 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.160076 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.161631 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.163132  2532 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.165807 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.166551 30900 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:27.163496 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.167097 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:27.168535 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.165635  2532 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.157793 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.173645 31617 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.980612  2587 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.170261 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:27.166973  2479 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:27.169179 31623 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:27.080329  2572 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.141019  2411 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:27.181845 31050 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:27.167587 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:27.173549 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:27.171557 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:27.188400 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.171226  2465 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.210229 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.214661 30901 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:25:27.216051 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 104461us
I20260709 12:25:27.217434 30900 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:27.184834  2411 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.228883 31621 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:27.206871  2479 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.227308 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.239836 31051 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:27.240281  1944 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.240926  1944 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.241880  2451 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.242497  2451 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.244097  1944 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.244839  2451 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.245941 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.233362 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:27.252513 30893 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:27.253958 31051 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:27.254930  2451 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.255618  2451 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.263080  2451 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.264592  2497 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:27.265056  2497 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.265399  2497 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.266927  2331 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:27.267395 31622 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:27.241801 30899 raft_consensus.cc:2410] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:27.227984  2411 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.270043  2451 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.279918 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:27.281286  2532 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:27.287842  2572 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.288338 30798 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.289093 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.296008 30967 raft_consensus.cc:1240] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:27.300308 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:27.279858 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:27.308040 31617 raft_consensus.cc:2468] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:27.299160 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:27.318006 31618 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:27.327075 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:27.326391 30975 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:27.285506  2586 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.326462  2480 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.344727  2480 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.346545 30968 pending_rounds.cc:85] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 7
I20260709 12:25:27.346864  2480 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:27.347803 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 68094.4us
I20260709 12:25:27.348577 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:27.349591  2332 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:27.349969  2332 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.350366  2332 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.351016 31051 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:27.346877 30968 pending_rounds.cc:107] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 12:25:27.352072 30794 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53558 (request call id 356) took 21699 ms (client timeout 15000 ms). Trace:
I20260709 12:25:27.352268 30968 raft_consensus.cc:2889] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:27.352563 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:27.353338 30967 raft_consensus.cc:1813] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Handling vote request from an unknown peer 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:27.353677 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.353897 30967 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:27.349743 30865 leader_election.cc:400] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13.
I20260709 12:25:27.355198 30865 leader_election.cc:403] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:27.354617 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.313908  2479 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.373813 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.376523  2348 consensus_queue.cc:1059] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:27.338790  2259 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:27.378998 31622 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:27.319694  2451 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.370353 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.379804 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.380404 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.385917 30972 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:27.389358  2527 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:27.390028  2527 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.392084 31588 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:27.396081 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.397590 30798 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.397776 31620 raft_consensus.cc:2955] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:27.400758 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 76151.6us
I20260709 12:25:27.401577  2473 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:27.376608  2436 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:25:27.402235  2473 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.399389 30939 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:27.403862  2573 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:27.404443  2573 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.405650 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:27.406100 30898 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:27.406580  2573 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.401531 31013 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:27.404310  2585 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:27.407055 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:27.399163 30798 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.416322 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:27.416978 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 222074us
I20260709 12:25:27.420085 30892 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:27.417138 31624 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:27.424028 31587 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:27.424284  2473 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.369894  2460 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:25:27.413618  2585 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.425266  2585 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.425632  2587 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.426152  2587 raft_consensus.cc:2764] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:27.413611  2480 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.428745  2433 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:27.415513  2573 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:27.429491  2573 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:27.429342  2433 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.430485  2573 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.430953 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:27.431829 30973 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:27.430836 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.432992 31042 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:27.434018 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.434140  2572 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:27.435111  2572 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.435504  2572 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.422089 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:27.438472 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.367689  2282 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:25:27.444370 31624 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:27.417284  2348 raft_consensus.cc:3055] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:27.421727 30798 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.431525  2433 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.455916 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.457002 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.446656  2348 raft_consensus.cc:740] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:27.453572 30798 catalog_manager.cc:5697] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 11, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.478048 30867 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:27.478364 30798 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 7 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.477111  2415 consensus_queue.cc:1059] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:25:27.479959  2527 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.476459  2473 consensus_queue.cc:1059] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:25:27.480492  2415 raft_consensus.cc:3055] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:27.481619  2415 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:27.352422 30794 rpcz_store.cc:269] 0709 12:25:05.652788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.653127 (+   339us) service_pool.cc:224] Handling call
0709 12:25:06.250749 (+597622us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54001d0510. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d5090b2 00007f0336482759 00007f033641aa76 00007f03363ebd58 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc
0709 12:25:27.351804 (+21101055us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:22.690569 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:22.691101 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:22.691153 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:25:22.691172 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:22.692253 (+  1081us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:22.692344 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:22.692374 (+    30us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:25:22.693382 (+  1008us) tablet.cc:701] Row locks acquired
0709 12:25:22.693428 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:25:22.693588 (+   160us) write_op.cc:270] Start()
0709 12:25:22.693725 (+   137us) write_op.cc:276] Timestamp: P: 1783599922693522 usec, L: 0
0709 12:25:22.693748 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:22.694441 (+   693us) log.cc:844] Serialized 4689 byte log entry
0709 12:25:23.038443 (+344002us) op_driver.cc:464] REPLICATION: finished
0709 12:25:23.129782 (+ 91339us) write_op.cc:301] APPLY: starting
0709 12:25:23.129886 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:23.130838 (+   952us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:23.130959 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:23.132015 (+  1056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:23.132247 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:25:23.132275 (+    28us) write_op.cc:312] APPLY: finished
0709 12:25:23.132543 (+   268us) log.cc:844] Serialized 89 byte log entry
0709 12:25:23.132723 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:23.132866 (+   143us) write_op.cc:454] Released schema lock
0709 12:25:23.132931 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:23.133370 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:23.133397 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":650405,"reported_tablets":45,"spinlock_wait_cycles":165869952,"child_traces":[["op",{"apply.queue_time_us":91052,"apply.run_cpu_time_us":3544,"apply.run_wall_time_us":3548,"num_ops":12,"prepare.queue_time_us":62059,"prepare.run_cpu_time_us":13576,"prepare.run_wall_time_us":175970,"raft.queue_time_us":105989,"raft.run_cpu_time_us":9551,"raft.run_wall_time_us":91929,"replication_time_us":342912,"thread_start_us":391113,"threads_started":4,"wal-append.queue_time_us":183204,"wal-append.run_cpu_time_us":35088,"wal-append.run_wall_time_us":1276850}]]}
I20260709 12:25:27.482714  2415 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.487869  2350 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:27.480621 31615 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.483866  2433 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:27.481590  2473 raft_consensus.cc:3055] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:27.517221 30901 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
W20260709 12:25:27.527765 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 389632us
I20260709 12:25:27.530632 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:27.535356 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.535642 30942 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:27.520182  2473 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:27.548691  2415 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.549134  2431 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:27.549291  2473 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.550755  2473 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.550858 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.552582 30798 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 9 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.553537  2594 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.554193 30798 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 6, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 6 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.555864  2408 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13.
I20260709 12:25:27.557286  2411 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.559383  2411 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.528119  2433 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:27.560353  2594 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:27.561141  2433 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.562112  2594 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:27.564056  2594 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.564424  2348 consensus_queue.cc:260] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.565575  2348 raft_consensus.cc:3060] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.565996  2332 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.575402 30864 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:27.576303 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 152633us
I20260709 12:25:27.582561 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:27.580268 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 102418us
I20260709 12:25:27.596956 30865 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:27.602661 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.603173 30967 raft_consensus.cc:1240] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: [7.10-7.10]
I20260709 12:25:27.604250 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.605535 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:27.606995 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.607615 30898 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:27.607981 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:27.519692  2571 consensus_queue.cc:1048] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:25:27.608505 30975 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.612005  2652 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.614176 30798 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 6, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.535919  2461 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.616905 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:27.564133  2282 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:27.649859 31615 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:27.526765  2350 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.612674  2652 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.666116 30798 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 7 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.553845  2572 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.648437  2408 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:27.599378  2431 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:25:27.676594 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:27.676196  2408 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.679692  2408 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.679807  2294 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:27.680241  2294 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.680567  2294 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.681643  2342 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:25:27.682652  2596 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:27.683240  2596 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:27.685313 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 127209us
I20260709 12:25:27.686800 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:27.664104  2586 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.668217  2479 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:27.667987  2419 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.657671  2497 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.668633  2282 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.689881  2594 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.704367  2465 raft_consensus.cc:3055] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:27.704614  2282 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.699390 30975 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:27.677083  2332 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.688862  2531 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.709383  2465 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:27.761701  2596 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.764907  2451 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:27.784703 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 169109us
I20260709 12:25:27.753252  2586 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.785979 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.753062  2392 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:27.805822 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:27.805873 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.881546 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:27.745435  2419 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.880825 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:27.881896 30798 catalog_manager.cc:5697] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 7, leader changed from <none> to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 7 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.746026  2585 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.786728  2571 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:27.890128 31044 raft_consensus.cc:3060] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.883594 31619 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:27.811369  2480 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:27.897591 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 277337us
W20260709 12:25:27.892429 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 452166us
I20260709 12:25:27.892452  2594 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:27.786124  2531 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.897245  2282 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.917336 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:27.918720 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:27.922006 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 305088us
I20260709 12:25:27.918162 30798 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 9, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:27.888914  2479 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:25:27.950366  2655 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:27.957012 31043 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:27.958616 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:27.966817 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 159340us
W20260709 12:25:27.966890 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 48279.5us
W20260709 12:25:27.969440 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 282707us
I20260709 12:25:27.970221 30942 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:27.909711  2480 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:27.974522 30942 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:27.944927  2460 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:27.988080 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 83562.6us
I20260709 12:25:27.980225 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:27.942098  2350 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.951051  2655 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.919847  2465 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.978752  2573 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:27.962442  2282 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.941044  2571 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:27.980038  2572 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:27.991854 30798 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 7 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:28.001411  2596 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:27.972918  2652 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:28.019789 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:28.010732  2431 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:28.044113  2664 raft_consensus.cc:3055] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:25:28.056439 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 51786.3us
I20260709 12:25:28.017864  2573 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:28.072151 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 103914us
I20260709 12:25:28.009049  2460 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:28.071094 31587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.555s (SENT) [suppressed 18 similar messages]
I20260709 12:25:28.047232  2431 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.069190  2573 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.062467  2594 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:28.056831  2664 raft_consensus.cc:740] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:28.074813  2653 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.098225 30798 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 10 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:28.099275 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 110285us
W20260709 12:25:28.093087  2648 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:25:28.106984 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 137897us
W20260709 12:25:28.100665 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 163902us
I20260709 12:25:28.089438  2431 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:28.110867 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 438789us
I20260709 12:25:28.111888 30939 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.111076  2498 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:28.118637 31016 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:28.119405  2498 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.119837  2498 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.120107  2451 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:28.120502  2451 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.120842  2451 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.123277 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:28.123853 31623 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.123962 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.124238 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.124627 31615 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:28.127750  2498 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.081115  2337 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:28.099428  2419 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.132035 31623 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
W20260709 12:25:28.133183 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 66841.5us
I20260709 12:25:28.133613 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:28.136298 30798 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:28.108577  2531 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.108834  2594 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:28.138051  2596 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:28.141115 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:28.141502 30942 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:28.142107 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:28.142657  2670 raft_consensus.cc:2804] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:28.143220 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:28.145390 31051 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.104665  2651 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.172s
I20260709 12:25:28.146062  2649 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.146441 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.146821  2480 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:28.147945  2282 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:28.148705 30969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2364) took 1077 ms. Trace:
I20260709 12:25:28.149020  2571 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.141671 31043 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.139518 31016 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:28.158879 30798 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:28.167939 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56152.2us
W20260709 12:25:28.168218  2661 log.cc:927] Time spent T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:25:28.168924 30939 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.169767  2596 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.146632  2649 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:28.174705 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.143199  2670 raft_consensus.cc:697] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:28.174873 30939 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.175068  2649 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.175783  2673 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:28.175968  2670 consensus_queue.cc:237] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.176918 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.177666  2673 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.178346  2673 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:28.178925  2659 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:25:28.178830  2673 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.149056 30969 rpcz_store.cc:276] 0709 12:25:27.071178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.079940 (+  8762us) service_pool.cc:224] Handling call
0709 12:25:27.089618 (+  9678us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:27.229807 (+140189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.229838 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:27.257345 (+ 27507us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b2c00010828. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032ef26a11 00007f032ef36372 00007f0330668a01 00007f033062d43a 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2
0709 12:25:27.258075 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 12:25:27.532081 (+274006us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:27.532121 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.148414 (+616293us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001b9ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:28.148458 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.148498 (+    40us) raft_consensus.cc:1685] finished
0709 12:25:28.148511 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.148631 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6332,"raft.queue_time_us":6528,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10418,"spinlock_wait_cycles":289299072,"thread_start_us":273582,"threads_started":1,"wal-append.queue_time_us":351255}
I20260709 12:25:28.159452  2585 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.180938  2673 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.157850  2682 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:28.184303 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.184930 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.195804 30939 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.197373 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.199945 30798 catalog_manager.cc:5697] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 1 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 7 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:28.201524 31043 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:28.203794 30798 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:28.205761 30798 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 8, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 8 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:28.216698 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 70325.5us
I20260709 12:25:28.218048 31014 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.198611 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.221493 30972 raft_consensus.cc:2393] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:28.225883 30798 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:28.198935  2531 raft_consensus.cc:2804] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:28.202011  2585 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:28.227972 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.198451  2649 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.196713  2688 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:28.251034  2649 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.251026  2688 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.252210  2688 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.253168  2649 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:28.253502  2669 log.cc:927] Time spent T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:25:28.253720  2282 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:28.254583  2657 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 12:25:28.254278  2282 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.256434  2282 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:28.262002  2473 consensus_meta.cc:287] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.005s
I20260709 12:25:28.242630 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:28.243337  2294 consensus_meta.cc:287] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.003s
I20260709 12:25:28.169019  2408 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.246997  2596 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.247223  2676 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:28.249429 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:28.250470  2498 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:28.266089 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 195011us
W20260709 12:25:28.266836 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 99302.8us
I20260709 12:25:28.267853 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.278661 30975 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:28.117027  2653 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.281172 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:28.281386 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.232558  2655 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.199517  2673 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:28.270793 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 71522.8us
I20260709 12:25:28.252419  2451 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.273867  2675 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:25:28.274132 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.275161 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.299962 30898 raft_consensus.cc:2393] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:28.243273 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.272840 30798 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 9, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:28.278141  2567 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.300367 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:28.284672 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.283015 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.286659 30900 raft_consensus.cc:2393] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:28.287705 30865 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:28.273545  2656 log.cc:927] Time spent T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:25:28.289129 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:28.303938 31051 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.289366  2679 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:28.289688 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e64945a8b39400e851326d79a2f4d8d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.290534 30973 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:28.292053 30864 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:28.292189 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:28.289321 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.184312  2682 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.289260 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.298938 31046 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:28.265302  2585 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:28.319895 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.322392 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.318691 30892 raft_consensus.cc:2376] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13. Re-sending same reply.
I20260709 12:25:28.278009  2676 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:28.269893  2294 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.307708 31618 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:28.294230  2653 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.304042 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:28.322719 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.337337 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.336138 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.276567  2531 raft_consensus.cc:697] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:28.302310 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.339372 30899 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:28.332842 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.345238 31623 raft_consensus.cc:2410] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:28.304518  2419 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:28.338512 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.307610  2673 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.340287 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.337868 30976 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:28.307552  2679 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:28.350387 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 50098.2us
I20260709 12:25:28.347373 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:28.345906 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:28.319370  2411 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.323642  2585 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.321508  2683 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:28.346391  2473 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.288147  2596 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.354351 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:28.254221  2594 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.357012 30901 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:28.355846  2684 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:28.354947 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.384732 30973 raft_consensus.cc:2410] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:25:28.359632 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:28.365772  2668 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:28.366679  2537 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:28.366819  2531 consensus_queue.cc:237] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.351871  2679 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.368352 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.338882  2460 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.394109  2537 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:28.375113 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 71167.4us
I20260709 12:25:28.368608 30893 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:28.358522 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:28.381640 31044 raft_consensus.cc:2468] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:28.322531  2567 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.354997  2532 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.394068 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.402169 31046 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:28.439885 31617 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.399636 31045 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:28.442246 31051 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
W20260709 12:25:28.441270 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 47313.5us
I20260709 12:25:28.380970  2342 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.444319 31615 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:28.449388 30939 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:28.402892  2408 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:28.443280  2415 consensus_meta.cc:287] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.894s	user 0.011s	sys 0.000s
I20260709 12:25:28.471596 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:28.475468 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:28.476497 31047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34990 (request call id 726) took 1347 ms. Trace:
I20260709 12:25:28.442535  2537 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.476873 31047 rpcz_store.cc:276] 0709 12:25:27.128812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.128932 (+   120us) service_pool.cc:224] Handling call
0709 12:25:27.134132 (+  5200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.134638 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:27.450771 (+316133us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.751109 (+300338us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.751340 (+   231us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.811127 (+ 59787us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.884584 (+ 73457us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:27.886525 (+  1941us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.894917 (+  8392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.895007 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.242972 (+347965us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b1800490360. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d540522 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:25:28.255898 (+ 12926us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800490360. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:25:28.476277 (+220379us) raft_consensus.cc:1685] finished
0709 12:25:28.476300 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.476435 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16932,"prepare.queue_time_us":74083,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":99,"raft.queue_time_us":8974,"raft.run_cpu_time_us":460,"raft.run_wall_time_us":36508,"spinlock_wait_cycles":26897536,"thread_start_us":497922,"threads_started":2,"wal-append.queue_time_us":486935}
I20260709 12:25:28.481585 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:28.489274 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 93698.9us
I20260709 12:25:28.450165  2683 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:28.475960  2473 raft_consensus.cc:2804] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:28.513120 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:28.515021 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 134196us
I20260709 12:25:28.515208 31618 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.515358 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.473897  2460 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:25:28.496863 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.497152 30970 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:28.498811 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.503624  2451 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.503988 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.504853  2684 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:28.505466 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:28.506763  2348 consensus_meta.cc:287] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.941s	user 0.009s	sys 0.002s
I20260709 12:25:28.507681  2411 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:28.510365  2585 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.513120 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.475996  2342 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.479230  2392 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:28.471258  2446 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:28.516721 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.511492 30867 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.522445 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:28.523824 30865 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:28.524004 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.525070 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.525326 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.525534  2532 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:28.490914  2670 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:28.562105 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 45466.7us
W20260709 12:25:28.495895  2586 consensus_meta.cc:287] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.002s
I20260709 12:25:28.536391 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:28.563827 31624 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.545039 30895 raft_consensus.cc:2410] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
W20260709 12:25:28.564682 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 53268.1us
I20260709 12:25:28.548127 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.399999  2676 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.488284  2431 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.522931 31588 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:28.569341 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 45603.1us
I20260709 12:25:28.532905  2473 raft_consensus.cc:697] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:28.566658 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.567902 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.568584 30973 raft_consensus.cc:1240] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:28.571197 31014 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:28.559065  2647 log.cc:927] Time spent T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.779s	user 0.000s	sys 0.002s
I20260709 12:25:28.573556 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.576839 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.576478 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.579291 30970 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 13: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:25:28.579793 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 56928.1us
I20260709 12:25:28.577744 30976 raft_consensus.cc:2393] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:28.586267 30975 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:28.562359  2670 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.561945  2532 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:28.530900  2460 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.603627 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.569424  2586 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.609257 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.609867 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.610731  2596 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.612709  2674 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.614092  2585 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.614734 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.616117  2337 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:28.616343  2698 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:25:28.616650  2703 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:28.617492  2679 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.618402 31044 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:28.606254  2479 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:28.621704 30969 raft_consensus.cc:1275] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:28.569129  2571 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.625855 30974 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:28.549015  2411 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.580375  2572 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:25:28.577440  2282 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:28.638134 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 75057.1us
I20260709 12:25:28.641373 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.579984  2649 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:28.651412 30972 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:28.619540 31618 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:28.624372  2670 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:28.634694  2461 consensus_meta.cc:287] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.989s	user 0.007s	sys 0.004s
I20260709 12:25:28.638099  2676 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.643810 31617 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:28.609295  2342 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.625195  2532 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.650583 30942 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.579630  2446 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.638818  2678 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:28.653138 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 60616.8us
I20260709 12:25:28.634963  2596 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.658062 31016 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:28.660646 30942 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.666720 30942 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:28.651950  2573 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.002s
I20260709 12:25:28.662696 30968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2380) took 1331 ms. Trace:
I20260709 12:25:28.632699  2688 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.633883  2408 consensus_queue.cc:1059] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:25:28.672727 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 54128us
I20260709 12:25:28.672799 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.674527 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.658701  2461 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.663283  2586 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:28.664333  2678 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.676208  2585 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.669365 30968 rpcz_store.cc:276] 0709 12:25:27.331544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.331971 (+   427us) service_pool.cc:224] Handling call
0709 12:25:27.338286 (+  6315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:27.378891 (+ 40605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.378921 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:27.391391 (+ 12470us) log.cc:844] Serialized 52 byte log entry
0709 12:25:27.401342 (+  9951us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b48002001d8. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0335556aa1 00007f033554db37 00007f033554d9ca 00007f033564526f 00007f0335644f37 00007f033565955c 00007f0335659508 00007f0335659488 00007f0335659443 00007f03356586ec 00007f0334582a96
0709 12:25:27.534583 (+133241us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:27.534646 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.534740 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.558338 (+1023598us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:28.662501 (+104163us) raft_consensus.cc:1685] finished
0709 12:25:28.662521 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.662644 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11029,"raft.queue_time_us":20013,"raft.run_cpu_time_us":1866,"raft.run_wall_time_us":23394,"spinlock_wait_cycles":13980800,"thread_start_us":142724,"threads_started":1,"wal-append.queue_time_us":310395}
I20260709 12:25:28.682289 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:28.684171 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.684281 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.670804  2451 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:28.686374 30969 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.680836  2571 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.636435  2683 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.692970 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.693573 30975 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:28.692742 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:28.696534 30897 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.647205  2684 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.691182  2342 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.725261  2342 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:28.725728  2687 log.cc:927] Time spent T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.523s	user 0.003s	sys 0.000s
I20260709 12:25:28.694387  2682 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.672716  2573 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.688437  2678 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.704468 30893 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:28.668706  2473 consensus_queue.cc:237] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.657851  2649 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.737872 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.744742 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.745967 31624 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:28.747505 31016 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:28.727341  2342 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.718365  2411 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.711514  2419 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.758806 30971 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:28.764312  2419 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.719367  2679 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:28.738900  2587 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:28.719208  2480 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.718813  2451 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:28.759531 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.682175  2596 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.775534 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.778475 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:28.779268 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 112627us
I20260709 12:25:28.705356  2700 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:25:28.782955 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2280) took 1200 ms. Trace:
I20260709 12:25:28.750944  2585 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.748023  2461 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.780082 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:28.783354 30895 rpcz_store.cc:276] 0709 12:25:27.582501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.599520 (+ 17019us) service_pool.cc:224] Handling call
0709 12:25:28.780357 (+1180837us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400195d54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:28.782893 (+  2536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139641216}
I20260709 12:25:28.789273 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.776608  2587 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:28.776692  2431 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.776810  2479 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:28.793413 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.780210  2411 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.796289 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.797439 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.800047 30893 raft_consensus.cc:3060] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.798573 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.798838 31617 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:25:28.800961 31617 pending_rounds.cc:85] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 7
I20260709 12:25:28.801206 31617 pending_rounds.cc:107] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:25:28.801421 31617 raft_consensus.cc:2889] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.802966 31624 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:28.804942 31618 raft_consensus.cc:1240] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:28.802521 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:28.806975 31587 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:28.807878  2259 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.808557 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.807646 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:28.810016 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:28.810592  2411 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.811142 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:28.811415  2282 raft_consensus.cc:2749] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.816170  2282 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:28.816534  2282 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.816869  2282 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:28.812341  2708 log.cc:927] Time spent T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:28.812681  2688 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:28.813491  2702 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:28.786427  2461 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.793032  2586 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.824270 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.824958 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.826438 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:28.830183 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.847417 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:28.787350  2480 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.853952 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.854548  2373 consensus_queue.cc:1059] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.858302  2461 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.849226  2411 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.860296 31616 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.860859  2446 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.862195  2649 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:28.849486  2710 log.cc:927] Time spent T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:28.865234 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.795279  2585 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.820466  2479 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:28.863754 30892 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 7.
I20260709 12:25:28.878423 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.832325  2702 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:28.823627  2433 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:28.883843 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 146920us
I20260709 12:25:28.875766  2674 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:28.894629 31616 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:28.876173  2431 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.895277 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:28.910543  2674 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:28.911067  2674 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.910754  2702 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.911480  2674 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.912436 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.913103 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.932431 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.954578 30897 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:28.958452 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:28.959860 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:28.960418 31621 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:28.875622  2451 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.964123 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.913532  2702 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.964988  2596 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.965543  2596 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:28.966023  2596 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.969533  2465 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.977360  2679 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:28.977813  2678 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.901374  2446 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:25:28.979517  2666 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:28.887104  2587 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.980145  2666 consensus_queue.cc:1243] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 1a7b44e2d0ed440985e5f643a5a54587 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:28.980623  2587 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.982062  2663 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:28.982478  2663 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:28.983235  2663 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.909133  2431 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:28.984253  2663 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.985458  2431 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:28.928808  2497 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.987612  2668 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.988108  2668 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.964915 30901 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:28.990430 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:28.991663 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:28.992947 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:28.993908 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:28.977902  2679 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:28.998296 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.018813 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.020416 30974 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:29.020656 30893 raft_consensus.cc:2468] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:29.004328 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:28.928176  2573 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:28.919845  2480 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.027860 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.032661 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.035125 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.037111 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.031962 31588 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.039149 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:29.034109 30865 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:29.042865 31588 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.044786 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.045306 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.046059 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.018615  2436 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:29.050139 31588 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.052513 31588 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.034493  2431 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.056006 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.053316  2678 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:29.059554  2691 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.059878  2660 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.045521  2259 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.060103  2691 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:28.914582  2479 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.053975  2446 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.051393  2436 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:29.053478  2433 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.055182  2649 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:29.064640 31588 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:29.051304  2684 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:29.074143  2684 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.061841  2596 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.065693  2446 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.076261  2684 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.066483 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.078174 31588 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.056807  2431 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.070402  2691 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.072727  2679 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:29.079098 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.080754 30969 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:29.061503  2282 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.085379  2259 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.085620  2433 consensus_queue.cc:1048] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:29.086266  2259 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:29.076197  2446 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.061932  2532 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.066680  2436 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.091526 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:29.093029 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.075309  2674 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:29.094019 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.081142  2431 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.095132 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.083709  2649 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.061390  2670 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:29.094630 30865 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:29.098614  2715 consensus_queue.cc:1059] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:29.099751 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.070429  2668 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.096454 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.103077 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.106527 30892 raft_consensus.cc:2410] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:29.087522  2433 consensus_queue.cc:1059] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:25:29.067842  2419 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.102280  2649 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.116426  2532 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.116937  2461 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.114899 30968 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
W20260709 12:25:29.153656 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.154814  2674 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.092163  2691 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:29.160487 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:29.165272 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.119289 30971 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:29.164644 30867 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.198217 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.199658 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.200286 31048 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:29.202164 31042 raft_consensus.cc:2393] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:29.170634  2649 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.208536 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:29.209057 30968 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.210896 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.177001  2461 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.108404  2666 consensus_queue.cc:1059] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:25:29.170014  2715 consensus_queue.cc:1243] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 9f38f761eded4f28b9d802f6570ee71e log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:29.169591  2700 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:29.214147 31050 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:29.264101 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:29.264801 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 50787.5us
I20260709 12:25:29.214740  2461 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.181833  2446 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.266535 31042 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.277455 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.283576 30975 raft_consensus.cc:1240] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.286595  2436 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.296940  2446 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.269917  2660 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:29.300382  2733 log.cc:927] Time spent T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:25:29.265916  2282 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.298492  2704 raft_consensus.cc:3055] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:29.272107  2689 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:29.308804 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.310397 31042 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:29.310505  2668 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.311177  2670 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.313643 31616 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:29.276835  2425 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.315879  2419 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.316774 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
W20260709 12:25:29.317551  2695 log.cc:927] Time spent T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.866s	user 0.003s	sys 0.000s
I20260709 12:25:29.329692 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:29.319934 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:29.339923  2461 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.341960  2461 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.343690 30899 raft_consensus.cc:2368] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11.
I20260709 12:25:29.329556 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.323081  2431 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.324002  2585 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.317466 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.347595  2431 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.348121  2567 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.351178 30942 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:29.353360  2585 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:29.353878  2585 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:29.354846  2585 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.324632  2704 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:29.336642  2460 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:29.330034 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.332051 30864 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.332387 31047 raft_consensus.cc:1217] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-12.8]   Dedup: 9.6->[10.7-12.8]
I20260709 12:25:29.336385  2425 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.360996 31047 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13. Ops: [9.6-12.8]
I20260709 12:25:29.332670 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.362419  2425 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.327617  2660 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.329409 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.363354 31617 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:29.336143 31045 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:29.364464  2660 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:29.337024  2668 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.333042  2715 consensus_queue.cc:1059] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:25:29.337699  2689 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:29.367645  2689 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.368742 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.328316 30968 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
W20260709 12:25:29.369916  2732 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:25:29.370862  2664 consensus_queue.cc:260] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.371913 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:29.372133  2664 raft_consensus.cc:3060] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.372443 30970 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.374366 30971 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:29.375700  2294 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.383344 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:29.377113  2726 log.cc:927] Time spent T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:25:29.268253  2700 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.385028 30867 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:29.388314 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.389400 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.387439 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:29.390780 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.391070 31588 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.391844 30942 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:29.392127 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:29.398546 31615 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:29.398509 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.401916 31013 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.400424 30942 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:29.403555 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:29.405704 30942 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:25:29.407172 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 63621.8us
I20260709 12:25:29.407480 31615 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.358626  2649 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.408226  2573 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.409451 30972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41634 (request call id 2038) took 1181 ms. Trace:
I20260709 12:25:29.409946  2461 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:29.410091 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 78129.4us
I20260709 12:25:29.411935 30972 rpcz_store.cc:276] 0709 12:25:28.227857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.230243 (+  2386us) service_pool.cc:224] Handling call
0709 12:25:28.230540 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.651785 (+421245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.409243 (+757458us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54001e55d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:29.409398 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948035328}
I20260709 12:25:29.428406 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:29.401665  2596 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:29.401221  2425 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.430222 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.406883  2655 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.437995 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.404685  2660 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.407073  2594 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.404306  2689 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:25:29.419046  2677 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:29.443310 30864 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:29.436916 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:29.426015 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.408257  2586 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:29.422575 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:29.440879 31623 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:29.421967  2527 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.441495 30865 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:29.447414 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:29.435973  2337 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.453052 31013 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.435252  2425 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:29.456115 31615 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:29.458814 31013 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:29.463428 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.445353  2586 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:29.447822  2342 consensus_queue.cc:1059] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:25:29.448079  2415 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.448199  2675 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.407634  2704 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.465428  2665 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:29.467893  2707 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:29.468896 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.458858  2451 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.461087  2679 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:25:29.470497  2688 raft_consensus.cc:3055] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:29.473265 31013 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.454272  2674 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.451668  2337 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:29.458523  2425 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.464046  2531 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.479913  2436 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:29.482929 30864 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.471468  2700 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.471710  2586 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.445533  2731 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:25:29.527377 30970 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:29.476610  2479 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.451371  2677 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.531905 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.534013  2704 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.527462  2688 raft_consensus.cc:740] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:29.538250 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 65018us
I20260709 12:25:29.524930  2665 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:29.472424  2703 consensus_queue.cc:1059] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:25:29.530176  2337 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:29.545490 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 62634.8us
I20260709 12:25:29.547339 30900 raft_consensus.cc:2410] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:29.551674 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.552043 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.555088 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.552086 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.536527  2655 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.555823 30895 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:29.539148  2649 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:29.545456  2527 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.568492 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.569002 30895 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.567185  2655 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.569711  2688 consensus_queue.cc:260] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.570864  2688 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.547655  2342 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:29.556249  2392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.015s	sys 0.019s
W20260709 12:25:29.580253  2392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.015s	sys 0.019s
I20260709 12:25:29.577229 31045 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:29.578258 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.579279  2411 consensus_queue.cc:1059] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:29.579620 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.581918 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.577229 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:29.587550 31042 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:29.588809 31049 raft_consensus.cc:2393] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:29.591578 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:29.592350 30864 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.593143 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.594640 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:29.595757 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.595890  2665 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:29.596988 31616 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:29.596331 31622 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:29.576493  2348 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:29.608434 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:29.610371 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.611948 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.584666  2392 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:29.613380 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.617271 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.617779 31617 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:29.618453 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:29.616547  2294 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.667990 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.669286 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.669826 30900 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.616410  2348 consensus_queue.cc:1243] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 1a7b44e2d0ed440985e5f643a5a54587 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:25:29.616855  2739 log.cc:927] Time spent T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:29.673069 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.673669 30893 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.678323  2586 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:29.687692 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.699544 31043 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:29.708452 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:29.709170 31622 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:25:29.728435 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.790005 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.818441  2348 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.840967 30893 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:29.842185 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.865862 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:29.867856 30893 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:29.868659 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:29.877758  2411 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:29.880617  2411 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.882855  2411 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.886385  2408 raft_consensus.cc:3055] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:29.887032  2408 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:29.887217 31047 raft_consensus.cc:1217] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-12.8]   Dedup: 9.6->[10.7-12.8]
I20260709 12:25:29.887846 31047 raft_consensus.cc:1240] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13. Ops: [9.6-12.8]
I20260709 12:25:29.889247  2294 consensus_queue.cc:1059] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:29.889950  2294 consensus_queue.cc:1243] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 1a7b44e2d0ed440985e5f643a5a54587 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:25:29.898433  2716 log.cc:927] Time spent T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 12:25:29.920068 31622 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:29.868872  2348 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.928906  2348 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.929979 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.930609 31617 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
W20260709 12:25:29.932942 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.935151 30895 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:29.935366 30900 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:29.937115 30893 raft_consensus.cc:2410] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:29.891549  2408 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:29.926820 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:29.937934 31046 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:29.941746 30895 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.942307 30900 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:29.942339 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 733) took 1257 ms. Trace:
I20260709 12:25:29.942898 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 731) took 1260 ms. Trace:
I20260709 12:25:29.942870 30895 rpcz_store.cc:276] 0709 12:25:28.684701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.941234 (+1256533us) service_pool.cc:224] Handling call
0709 12:25:29.941592 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.942133 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.942291 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:29.943285 30900 rpcz_store.cc:276] 0709 12:25:28.682117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.941899 (+1259782us) service_pool.cc:224] Handling call
0709 12:25:29.942164 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.942707 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.942853 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:29.946269 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 351597us
I20260709 12:25:29.948359 30895 raft_consensus.cc:1240] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:29.948792 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2033) took 1261 ms. Trace:
I20260709 12:25:29.948994 30895 rpcz_store.cc:276] 0709 12:25:28.687380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.948068 (+1260688us) service_pool.cc:224] Handling call
0709 12:25:29.948251 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.948641 (+   390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.948754 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:29.949600 31013 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:29.945180  2348 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 12:25:29.944381  2743 log.cc:927] Time spent T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
W20260709 12:25:29.991613 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.999468  2677 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.945456  2586 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:29.953503 30895 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:29.953260 31013 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:30.005986 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 52782.7us
I20260709 12:25:30.006975 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.007706  2451 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:30.007946  2677 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:30.008090 31013 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:30.008127  2451 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:30.008878  2451 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.008980  2677 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.924988  2392 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:29.991627  2731 raft_consensus.cc:2749] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:30.012293 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.992331  2408 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.014611 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2038) took 1257 ms. Trace:
I20260709 12:25:30.024391 30895 rpcz_store.cc:276] 0709 12:25:28.753713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.949462 (+1195749us) service_pool.cc:224] Handling call
0709 12:25:29.949642 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.010878 (+ 61236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.011464 (+   586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.030223 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 734) took 1345 ms. Trace:
I20260709 12:25:30.030534 30899 rpcz_store.cc:276] 0709 12:25:28.684969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.160192 (+475223us) service_pool.cc:224] Handling call
0709 12:25:30.030078 (+869886us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540014aad4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:30.030179 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326711680}
W20260709 12:25:30.043107  2664 consensus_meta.cc:287] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.671s	user 0.004s	sys 0.003s
I20260709 12:25:30.044752 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2042) took 1290 ms. Trace:
I20260709 12:25:30.027441  2649 raft_consensus.cc:493] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.012779  2677 consensus_queue.cc:1059] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:25:30.049322 30897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2289) took 1753 ms (client timeout 2003 ms). Trace:
I20260709 12:25:30.048520 30899 rpcz_store.cc:276] 0709 12:25:28.754801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.044005 (+1289204us) service_pool.cc:224] Handling call
0709 12:25:30.044299 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.044464 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.044487 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.044534 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:30.044565 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.044612 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.044703 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.051865 30896 raft_consensus.cc:2410] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:25:30.046372  2747 log.cc:927] Time spent T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:25:30.035781  2419 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:25:30.038084  2702 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:30.059919  2702 consensus_queue.cc:1243] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 1a7b44e2d0ed440985e5f643a5a54587 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:30.060367  2709 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:30.060724  2709 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:30.060961  2425 consensus_meta.cc:287] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.004s
I20260709 12:25:30.061496  2709 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.062659  2709 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:30.068306  2738 log.cc:927] Time spent T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.539s	user 0.009s	sys 0.011s
W20260709 12:25:30.070184  2660 consensus_meta.cc:287] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.621s	user 0.003s	sys 0.006s
I20260709 12:25:30.070601  2660 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:30.073951 31622 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.068231 30899 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.076002 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2043) took 1321 ms. Trace:
I20260709 12:25:30.076409 30899 rpcz_store.cc:276] 0709 12:25:28.755056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.056007 (+1300951us) service_pool.cc:224] Handling call
0709 12:25:30.068073 (+ 12066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.075777 (+  7704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.075944 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.077785 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.078686  2419 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:30.079074  2419 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:30.079353 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.079865  2419 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.080827 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.081053 30898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 726) took 1432 ms. Trace:
I20260709 12:25:30.053049  2649 raft_consensus.cc:515] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.087826  2649 leader_election.cc:290] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:30.056478  2731 raft_consensus.cc:3055] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:30.088385  2731 raft_consensus.cc:740] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:30.089419  2731 consensus_queue.cc:260] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.090624  2731 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.091058  2703 raft_consensus.cc:3055] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:30.091434  2703 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:30.081552  2419 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:30.059450  2704 consensus_meta.cc:287] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.001s
I20260709 12:25:30.061342  2425 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.099059 30901 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:30.100597 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.100765  2425 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:30.101730  2337 consensus_meta.cc:287] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.537s	user 0.004s	sys 0.004s
I20260709 12:25:30.083994  2527 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:30.084740 31013 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.108470 31013 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:30.052487 30897 rpcz_store.cc:269] 0709 12:25:28.296217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.296332 (+   115us) service_pool.cc:224] Handling call
0709 12:25:30.049207 (+1752875us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54003403d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:30.049281 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852906368}
I20260709 12:25:30.102160 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2292) took 1336 ms. Trace:
I20260709 12:25:30.110055 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:30.110606 30901 rpcz_store.cc:276] 0709 12:25:28.765982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.101424 (+1335442us) service_pool.cc:224] Handling call
0709 12:25:30.101694 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.101856 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.101880 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.101916 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:30.101944 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.101991 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.102082 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.102837  2703 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.104601  2451 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.082580 30899 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:30.115541 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2045) took 1360 ms. Trace:
I20260709 12:25:30.116052 31013 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.115939 30899 rpcz_store.cc:276] 0709 12:25:28.755607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.082183 (+1326576us) service_pool.cc:224] Handling call
0709 12:25:30.082427 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.115302 (+ 32875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.115488 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.105907 30898 rpcz_store.cc:276] 0709 12:25:28.648231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.648358 (+   127us) service_pool.cc:224] Handling call
0709 12:25:29.160972 (+512614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.161183 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:29.161421 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.446628 (+285207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:29.446676 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:29.446719 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.446779 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.080897 (+634118us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400099050. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:30.080998 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6637,"prepare.queue_time_us":105,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":3703,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":6116,"spinlock_wait_cycles":1157485440,"thread_start_us":282519,"threads_started":1,"wal-append.queue_time_us":364898}
I20260709 12:25:30.115475  2688 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:30.126806  2703 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.129241  2688 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.131618  2655 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:30.115764  2337 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.132223 30892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 2034) took 1444 ms. Trace:
I20260709 12:25:30.133085 30897 raft_consensus.cc:1275] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 10. (term mismatch)
I20260709 12:25:30.133451 30897 pending_rounds.cc:85] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 9
I20260709 12:25:30.133651 30897 pending_rounds.cc:107] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 7.10
I20260709 12:25:30.133860 30897 raft_consensus.cc:2889] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:30.134527 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2296) took 1313 ms. Trace:
I20260709 12:25:30.134821 30897 rpcz_store.cc:276] 0709 12:25:28.821103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.110718 (+1289615us) service_pool.cc:224] Handling call
0709 12:25:30.127295 (+ 16577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.134269 (+  6974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.134472 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.136983  2451 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:30.118911  2479 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:30.137748  2479 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:30.138147  2479 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.140213 30867 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.141505 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.142802 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:30.142715  2709 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:30.144475 30901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2298) took 1154 ms. Trace:
I20260709 12:25:30.144837 30901 rpcz_store.cc:276] 0709 12:25:28.989752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.126932 (+1137180us) service_pool.cc:224] Handling call
0709 12:25:30.144006 (+ 17074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.144169 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.144193 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.144237 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:30.144272 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.144322 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.144415 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.146384 30901 raft_consensus.cc:1275] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:30.132958  2748 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.403s	user 0.000s	sys 0.002s
I20260709 12:25:30.152320  2683 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:30.152736  2683 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.153056  2683 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:30.156421 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.132701 30892 rpcz_store.cc:276] 0709 12:25:28.687626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.046012 (+358386us) service_pool.cc:224] Handling call
0709 12:25:30.131996 (+1085984us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400099554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:30.132161 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114160000}
I20260709 12:25:30.159437 30867 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:30.160329  2294 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:30.160784  2294 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:30.164516  2294 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.118252  2677 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.147619 30901 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:30.176374  2738 log.cc:927] Time spent T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:30.177381 30974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 771) took 1080 ms. Trace:
I20260709 12:25:30.177781 30974 rpcz_store.cc:276] 0709 12:25:29.096676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.100403 (+  3727us) service_pool.cc:224] Handling call
0709 12:25:29.100701 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.101014 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.101040 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.101465 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.392729 (+291264us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:29.413804 (+ 21075us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.445210 (+ 31406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.445324 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.067765 (+622441us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:30.177094 (+109329us) raft_consensus.cc:1685] finished
0709 12:25:30.177172 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.177303 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28240,"prepare.queue_time_us":20855,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":40459,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":10909,"spinlock_wait_cycles":27330560,"thread_start_us":290911,"threads_started":1,"wal-append.queue_time_us":359652}
I20260709 12:25:30.182055 30976 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59150 (request call id 2394) took 1502 ms. Trace:
I20260709 12:25:30.187112  2479 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.189309  2479 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:30.193176 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 733812us
W20260709 12:25:30.196223 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 732258us
I20260709 12:25:30.197731  2702 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.198199  2702 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.198725 30939 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:30.192624 30899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2297) took 1203 ms. Trace:
I20260709 12:25:30.202689 30899 rpcz_store.cc:276] 0709 12:25:28.989397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.190613 (+1201216us) service_pool.cc:224] Handling call
0709 12:25:30.190909 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.191098 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.191121 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.192385 (+  1264us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:30.192426 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.192480 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.192574 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:30.203905  2670 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 12:25:30.207010 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 47627.4us
I20260709 12:25:30.204365  2537 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:30.221678 30939 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:30.216938  2573 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:30.233073 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:30.182428 30976 rpcz_store.cc:276] 0709 12:25:28.679162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.679338 (+   176us) service_pool.cc:224] Handling call
0709 12:25:28.680731 (+  1393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.698131 (+ 17400us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:28.740062 (+ 41931us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.883344 (+143282us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.281343 (+397999us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18001f8e80. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f0330625060 00007f0330637716 00007f0330648287 00007f0330648208
0709 12:25:29.436836 (+155493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:29.437006 (+   170us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:29.437055 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.480766 (+ 43711us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18001f8e80. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d50e2a6 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d50e2a6 00007f032d50e240
0709 12:25:29.535554 (+ 54788us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b18001f8e80. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:25:30.181840 (+646286us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b54001b9ed4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:30.181883 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.181994 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43384,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":24656,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":3743,"spinlock_wait_cycles":125298432,"thread_start_us":297113,"threads_started":2,"wal-append.queue_time_us":148984}
I20260709 12:25:30.228351 30867 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:30.227442 30895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2039) took 1466 ms. Trace:
I20260709 12:25:30.223033  2704 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:30.222771  2749 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:30.228354  2683 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.235366 30895 rpcz_store.cc:276] 0709 12:25:28.753976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.025518 (+1271542us) service_pool.cc:224] Handling call
0709 12:25:30.025814 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.028657 (+  2843us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:30.057111 (+ 28454us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.220387 (+163276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:30.220434 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:30.220474 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.220549 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.220758 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9155,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":412,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4602,"thread_start_us":133506,"threads_started":1}
I20260709 12:25:30.236799  2392 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:30.264007 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 148008us
I20260709 12:25:30.267086 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:30.253814  2740 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:30.239405  2664 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:30.257690  2431 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.283519 31622 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:30.268550  2749 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.240370  2537 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.269886  2677 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:30.240469  2573 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:30.289876 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 56898.3us
I20260709 12:25:30.290666 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:30.296178 30976 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.275455  2664 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.293725 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:30.296871 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:30.298694 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:30.303851 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:30.273648  2731 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:25:30.288034  2456 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:30.313172  2456 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.315107  2456 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.310292  2431 raft_consensus.cc:2749] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.310175  2670 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:30.266819  2392 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.319195  2392 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.319854  2683 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.300098  2702 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.295212  2763 consensus_queue.cc:1059] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:30.321763 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:30.322469 31049 raft_consensus.cc:2393] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 7: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:30.322710  2763 raft_consensus.cc:3055] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:30.323045 31048 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:30.323441 31048 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:30.323562 31051 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.324005 31047 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:30.323079  2763 raft_consensus.cc:740] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:30.324232 31048 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.325191 31048 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.325491 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:30.296446  2677 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.326247 31045 raft_consensus.cc:2410] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:30.327520  2677 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:30.292402  2749 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.328680 30896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 719) took 1755 ms. Trace:
I20260709 12:25:30.328928 30894 raft_consensus.cc:1275] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:25:30.329246 30894 pending_rounds.cc:85] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 8
I20260709 12:25:30.329437 30894 pending_rounds.cc:107] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:25:30.329586 30896 rpcz_store.cc:276] 0709 12:25:28.573519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.580315 (+  6796us) service_pool.cc:224] Handling call
0709 12:25:30.328489 (+1748174us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400195354. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:30.328628 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3290651008}
I20260709 12:25:30.325186 31042 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:30.298117  2664 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:30.321394 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.332754 30894 raft_consensus.cc:2889] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:30.316494 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.382195 30976 raft_consensus.cc:2468] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:30.330034  2749 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:30.383648 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:30.387650 30867 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:30.392133 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:30.389005 30968 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:30.393800 31588 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:30.396627 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.396859 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:30.397221 30899 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:30.325311  2763 consensus_queue.cc:260] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.399127  2763 raft_consensus.cc:3060] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.398979  2673 consensus_queue.cc:1048] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:30.399540  2749 consensus_queue.cc:1048] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:30.395805  2702 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:30.401070  2740 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:30.401108  2702 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:30.402360  2702 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.399952 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:30.405164 31617 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.405491 31013 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:30.381253  2764 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:30.407634 30967 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:30.409600 30867 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:30.408053 30972 raft_consensus.cc:1240] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.411271 31588 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:30.390120  2683 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.412747 31044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2403) took 2054 ms. Trace:
I20260709 12:25:30.414978 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.431800 31044 rpcz_store.cc:276] 0709 12:25:28.357903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.442845 (+ 84942us) service_pool.cc:224] Handling call
0709 12:25:28.618169 (+175324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.642300 (+ 24131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.412576 (+1770276us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002fb7d0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:30.412694 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331051392}
I20260709 12:25:30.415366 30895 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:30.415848  2764 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:30.417394  2348 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.418851  2537 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.409132  2761 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:30.422294  2425 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:30.423292  2573 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.410140  2655 raft_consensus.cc:2804] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:30.413909  2408 consensus_queue.cc:1059] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:25:30.410058  2703 consensus_queue.cc:1059] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 12:25:30.452942 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.436568  2764 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.438366  2664 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.441782 31617 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:30.455901 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.445376  2425 raft_consensus.cc:697] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:30.451009  2655 raft_consensus.cc:697] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:30.457098  2664 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.457615 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.457877  2655 consensus_queue.cc:237] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.451589  2573 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:30.451982 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.435146  2683 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.458817 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.457126 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:30.444772 30896 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:30.461556 30899 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 12: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
W20260709 12:25:30.468374 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.427780  2660 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.470304 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.435468  2761 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:30.474130  2703 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:30.474809  2761 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.479194 30865 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.479799 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:30.480423  2348 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:30.481142 30865 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.482679  2683 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.473115  2660 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:30.496744 31587 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.018s	sys 0.047s
W20260709 12:25:30.497078 31587 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.018s	sys 0.047s
W20260709 12:25:30.497323 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 976957us
I20260709 12:25:30.485176  2425 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.499624  2679 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:30.500095  2679 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:30.469213  2573 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.491580  2408 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:30.502274 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.519706 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:30.522352 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:30.500862  2679 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:30.530908 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.531541 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.527935 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:30.528724 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:30.535205 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.537822 30967 raft_consensus.cc:2393] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
W20260709 12:25:30.538244 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 126980us
I20260709 12:25:30.538300 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:30.540763 30972 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.541196 31047 raft_consensus.cc:2393] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:30.539230 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:30.544579 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:30.548105 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.549253 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:30.559587 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:30.562047 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:30.564978 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:30.568980 30967 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:30.569944 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7010d5d8a0647a9ab67a7f9250845ea" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.570278 30967 raft_consensus.cc:1240] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:30.571373 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:30.572083 31587 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:30.572608 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.573115 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:30.574081 30969 raft_consensus.cc:2393] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:30.575500 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:30.585935 30969 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:30.586416 30967 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:30.585990 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.592335  2731 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:30.592849  2731 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:30.593657  2731 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.592224 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:30.605728 31617 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:30.611577 30895 raft_consensus.cc:2468] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:30.617602 31617 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.576432  2702 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:30.621608 31620 raft_consensus.cc:1275] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:30.623628 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:30.623330 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:30.627918 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:30.627350 31624 raft_consensus.cc:2393] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:30.629989 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:30.630368 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:30.631008 31617 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:30.628338 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.626010 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.626740  2780 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:30.672024 30896 raft_consensus.cc:2410] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:30.674400 30969 raft_consensus.cc:1240] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:30.678907 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 139749us
I20260709 12:25:30.636353  2702 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:30.622304  2761 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:30.722435 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.643195  2527 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:30.670352  2419 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.831354 31013 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:30.832180 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.843438 31014 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.845055 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:30.846004 31050 raft_consensus.cc:2410] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:30.846491 30972 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:30.845327 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:30.848169 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:30.848438 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 166477us
I20260709 12:25:30.852973 31051 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:25:30.858103 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.862841 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:30.863297 31047 raft_consensus.cc:1240] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.863613 31048 raft_consensus.cc:1275] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:30.860965  2777 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.280s	user 0.000s	sys 0.006s
I20260709 12:25:30.861608  2780 consensus_queue.cc:1059] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:25:30.878057 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 306041us
I20260709 12:25:30.878829 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:30.864544  2749 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:30.869702  2788 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.856272  2419 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.861241  2527 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.914114 30898 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:30.928205 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 49461.9us
I20260709 12:25:30.907501 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
W20260709 12:25:30.908908 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.933301 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1227) took 1340 ms. Trace:
I20260709 12:25:30.935782 30867 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:30.891232  2779 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.899819  2749 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.945799  2779 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.947012  2749 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:30.899122  2760 log.cc:927] Time spent T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.583s	user 0.001s	sys 0.000s
I20260709 12:25:30.941340  2792 consensus_queue.cc:1059] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:30.944882  2527 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.896234  2761 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:30.897316  2781 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:30.933688 31623 rpcz_store.cc:276] 0709 12:25:29.593361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.593484 (+   123us) service_pool.cc:224] Handling call
0709 12:25:29.593760 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.596802 (+  3042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.596829 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.597269 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.923838 (+326569us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:29.991359 (+ 67521us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.992359 (+  1000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.992426 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.918122 (+925696us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b18002743c0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:25:30.927794 (+  9672us) raft_consensus.cc:1685] finished
0709 12:25:30.933100 (+  5306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.933236 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2703,"prepare.queue_time_us":11966,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":4189,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":8999,"spinlock_wait_cycles":16674688,"thread_start_us":390045,"threads_started":2,"wal-append.queue_time_us":405667}
I20260709 12:25:30.894290  2573 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:30.902633  2786 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:30.919966  2785 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:30.901904  2759 log.cc:927] Time spent T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.585s	user 0.001s	sys 0.000s
I20260709 12:25:30.897398  1944 raft_consensus.cc:3055] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:30.896445  2702 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.937537  2649 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.930653  2778 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:30.957719 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 126485us
I20260709 12:25:30.938459  2348 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:30.947824  2779 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:30.956323  2655 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:30.972729  2350 raft_consensus.cc:3055] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:30.968576  2527 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.932773  2788 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:30.974434 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 131066us
W20260709 12:25:30.976178 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.967461  2709 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:30.981108 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:30.972121  2786 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:30.981189 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:30.972358  1944 raft_consensus.cc:740] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:30.976563  2348 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.984445 30901 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:30.991060  2786 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:30.977833  2350 raft_consensus.cc:740] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:30.971702  2785 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.001744  2785 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.002677  2788 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:30.978586  2655 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.003569  2795 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:31.005666  2655 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:30.978408  2778 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:30.982257  2419 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.013140  2350 consensus_queue.cc:260] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.014377  2350 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.987062  2348 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.002559  2527 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.020432  2527 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.022464  2527 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.022987 30893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 745) took 1603 ms. Trace:
I20260709 12:25:31.025126 30897 raft_consensus.cc:1240] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:31.027040  2745 log.cc:927] Time spent T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 1.493s	user 0.012s	sys 0.000s
I20260709 12:25:31.031699 30894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35494 (request call id 727) took 2376 ms. Trace:
I20260709 12:25:31.031976  2778 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.023362 30893 rpcz_store.cc:276] 0709 12:25:29.419268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.868419 (+449151us) service_pool.cc:224] Handling call
0709 12:25:31.022793 (+1154374us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b5400099f54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:31.022932 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155761024}
I20260709 12:25:31.032433  2663 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:31.032464 30894 rpcz_store.cc:276] 0709 12:25:28.655512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.655643 (+   131us) service_pool.cc:224] Handling call
0709 12:25:30.328609 (+1672966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.378366 (+ 49757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.031481 (+653115us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400195350. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:31.031611 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3828209536}
I20260709 12:25:31.034586  2663 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:31.035447  2663 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.036419  2663 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:31.048593 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 111026us
I20260709 12:25:31.049486 31587 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:31.050259 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 98678.7us
I20260709 12:25:31.053064 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.053149 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.053951 30976 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:31.054514 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.075968  2796 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:31.076529  2796 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.078418  2805 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:31.078963  2805 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.080955  2805 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.082608 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:31.090968  2649 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:31.092585  2649 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.092941  2649 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.096622  2668 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.078541  2796 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:31.099887  2751 log.cc:927] Time spent T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 1.260s	user 0.007s	sys 0.006s
I20260709 12:25:31.074890  2348 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.103467 31587 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.129756  2573 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:31.130568  2758 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.812s	user 0.001s	sys 0.001s
I20260709 12:25:31.133323  2660 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.135118  2571 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.135686  2571 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.137916  2571 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.141362  2805 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.141990  2805 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:31.164413 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 175052us
W20260709 12:25:31.166267 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 179514us
I20260709 12:25:31.168694 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:31.173288 30867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.130501  2573 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.146302  2660 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:31.161556  2749 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:31.186968  2665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.295s	user 0.014s	sys 0.023s
W20260709 12:25:31.196475  2665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.305s	user 0.014s	sys 0.023s
I20260709 12:25:31.197183 31016 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.199409  2805 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.193310  2479 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.193125  2527 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:25:31.208426 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.208636  2806 consensus_queue.cc:1059] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:31.208431 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.192226  2749 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.238765 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.192410  2677 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:31.217048  2573 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.221482  2348 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.222800  2801 consensus_queue.cc:1048] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:31.228596 30939 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.230283 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.232050  2451 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:31.254877  2757 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.936s	user 0.002s	sys 0.000s
I20260709 12:25:31.255786  2749 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.256500 31046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46204 (request call id 2431) took 1296 ms. Trace:
I20260709 12:25:31.256930 31046 rpcz_store.cc:276] 0709 12:25:29.960079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.960277 (+   198us) service_pool.cc:224] Handling call
0709 12:25:29.991352 (+ 31075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.992399 (+  1047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.992427 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:30.010254 (+ 17827us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.217711 (+207457us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:30.217752 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.217823 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.254330 (+1036507us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:31.256222 (+  1892us) raft_consensus.cc:1685] finished
0709 12:25:31.256244 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.256439 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1114,"raft.queue_time_us":1098,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":19174,"spinlock_wait_cycles":133432576,"thread_start_us":178907,"threads_started":1,"wal-append.queue_time_us":244774}
W20260709 12:25:31.225302 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 121911us
I20260709 12:25:31.260689 31587 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.261350  2465 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.236286  2479 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.237810 30900 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:31.263543 30866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.264274  2479 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.264508  2461 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.265018 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49788 (request call id 2032) took 2577 ms. Trace:
I20260709 12:25:31.265527 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.266337  2702 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.238070 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.240033 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.235345 30974 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:31.239416 31621 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:31.238627 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.250335 31615 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:31.250748 31045 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:31.269047 31047 raft_consensus.cc:2393] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:31.230786 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.251713  2573 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.265270  2348 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:31.270738 30975 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:31.270843  2348 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.265069  2461 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.251622  2677 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.272881  2653 raft_consensus.cc:3055] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:31.273298  2653 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:31.273696  2348 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.274303  2461 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.274140  2653 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.274753  2677 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.275322  2677 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.270329 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.276475 30894 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:31.277755 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.278276 30896 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:31.277675 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.279456 30893 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:31.280599 30896 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:31.281112 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.281688 30894 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:31.280635  2451 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:31.283156 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 74806.4us
I20260709 12:25:31.283804  2677 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.285995  2677 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.287163 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.288344 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.289369 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.215651  2649 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.289671 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:31.290180  2779 raft_consensus.cc:3055] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:31.290630  2779 raft_consensus.cc:740] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:31.293852  2679 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.294322 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:31.297497 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2300) took 2181 ms. Trace:
I20260709 12:25:31.298331 30893 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:31.298832 30971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 772) took 2201 ms. Trace:
I20260709 12:25:31.299259 30971 rpcz_store.cc:276] 0709 12:25:29.097270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.210356 (+113086us) service_pool.cc:224] Handling call
0709 12:25:29.216025 (+  5669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.374792 (+158767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.298628 (+1923836us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540008a554. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:31.298780 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252538752}
I20260709 12:25:31.300138 31616 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:25:31.301909 30973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59852 (request call id 765) took 2497 ms (client timeout 3239 ms). Trace:
I20260709 12:25:31.302650  2804 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:31.303089  2804 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.303445  2804 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.307947 31618 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
I20260709 12:25:31.309208  2451 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:31.298269 30867 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.297842 30897 rpcz_store.cc:276] 0709 12:25:29.115716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.135633 (+1019917us) service_pool.cc:224] Handling call
0709 12:25:31.024955 (+889322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.025510 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.297331 (+271821us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400099f50. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062c8ad 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:31.297442 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981162752}
W20260709 12:25:31.302311 30973 rpcz_store.cc:269] 0709 12:25:28.804360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.852086 (+ 47726us) service_pool.cc:224] Handling call
0709 12:25:31.301728 (+2449642us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400126454. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:31.301834 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133095168}
I20260709 12:25:31.265455 30900 rpcz_store.cc:276] 0709 12:25:28.687117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.944391 (+1257274us) service_pool.cc:224] Handling call
0709 12:25:29.944650 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.263067 (+1318417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.264773 (+  1706us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003408d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:31.264954 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973598080}
I20260709 12:25:31.251782  2707 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:31.266789  2702 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.290287 31624 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:31.324211 31590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.280104  2806 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:31.326042 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 83240.5us
I20260709 12:25:31.329294 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.262547 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:31.322364 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.330472 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.298960 30894 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:31.329897 31616 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:31.332829 31048 raft_consensus.cc:1240] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:31.330992 31049 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:31.327055 31050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c773fc74822844b7aec9509683eb266e"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46178
I20260709 12:25:31.335680 31050 raft_consensus.cc:606] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Received request to transfer leadership
I20260709 12:25:31.337357 31043 raft_consensus.cc:1240] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:31.338317 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:31.338543 31045 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:31.335433 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.339534 31051 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
I20260709 12:25:31.276151  2337 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 7 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.342931 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:31.338315 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 75839us
I20260709 12:25:31.344770 31587 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:31.342831  2814 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:25:31.291431  2649 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.343429  2767 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:31.342955  2465 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:31.322986  2707 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:31.250766 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.326571  2806 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:31.291429  2779 consensus_queue.cc:260] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.349308 31620 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:31.373857 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.374420 31620 raft_consensus.cc:1813] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Handling vote request from an unknown peer 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.347922 31624 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:31.356384 31617 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:31.352403 31587 leader_election.cc:400] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11.
I20260709 12:25:31.376369 30867 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:31.376663 31587 leader_election.cc:403] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:31.377329 31616 raft_consensus.cc:1240] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:31.378067 31620 raft_consensus.cc:2410] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:31.362776 31051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c773fc74822844b7aec9509683eb266e"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46178
I20260709 12:25:31.379906 31051 raft_consensus.cc:606] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Received request to transfer leadership
W20260709 12:25:31.357375 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 106687us
I20260709 12:25:31.362779  2796 raft_consensus.cc:993] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:31.356397  2740 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.351558  2812 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:31.365592  2653 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.354175  2465 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:31.364701  2702 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.384080  2675 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:31.396414 30865 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.380679  2780 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11.
I20260709 12:25:31.359400  2788 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:25:31.358798  2527 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:25:31.386570  2573 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:25:31.400012 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.390666  2572 consensus_queue.cc:1048] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:31.390401  2537 consensus_queue.cc:1059] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:31.354872  2707 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.408231  2537 raft_consensus.cc:3055] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:31.408731  2537 raft_consensus.cc:740] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:31.409569  2537 consensus_queue.cc:260] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.410748  2537 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.362686  2806 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.412549  2788 consensus_queue.cc:1243] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer 5e9d2b069edc4166802ee0456ebcb706 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:31.412736  2806 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.405881  2675 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:31.351691  2649 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:25:31.359459  2664 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:25:31.404809 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.398228  2479 raft_consensus.cc:1081] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:31.417791  2465 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.417985  2675 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.396163  2571 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:31.421350  2668 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:31.416981 31051 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:31.401283  2812 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:31.423468  2812 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.408320  2707 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.426878  1944 consensus_queue.cc:260] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.428124  1944 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.431694 31016 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:31.432871 31016 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.436417 31615 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:31.436743 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:31.440676 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:31.458362 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.458954 30968 raft_consensus.cc:1813] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Handling vote request from an unknown peer 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.459436 30968 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 8: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:31.459987 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.441035  2571 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:31.469662  2571 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:31.470073  2571 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.442371 31615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c773fc74822844b7aec9509683eb266e"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44888
I20260709 12:25:31.477267 31615 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.477664 31615 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.481716 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.486922  2740 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:31.439910  2788 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:31.440889  2655 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:31.440059  2498 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:31.504956 30864 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.509692 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.509966 31587 leader_election.cc:304] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.511188 31587 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.515793 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.516355 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:31.517177 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:31.518172 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.519116 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.519810 30972 raft_consensus.cc:2410] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:31.521569 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.522380 31014 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.457952  2473 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:31.441198  2415 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:25:31.440058  2795 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:25:31.442179  2766 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:25:31.535130 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.523505  2456 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.536904 31619 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:31.502563  2788 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.539625 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.540858 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.514029  2498 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.441990  2786 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:25:31.543642 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.544390 30972 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
W20260709 12:25:31.546866 30783 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 148847us
I20260709 12:25:31.547422 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.523329  2282 raft_consensus.cc:2749] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:31.529397  2342 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:31.528601  2473 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.585892 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.545786 31615 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.586704 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.552835 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.558883 30942 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:31.559322 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.594597 30895 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:31.599076 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.600034 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.600675 30895 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:31.529171  2814 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:31.603819 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.565568 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.608521 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.614401 31616 raft_consensus.cc:1240] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:31.615140 31620 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:31.618418 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:31.624081 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 71307.3us
I20260709 12:25:31.625064 31014 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.546437  2498 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.609071 30942 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:31.629704 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.630306 31616 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:31.543987  2788 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:31.631669 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 111967us
I20260709 12:25:31.584048  2348 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.627341 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.616925 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.587818  2342 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:31.635149 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.534132  2802 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:25:31.591650  2473 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.649137 31621 raft_consensus.cc:2368] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12.
I20260709 12:25:31.635859 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:31.636689 31615 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:31.637286  2815 log.cc:927] Time spent T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.231s	user 0.003s	sys 0.000s
I20260709 12:25:31.589023  2679 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:31.590176  2812 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:31.542142  2586 consensus_queue.cc:1059] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:25:31.531606  2419 consensus_queue.cc:1059] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:25:31.644774  2479 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.642663  2700 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:31.642853  2337 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.588817  2465 consensus_queue.cc:1048] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:25:31.545735  2456 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.679267  2456 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:31.617772  2573 raft_consensus.cc:2749] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.676795  2700 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.650653 31587 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.653309  2572 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.545897  2767 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:25:31.671424  2663 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.688845  2663 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.691179  2663 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.699919  1944 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:31.700666  1944 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.702378  2675 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.702912  2663 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.703426  2663 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.702883  2675 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.708099  2663 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.642835  2342 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.638810  2761 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.674629  2766 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:31.713636  2766 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:31.714229  2571 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.714454  2766 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.715610  2766 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.716187  2571 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.717568  2342 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.682055  2700 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.643558  2348 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.720173  2342 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.707474  2675 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.721802  2348 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:31.723310  2816 log.cc:927] Time spent T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:25:31.728168  2337 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.730286  2337 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.733795  2796 raft_consensus.cc:3055] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:31.734192  2796 raft_consensus.cc:740] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:31.737499 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.737792 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.738452 31048 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:31.674768 30973 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:31.739286 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.739701 31044 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:31.740278 31048 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
I20260709 12:25:31.740520 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:31.741647 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:31.742527 30864 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:31.746975 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:31.748976 30864 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:31.735008  2796 consensus_queue.cc:260] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:31.751708 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 126726us
I20260709 12:25:31.752447 31014 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:31.754158 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 103598us
W20260709 12:25:31.839519 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 230517us
I20260709 12:25:31.840749 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:31.842231 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 65561.5us
W20260709 12:25:31.844645 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.755520  2819 log.cc:927] Time spent T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:25:31.846227 31587 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.703023  1944 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.750550  2675 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:31.849331 31048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c773fc74822844b7aec9509683eb266e"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46178
W20260709 12:25:31.850108 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.848172 31043 raft_consensus.cc:2410] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:31.751199  2686 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.855558 31048 raft_consensus.cc:606] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Received request to transfer leadership
W20260709 12:25:31.852850 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 97918.6us
I20260709 12:25:31.755959  2348 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:31.755028  2342 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:31.755174  2780 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:31.862489 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 229972us
I20260709 12:25:31.854342 30942 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:31.758731  2795 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:31.854005  2653 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:31.857270 31587 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.717593  2804 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.862156  2348 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.851871  2796 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.859004 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:31.884135 30894 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:31.870072  2572 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.868903 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.892469 31044 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:31.855327  2675 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:31.862215  2342 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.883462  2348 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.863485 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.900293  2675 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.903270 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.903872 30974 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:31.871287  2473 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.896142 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.907967 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.908792 30976 raft_consensus.cc:2393] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:31.908987 30969 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:31.909463 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:31.909824 30939 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:31.896716 31049 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:31.899587  2342 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.911532  2837 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:31.911928  2837 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.912243  2837 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.912660 30972 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:31.913180  2788 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.914281  2473 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.915828 31046 raft_consensus.cc:1813] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Handling vote request from an unknown peer 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.916090  2788 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.937196 30895 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:31.916349 31046 raft_consensus.cc:2368] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:31.916383  2572 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:31.918032  2806 consensus_meta.cc:287] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 12:25:31.918362  2660 raft_consensus.cc:2749] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.919450  2804 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.939656 31051 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:31.919929 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:31.896736  2805 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.940508  2660 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:31.921851  2740 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:31.922333  2766 consensus_queue.cc:1059] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:31.915870 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.940876  2660 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.940932 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:31.941321 30974 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:31.942409 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:31.921970 30942 leader_election.cc:400] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12.
I20260709 12:25:31.927747  2837 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.943831  2778 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:31.944258  2778 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.944582  2778 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.944954  2837 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.945448 30942 leader_election.cc:403] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:31.947386 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:31.947804  2780 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.948102 30974 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:31.948688  2649 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:31.949134 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:31.949668 30894 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.949929  2837 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12.
I20260709 12:25:31.950575  2837 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.950989  2837 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.909849 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:31.926980 30897 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:31.939441  2572 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.907910  2537 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.941329  2660 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.954800  2572 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.943018  2342 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:31.943312  2766 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:31.955914  2766 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:31.956698  2766 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:31.957804  2766 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.962518 30865 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.952899  2837 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:31.963835 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:31.964412 30970 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.965904  2415 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.967356 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:31.967908 31618 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:31.969292 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.954774 30969 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
W20260709 12:25:31.964534  2818 log.cc:927] Time spent T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.476s	user 0.002s	sys 0.001s
I20260709 12:25:31.974802 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.975411 31623 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:31.975968 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 1012) took 1459 ms. Trace:
I20260709 12:25:31.976351 31622 rpcz_store.cc:276] 0709 12:25:30.516812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.518194 (+  1382us) service_pool.cc:224] Handling call
0709 12:25:30.538830 (+ 20636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.278454 (+739624us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b1800490d80. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f03301d54bc 00007f032d52348b 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f0330625060 00007f0330625bfb 00007f033063064b
0709 12:25:31.278587 (+   133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.278612 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.279099 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.416396 (+137297us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:31.440060 (+ 23664us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.440288 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.440361 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.893057 (+452696us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b1800490d80. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:25:31.964000 (+ 70943us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:31.975762 (+ 11762us) raft_consensus.cc:1685] finished
0709 12:25:31.975784 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.975911 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40390,"prepare.queue_time_us":23961,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":949,"raft.queue_time_us":41533,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":6036,"spinlock_wait_cycles":59156992,"thread_start_us":199786,"threads_started":2,"wal-append.queue_time_us":208557}
I20260709 12:25:31.963374 30865 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:31.978559 30942 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:31.981603 30967 raft_consensus.cc:2468] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:31.934700  2498 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:31.989184 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.990447  2342 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:31.991952  2415 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.993103  2812 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:31.995685 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:31.988411 30970 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:32.004683 30865 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.006582 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:32.008251 31622 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:32.010586 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:32.012002 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:32.013375 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:32.017287 30894 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:31.987479 31618 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:32.036262 30864 leader_election.cc:400] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 8. Current term is 9.
I20260709 12:25:32.024595 30969 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:32.004127  2665 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:32.025425 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:32.029935 31045 raft_consensus.cc:1240] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:25:31.994496  2689 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:32.048636 31621 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:32.049829 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:32.047588 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 62070.2us
I20260709 12:25:32.066227 30942 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.071290 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.072232 31046 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.076098 31588 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.036335  2679 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.046918  1944 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:32.046448  2796 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.064019  2689 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.114004  2689 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.104506  2675 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.121378  2675 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:32.122037  2796 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:32.125069  2799 raft_consensus.cc:3055] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:32.125494  2799 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:32.075106  2835 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:32.081673  2792 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.085933  1944 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.113392  2814 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:32.105002  2282 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:32.139103 30969 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:32.067194  2342 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:25:32.136862  2802 raft_consensus.cc:2804] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:32.159039  2792 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.164597  2802 raft_consensus.cc:697] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:32.165867  2792 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:32.163275  2814 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.159322  2835 raft_consensus.cc:697] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:32.167455  2835 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.168264  2814 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:32.168283  2779 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.165485  2802 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.180739  2689 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.182776  2689 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:32.159803  2845 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:25:32.161820  2796 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:32.162220  2778 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.189205  2778 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:32.159303  1944 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.162388  2660 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.200016  2660 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:32.200516 31618 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:32.100225  2679 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:32.201607 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:32.202334 31623 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:32.202696  2679 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:32.203125 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:32.203869 31616 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 11: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:32.206257  2498 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:32.207866 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 181912us
I20260709 12:25:32.208536 30865 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:32.209496 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:32.210108 30972 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:32.209436 31014 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:32.211047 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:32.211608 31618 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.228353 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.229419 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:32.233194 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:30.157706 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.249850 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:32.250533 30976 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:32.254825 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:32.255412 30975 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
W20260709 12:25:32.260344 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 51890.8us
I20260709 12:25:32.261554 30865 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.236040  2665 raft_consensus.cc:493] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:32.264572  2665 raft_consensus.cc:515] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:32.266500  2665 leader_election.cc:290] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:32.266979  2665 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:32.256271  2675 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:25:32.268747  2799 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.270241  2799 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.274824 31587 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:32.260082 31618 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:32.282353 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:32.282804 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:32.284353  2686 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:32.284891 30975 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.286782  2411 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.287292  2411 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.282955  2433 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:32.288304  2433 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:32.288666  2433 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.288841  2703 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:32.289352  2703 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:32.291254  2703 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:32.293215 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:32.293990 30974 raft_consensus.cc:2393] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:32.254511  2498 raft_consensus.cc:2804] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:32.251929  2688 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.248035  2702 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:32.306849 30975 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 14.
I20260709 12:25:32.257349  2479 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:32.319293 30865 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.234965  2679 consensus_queue.cc:1059] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:25:32.325855 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 260485us
I20260709 12:25:32.272815  2796 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:32.328751 31049 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:32.327996 30942 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.341140 30798 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48640 (request call id 262) took 11073 ms. Trace:
I20260709 12:25:32.235946  2807 consensus_queue.cc:1059] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 12:25:32.344203 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 86418.5us
I20260709 12:25:32.345353 31016 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:32.346611 31588 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.344275 30867 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:32.347419 31588 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:32.346642 31050 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:32.316994  2664 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:32.358179 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 308415us
I20260709 12:25:32.360020 31047 raft_consensus.cc:1240] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:32.360306 30897 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:32.361347 31616 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:32.361855 31044 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:32.362361 30893 raft_consensus.cc:1275] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:25:32.368629 30893 pending_rounds.cc:85] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Aborting all ops after (but not including) 8
I20260709 12:25:32.368871 30893 pending_rounds.cc:107] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:32.321208  2702 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.363471 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:32.364674 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.369175 30893 raft_consensus.cc:2889] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:32.404948 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:32.406715 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:32.329478  2665 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:32.404141 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.410890 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8d20fced0547649402e6668241468c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:32.411376 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:32.343849  2781 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.433492 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:32.433647 31047 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:32.414139 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:32.347350  2498 raft_consensus.cc:697] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:32.364240  2337 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:32.427435 30900 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:32.431548 30897 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:32.320680  2479 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.432832 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:32.344740  2796 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.296708  2348 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:32.436439 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 63280.9us
I20260709 12:25:32.494621 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:32.368914  2778 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:32.369153  2660 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:32.368803  2801 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:32.326472  2688 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:32.428207  2689 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.401335 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:32.365658  2664 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.466735 31045 raft_consensus.cc:3055] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:32.431540  2702 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.370779  2596 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.505113 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.514148 31621 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:32.514520 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.369376  2731 consensus_queue.cc:1059] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:25:32.521168 30897 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:32.524361 30895 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:32.583667 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:32.584976 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:32.464218  2282 consensus_queue.cc:1048] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:25:32.526849  2491 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:32.441112  2781 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.341732 30798 rpcz_store.cc:276] 0709 12:25:21.267712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.267928 (+   216us) service_pool.cc:224] Handling call
0709 12:25:32.341020 (+11073092us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:28.695422 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:28.766301 (+ 70879us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:28.766350 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:25:28.766368 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:28.902380 (+136012us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:28.938489 (+ 36109us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:28.941942 (+  3453us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:25:28.962989 (+ 21047us) tablet.cc:701] Row locks acquired
0709 12:25:28.963032 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:25:28.963217 (+   185us) write_op.cc:270] Start()
0709 12:25:28.963360 (+   143us) write_op.cc:276] Timestamp: P: 1783599928963132 usec, L: 0
0709 12:25:28.963392 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:25:29.061096 (+ 97704us) log.cc:844] Serialized 8064 byte log entry
0709 12:25:29.465403 (+404307us) op_driver.cc:464] REPLICATION: finished
0709 12:25:29.567313 (+101910us) write_op.cc:301] APPLY: starting
0709 12:25:29.571751 (+  4438us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:29.959467 (+387716us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:29.959598 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:30.095287 (+135689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:30.095654 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:25:30.095711 (+    57us) write_op.cc:312] APPLY: finished
0709 12:25:30.096193 (+   482us) log.cc:844] Serialized 188 byte log entry
0709 12:25:30.126857 (+ 30664us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:30.128889 (+  2032us) write_op.cc:454] Released schema lock
0709 12:25:30.128975 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:30.129418 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:30.129444 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":190171,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":92093,"apply.run_cpu_time_us":30122,"apply.run_wall_time_us":562103,"cfile_cache_hit":82,"cfile_cache_hit_bytes":85444,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6211,"cfile_init":2,"lbm_read_time_us":56159,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":9,"num_ops":21,"prepare.queue_time_us":109884,"prepare.run_cpu_time_us":20063,"prepare.run_wall_time_us":595337,"raft.queue_time_us":175400,"raft.run_cpu_time_us":7503,"raft.run_wall_time_us":62084,"replication_time_us":500344,"thread_start_us":368864,"threads_started":4,"wal-append.queue_time_us":204916,"wal-append.run_cpu_time_us":26900,"wal-append.run_wall_time_us":1848824}]]}
I20260709 12:25:32.591807 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:32.527751  2835 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:32.532524 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:32.532539 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:32.536167 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.497215  2479 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.535092 31045 raft_consensus.cc:740] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:32.616395 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:32.442757  2337 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:32.522740  2827 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:32.512367  2660 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.633879 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:32.438880  2830 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:32.587922 31051 raft_consensus.cc:2393] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:32.638509 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.588078 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.513901  2807 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:32.595058 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:32.639953 31043 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:32.591835  2491 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:32.596235  2781 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:32.596499  2801 raft_consensus.cc:3055] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:32.597764 30795 catalog_manager.cc:5697] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 6 to 9, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.682900 30795 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 4 to 7, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 7 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:32.599924  2688 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:32.537290  2664 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.533874  2703 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.682538 31045 consensus_queue.cc:260] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.696709 31045 raft_consensus.cc:3060] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:32.625973 31046 consensus_meta.cc:287] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.001s
I20260709 12:25:32.704442 31046 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 14.
I20260709 12:25:32.628504  2337 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.502454  2796 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.671909 31042 raft_consensus.cc:2393] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:32.676589 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:32.724473 30892 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.512384  2778 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:32.536177  2689 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.536228  2846 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 12:25:32.708411 31013 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:32.671478  2660 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.732103 30896 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
W20260709 12:25:32.773543 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 65223.5us
W20260709 12:25:32.701086  2465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.031s	sys 0.025s
I20260709 12:25:32.775876 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:32.776170  2465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.031s	sys 0.025s
I20260709 12:25:32.736918  2411 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:32.777274 30896 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:25:32.777611  2843 log.cc:927] Time spent T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 12:25:32.682154  2801 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:32.618216  2835 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.605924  2498 consensus_queue.cc:237] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:32.772940  2828 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:25:32.777382  2686 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:32.791932 30795 catalog_manager.cc:5697] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 1 to 7, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 7 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:32.695186  2830 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.774991  2781 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:32.809784  2850 log.cc:927] Time spent T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:25:32.805496 31045 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
I20260709 12:25:32.788838  2778 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:32.682092  2807 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.726692  2688 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:25:32.779577  2779 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:25:32.827446 30795 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 8 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:32.725771  2703 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.806947  2282 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:32.807129  2686 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:32.699870  2836 consensus_queue.cc:1175] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9f38f761eded4f28b9d802f6570ee71e" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:32.835268 30795 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 6 to 7, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 7 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:32.793681  2465 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:32.843008  2702 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:32.827114  2806 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:25:32.835588  2686 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.833611  2348 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:32.913419 30898 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:32.849299  2689 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:32.918761 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 53182.5us
I20260709 12:25:32.921990  2807 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:32.924404 30892 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:32.927541 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:32.928200 30893 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.937014  2702 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:32.941380  2433 consensus_meta.cc:287] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.004s
I20260709 12:25:32.941641 30893 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
W20260709 12:25:32.944289  2857 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:25:32.948380  2830 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:32.953994 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:32.955104 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:32.855880  2665 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:32.835891  2282 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.918946  2781 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.943336  2796 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:32.999217 30864 leader_election.cc:304] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:32.836272  2801 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:33.018549  2842 log.cc:927] Time spent T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.528s	user 0.006s	sys 0.008s
W20260709 12:25:33.083436 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:33.027451  2855 log.cc:927] Time spent T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 12:25:33.036845 30867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.019s	sys 0.028s
W20260709 12:25:33.043361 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44218.8us
I20260709 12:25:32.914147  2465 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.054665 31048 raft_consensus.cc:1240] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:33.055945 30969 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:33.059896  2835 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.058646 30975 raft_consensus.cc:1240] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:33.033387  2781 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:32.964589  2433 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.069895 30898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:33.090807 30898 raft_consensus.cc:606] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:33.091154 30898 raft_consensus.cc:614] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:33.077453  2703 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.095320 30795 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:33.078881 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 490177us
W20260709 12:25:33.084388 30867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.019s	sys 0.028s
W20260709 12:25:33.097579 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 586860us
I20260709 12:25:33.084949 30864 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:33.057161 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.098932 31013 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:33.060861 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.050770  2849 consensus_queue.cc:1059] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:25:33.113101 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:33.007714  2688 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:33.099030 30972 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:33.118073 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.118618 30972 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:33.101145 31042 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:33.101550 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.122170 30893 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:33.102849 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:33.123212 31045 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:33.106190 31015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.108139 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.110622 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:33.111184 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:33.125384 31615 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:33.067154  2778 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.127990 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:33.089732  2801 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:33.135516 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 50650.1us
I20260709 12:25:33.135636 30939 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:33.131947  2596 raft_consensus.cc:697] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:33.137044  2862 raft_consensus.cc:3055] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:33.137491  2862 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:33.138334  2862 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.138890  2491 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.139518  2862 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.139835  2491 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:33.141337  2852 log.cc:927] Time spent T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:25:33.142846  2749 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:33.144583  2596 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.115234  2451 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:33.106029  2835 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:33.152532  2835 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:33.153987  2854 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:25:33.154759  2835 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.155903  2703 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.160254  2862 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:33.160979  2862 consensus_queue.cc:1243] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 1a7b44e2d0ed440985e5f643a5a54587 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:33.161262 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:33.161871 31047 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:33.164268 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:33.164883 31045 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.173846 31042 pending_rounds.cc:85] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 9
I20260709 12:25:33.174389 31042 pending_rounds.cc:107] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:33.174710 31042 raft_consensus.cc:2889] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.077236  2665 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.186985 31622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44882 (request call id 1270) took 1166 ms. Trace:
I20260709 12:25:33.193008 31622 rpcz_store.cc:276] 0709 12:25:32.021029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.021128 (+    99us) service_pool.cc:224] Handling call
0709 12:25:32.021418 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.063442 (+ 42024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.063471 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.183596 (+120125us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b2c000472a8. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032ef26a11 00007f032ef36372 00007f0330668a01 00007f033062d43a 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2
0709 12:25:32.184048 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:25:32.534393 (+350345us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:32.534431 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.534496 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.186729 (+652233us) raft_consensus.cc:1685] finished
0709 12:25:33.186753 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.186933 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44283,"raft.queue_time_us":45856,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":9898,"spinlock_wait_cycles":8864000,"thread_start_us":349994,"threads_started":1,"wal-append.queue_time_us":619911}
I20260709 12:25:33.196168 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:33.197264 30939 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:33.201371 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 500077us
I20260709 12:25:33.190390 31045 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:33.202422 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.204780 31047 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:33.202932 30864 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:33.193197  1944 consensus_meta.cc:287] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 1.000s	user 0.009s	sys 0.001s
I20260709 12:25:33.215013 31014 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:33.187071  2749 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:33.221004 31014 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:33.218189 30970 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:33.273406 31624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 1027) took 1324 ms. Trace:
W20260709 12:25:33.275138 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 72277.3us
I20260709 12:25:33.277038 30864 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:33.275393 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 70030.8us
I20260709 12:25:33.131419  2688 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:33.315466 31016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.282279 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.276412 31624 rpcz_store.cc:276] 0709 12:25:31.948514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.955583 (+  7069us) service_pool.cc:224] Handling call
0709 12:25:31.955901 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:31.956267 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:31.956294 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:31.956811 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 12:25:32.151564 (+194753us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:32.151603 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.151675 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.017968 (+866293us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b4400022b4c. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d466c85 00007f032d4676a2 00007f03301d91db 00007f03301d4aaf 00007f03301c886e 00007f03301c7bb6 00007f03301c77d8 00007f03301d1221 00007f03301d11d9 00007f03301d1169
0709 12:25:33.224806 (+206838us) raft_consensus.cc:1685] finished
0709 12:25:33.224829 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.273320 (+ 48491us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1086,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":70490368,"thread_start_us":194359,"threads_started":1,"wal-append.queue_time_us":387807}
W20260709 12:25:33.324358 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 103434us
I20260709 12:25:33.325935 30898 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:33.278955  2700 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.337323 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:33.339116 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 62162.2us
I20260709 12:25:33.345835 30898 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:33.225566  2863 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:33.348292 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 44219.6us
I20260709 12:25:33.228242  2788 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.319057  2415 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:33.280303  2282 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.360841 30795 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 5 to 8, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 8 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.203122  2573 consensus_queue.cc:1059] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:25:33.284929 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.278836  2833 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:33.331363  2866 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:33.333600  2731 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:33.228595  1944 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.365267 30795 catalog_manager.cc:5697] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:33.330142  2740 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.353391  2859 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:33.410447 30795 catalog_manager.cc:5697] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 6 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.288468 30865 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:33.285300 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.433789 30899 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
W20260709 12:25:33.437889 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 149495us
I20260709 12:25:33.355381  2700 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.364590  2411 raft_consensus.cc:2749] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:33.369817  2415 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:33.453567 30901 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 13: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:33.417271  2740 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.482445  2740 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.414443  2866 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:33.374073  2749 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:33.375221  2731 raft_consensus.cc:493] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.489730  2731 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:33.370832  2796 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.452823  2846 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.456274  2433 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:33.456652 30941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.029s	sys 0.121s
I20260709 12:25:33.483633  2866 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:33.493299 30941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.030s	sys 0.121s
W20260709 12:25:33.460384  2868 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:25:33.463785  2872 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:25:33.466009  1944 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:33.470783  2479 consensus_meta.cc:287] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.840s	user 0.006s	sys 0.001s
W20260709 12:25:33.471686 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.472899  2700 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.216233  2785 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.200s
W20260709 12:25:33.489959  2337 consensus_meta.cc:287] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.003s
I20260709 12:25:33.453816 30795 catalog_manager.cc:5697] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 7 to 8, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:33.366529  2871 consensus_queue.cc:1059] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
W20260709 12:25:33.481137  2686 consensus_meta.cc:287] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.004s
I20260709 12:25:33.361819  2863 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.477252  2465 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:33.477198  2792 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:25:33.498723 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 284684us
I20260709 12:25:33.484599  2814 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:33.381553  2833 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.492323  2846 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:33.501681  2664 consensus_meta.cc:287] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 12:25:33.502209  2479 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.499084  2433 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:33.532534 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:33.499742  2689 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:33.534242 30864 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.534572 31047 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:33.534981 30892 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:33.538875 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:33.539605 31624 raft_consensus.cc:2393] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:25:33.526999  2660 consensus_meta.cc:287] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.733s	user 0.004s	sys 0.006s
W20260709 12:25:33.535357 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 323762us
W20260709 12:25:33.533164 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 204282us
I20260709 12:25:33.540696 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:33.543251 31045 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:33.543494 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:33.533262  2846 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.509812  2686 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.582641 30893 raft_consensus.cc:1240] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:33.578783 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.579562 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.583804 30976 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 7.
I20260709 12:25:33.509294  2337 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.535897  2871 raft_consensus.cc:3055] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:33.588039 31044 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
W20260709 12:25:33.581334  2799 consensus_meta.cc:287] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 1.307s	user 0.013s	sys 0.001s
I20260709 12:25:33.572646  2498 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:33.530826  2792 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:33.604487 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 109857us
I20260709 12:25:33.605937 30897 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
W20260709 12:25:33.601522 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 155391us
I20260709 12:25:33.532615  2814 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.574564  2870 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.606799  2870 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.607904 30897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2328) took 1074 ms. Trace:
I20260709 12:25:33.608279  2814 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:33.608884  2870 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.611690 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:33.612267 31050 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:33.574318  2807 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:33.613942  2807 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.616297 30967 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:33.616623 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
W20260709 12:25:33.616796 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 255828us
I20260709 12:25:33.617204 30976 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:33.617539 30867 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:33.618772  2703 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:33.608292 30897 rpcz_store.cc:276] 0709 12:25:32.533157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.584727 (+ 51570us) service_pool.cc:224] Handling call
0709 12:25:33.607762 (+1023035us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400207e54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:33.607855 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344009088}
I20260709 12:25:33.621024 31013 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:33.540589  2433 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.634969 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:33.545200  2796 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:33.635929 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:33.620122 30847 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1a7b44e2d0ed440985e5f643a5a54587 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:33.636868 30847 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c773fc74822844b7aec9509683eb266e already in progress
I20260709 12:25:33.541385  2688 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.539062  2664 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.623041 30900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2322) took 1091 ms. Trace:
I20260709 12:25:33.596222  2871 raft_consensus.cc:740] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:33.646322 30900 rpcz_store.cc:276] 0709 12:25:32.531612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.531764 (+   152us) service_pool.cc:224] Handling call
0709 12:25:32.532113 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.535708 (+  3595us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:32.604634 (+ 68926us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.924488 (+319854us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4800002958. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0335556aa1 00007f033554db37 00007f033554d9ca 00007f033564526f 00007f0335644f37 00007f033565955c 00007f0335659508 00007f0335659488 00007f0335659443 00007f03356586ec 00007f0334582a96
0709 12:25:32.997663 (+ 73175us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.008545 (+ 10882us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.008709 (+   164us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:33.008749 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.008837 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.604128 (+595291us) raft_consensus.cc:1685] finished
0709 12:25:33.622862 (+ 18734us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.622986 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71725,"prepare.queue_time_us":70018,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":76204,"raft.run_cpu_time_us":8010,"raft.run_wall_time_us":331343,"spinlock_wait_cycles":3670272,"thread_start_us":389696,"threads_started":1,"wal-append.queue_time_us":598135}
I20260709 12:25:33.648470 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.623613 30899 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:33.572731  2660 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.635584 30895 raft_consensus.cc:606] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:33.644676 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:33.637178 30847 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c773fc74822844b7aec9509683eb266e already in progress
I20260709 12:25:33.651859 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:33.655066 30976 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
I20260709 12:25:33.651901 30895 raft_consensus.cc:614] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:33.649993 30900 raft_consensus.cc:3060] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:33.700109 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 48315.1us
I20260709 12:25:33.707273 31049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46204 (request call id 2480) took 1293 ms. Trace:
I20260709 12:25:33.707759 31049 rpcz_store.cc:276] 0709 12:25:32.413795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.413909 (+   114us) service_pool.cc:224] Handling call
0709 12:25:33.707047 (+1293138us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540007c1d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:33.707204 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523191680}
I20260709 12:25:33.605361  2573 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.605183  2785 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.668011 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.537443  2415 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.545239  2689 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.734716 30864 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:33.577309  2749 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.743990 31621 raft_consensus.cc:1240] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:25:33.747123 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 204855us
I20260709 12:25:33.748811 31587 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:33.726351  2688 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.623795  2498 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.660807  2796 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.775185  2859 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:33.796211 30898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:33.763201  2882 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:33.796826 30898 raft_consensus.cc:606] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:33.797178 30898 raft_consensus.cc:614] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:33.744499  2573 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:33.801322 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 48337.4us
W20260709 12:25:33.796039  2491 consensus_meta.cc:287] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.005s
I20260709 12:25:33.748970  2785 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.796712  2688 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:33.816148 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 114085us
I20260709 12:25:33.819208 30971 raft_consensus.cc:2410] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:25:33.799871  2891 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:33.813953  2873 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:25:33.803169  2596 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:33.828287  2886 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
W20260709 12:25:33.829133  2874 log.cc:927] Time spent T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:25:33.851356 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 75345.1us
I20260709 12:25:33.815426  2888 raft_consensus.cc:493] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:33.830005  2479 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.870198  2498 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.830675  2700 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:33.847791  2890 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:33.877688  2890 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.804697  2882 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:33.854360 30939 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.1:39249 timed out after 1.822s (SENT) [suppressed 10 similar messages]
I20260709 12:25:33.829515  2833 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.869199  2660 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.857491  2847 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.869939  2785 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:33.831360  2688 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.774154  2871 consensus_queue.cc:260] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:33.848424  2891 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.830631  2872 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:33.859162  2876 log.cc:927] Time spent T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:25:33.861966  2888 raft_consensus.cc:515] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.869808  2689 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:33.873373 30900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
W20260709 12:25:33.887825 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 82114.7us
I20260709 12:25:33.871199  2686 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.897435 31587 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:33.882548  2880 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:25:33.899339 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 278385us
I20260709 12:25:33.879673  2890 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.862083  2799 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:25:33.858664  2596 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.893872  2847 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.920557 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:33.921254  2596 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.922500  2847 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.903237  2880 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.894656  2891 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:33.925671  2880 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.926061  2740 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.928300  2573 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.929126 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:33.859495  2859 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.906159  2894 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:33.897364  2664 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.886761  2904 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:33.908106 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:33.908324 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:33.907665  2882 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.909076  2863 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.910203 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:33.910887  2688 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.955806 31619 raft_consensus.cc:2410] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:25:33.902617  2911 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:25:33.912241  2872 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:33.892163  2792 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.918108  2870 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.932415 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:33.932718 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:33.964586 31048 raft_consensus.cc:2393] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 13: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:33.966958  2888 leader_election.cc:290] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:33.934919 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 80607.4us
I20260709 12:25:33.941625 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.955575 31617 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.957553 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:33.971205 30970 raft_consensus.cc:2368] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 11. Current term is 12.
W20260709 12:25:33.958423 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 57003.3us
I20260709 12:25:33.934178  2796 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:33.976828 30897 raft_consensus.cc:1240] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:25:33.978149 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.976697 30865 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:33.980448 30893 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:33.981297 31623 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:33.968322  2740 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.983044 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:33.983304 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:33.983824 30867 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:33.985765 30892 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:33.986004 31013 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:33.988590 31048 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:33.988747 31047 raft_consensus.cc:2368] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:33.992220 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.992888 30897 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 14.
I20260709 12:25:33.993993 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:33.992336 30865 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:33.997552 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:33.999761 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:34.000092 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.002625 30939 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:34.003428 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:34.000707 30970 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 7.
I20260709 12:25:33.954897  2894 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.009933 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:33.978674  2799 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:34.012473 31047 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:33.968401  2846 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.011045 31617 raft_consensus.cc:2410] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:34.014020 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.019441  2573 consensus_queue.cc:1059] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:25:34.022739  2872 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.023581  2911 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:34.024088  2912 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:34.024130  2911 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:33.969084  2731 raft_consensus.cc:515] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.033371  2660 consensus_queue.cc:1059] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:34.034785  2731 leader_election.cc:290] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:34.034947  2660 raft_consensus.cc:3055] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:34.035327  2660 raft_consensus.cc:740] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:34.036362 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.036857 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.037518 31623 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:34.038095 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.038691 31620 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:34.041579  2891 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.042681 31621 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:34.038407 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.044155  2781 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.006011  2908 consensus_queue.cc:1059] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:25:34.044895  2802 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.025758  2882 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.045408  2802 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.046129  2882 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.020270  2888 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:34.047462  2802 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:34.047624  2337 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:33.997231  2847 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.986860  2415 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:34.017598 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:34.055272 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:34.081389 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 63883.7us
I20260709 12:25:34.036954 31624 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:34.061615 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.083287 31621 raft_consensus.cc:2368] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10.
I20260709 12:25:34.086833 30939 leader_election.cc:400] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:34.005014  2902 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.090636 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.091840 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:34.093777 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 78864.5us
I20260709 12:25:34.094313 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.016566 30892 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:33.972999  2904 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.032409  2917 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:34.032656  2897 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:33.994566  2907 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:34.048471 30900 raft_consensus.cc:606] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:34.035979  2799 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:34.037664 31619 raft_consensus.cc:1275] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:34.058408 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.035957  2911 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:34.048975 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:34.063841 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:34.079370 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 52316.3us
I20260709 12:25:34.131641 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.132372 30892 raft_consensus.cc:2393] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 14: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:34.053416 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.080646 31617 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:34.047633  2888 raft_consensus.cc:493] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:34.135972 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 87166us
I20260709 12:25:34.024600  2912 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:34.084239 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.142927 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.084584  2740 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.143997  2740 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.144402  2740 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.145895  2799 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.085321 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.018213 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.148377 31624 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 8.
I20260709 12:25:34.089135 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:34.086715 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:34.149602 31047 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.150068  2912 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.151264  2912 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.087952 30939 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:34.153651  2740 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.154727 30974 raft_consensus.cc:2368] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 14. Current term is 15.
I20260709 12:25:34.142316  2888 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.156266  2740 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.157032 31047 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:34.094445 31013 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:34.078439  2847 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.157924  2847 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.107828 30900 raft_consensus.cc:614] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:33.968999  2870 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:34.158177 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 63815.6us
I20260709 12:25:34.159754  2870 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.132350  2415 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 13 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:34.160444 30896 raft_consensus.cc:2368] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 11. Current term is 12.
I20260709 12:25:34.160003 30968 raft_consensus.cc:2393] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:34.107847 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.038411  2894 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:34.043627  2891 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.045461  2908 raft_consensus.cc:3055] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:34.129522 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.175864  2908 raft_consensus.cc:740] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:34.176088 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.177230 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.178289 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.083598 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:34.136670 31587 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:34.179316 30976 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.179633  2894 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:34.180177  2894 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:34.180982  2894 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.182927 30942 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:34.171540 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.184772 30942 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:34.185213 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:34.134049 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:34.132030 30864 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:34.186328 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 54389.5us
I20260709 12:25:34.186440 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.186700 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16482c443f7041fa88ccf619697bd7b6" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.138674  2911 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.140197  2778 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.141093 31588 leader_election.cc:400] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 11. Current term is 12.
I20260709 12:25:34.127821  2917 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.157317  2586 raft_consensus.cc:3055] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:34.096637 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41891dd6716497eaa34a9558f696ee1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:34.197624 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 63659.6us
I20260709 12:25:34.197661 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.198740 31619 raft_consensus.cc:3060] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.165439 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:34.199213 30897 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.166749 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.196514  2664 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.136968  2862 consensus_queue.cc:1059] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:25:34.210006  2862 raft_consensus.cc:3055] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:34.169070 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 81189.2us
I20260709 12:25:34.168747  2731 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:34.130530  2660 consensus_queue.cc:260] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.173736  2415 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.218737 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:34.129618 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.219909 30939 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:34.220511 30969 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:34.186992 31624 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:34.188349 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.188997 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.189278 30892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:34.222424 31616 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.222817 30892 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.222462 31623 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.192413 30976 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:34.196177 31588 leader_election.cc:403] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:34.183257  2887 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:34.227392 30973 raft_consensus.cc:2393] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 12: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:34.229550 31050 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:34.183772  2891 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.201844  2846 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.203608  2864 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:34.232386  2870 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:34.232733  2864 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:34.233166  2864 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.234087  2907 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:34.234563  2907 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.236195  2888 raft_consensus.cc:515] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.236577  2907 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.203999 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.238284  2888 leader_election.cc:290] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.204401  2836 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.197239  2814 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:25:34.195925  2700 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.276172  2883 consensus_queue.cc:1059] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:25:34.276623  2700 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.210382  2862 raft_consensus.cc:740] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:34.278003  2862 consensus_queue.cc:260] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.279179  2862 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.210634  2586 raft_consensus.cc:740] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:34.216552 30942 leader_election.cc:304] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:34.189817  2740 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:34.225999 30897 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:34.288793 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.289420 30897 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:34.223694 31016 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
W20260709 12:25:34.290325 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 66700.2us
I20260709 12:25:34.292024 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.292574 31043 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:34.293342 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:34.293617 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.230252 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:34.295275 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 78801.7us
I20260709 12:25:34.231317 31049 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:25:34.231819  2835 consensus_queue.cc:1048] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:34.232029  2660 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:34.243083 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 102110us
I20260709 12:25:34.301741 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:34.247493 30865 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:34.275497 31050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.215711  2731 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.203646  2917 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.232754  2904 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.297953 31043 raft_consensus.cc:2368] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
W20260709 12:25:34.277940  2918 log.cc:927] Time spent T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:34.297609 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
W20260709 12:25:34.354954 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 57429.4us
W20260709 12:25:34.355919 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 108517us
I20260709 12:25:34.305378 31623 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:34.326030 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.326864 31588 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.283043 31619 raft_consensus.cc:2468] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:34.277297  2883 raft_consensus.cc:3055] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:34.232905  2870 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:34.280345  2586 consensus_queue.cc:260] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.343053  2731 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.305333  2749 raft_consensus.cc:2749] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.299226  2740 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:34.363526 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:34.279059  2847 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.340520  2781 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:34.364313 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.393565 31588 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.393841 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:34.394405 30897 raft_consensus.cc:2368] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:34.363143  2883 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:34.325321  2908 consensus_queue.cc:260] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.361948 30942 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:34.376495 30892 raft_consensus.cc:2468] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:34.405623 30892 raft_consensus.cc:1240] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:25:34.288676  2846 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:25:34.358770  2411 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.362820  2902 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:34.358712  2689 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.395052 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:34.403713 31588 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.406508 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:34.407123 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 45250.3us
I20260709 12:25:34.376008  2912 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 11. Current term is 12.
I20260709 12:25:34.370105  2779 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:25:34.416522  2920 log.cc:927] Time spent T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:25:34.417963  2902 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:34.418879  2902 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.424258 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.427911  2870 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.428805 31043 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:34.429309  2700 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.393134  2781 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.430958  2781 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.367694  2901 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 12:25:34.414271 31588 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.412871  2749 raft_consensus.cc:2804] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:34.415397  2927 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:25:34.405077  2917 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.393115  2905 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.410893 30897 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.432858 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.392820  2740 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.414088  2908 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:34.434968 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 79108.1us
I20260709 12:25:34.405309  2814 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:34.439456 31588 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.411163  2689 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.442679 31043 raft_consensus.cc:2468] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:34.440914  2872 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.447805 30939 leader_election.cc:400] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:34.435107  2778 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:34.449208 30939 leader_election.cc:403] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:25:34.453126 31588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.453495 30897 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 15.
I20260709 12:25:34.456203 30897 raft_consensus.cc:1240] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:34.456372 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.459264 31615 raft_consensus.cc:2393] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 12: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:34.413094  2411 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.452126  2689 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.464695 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.465761 30939 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:34.468102 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:34.482331  2926 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:25:34.436975  2846 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:34.471223 30898 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:34.448649  2905 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.484258 30898 raft_consensus.cc:606] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:34.485250 30898 raft_consensus.cc:614] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:34.486382 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:34.452976  2749 raft_consensus.cc:697] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:34.487905  2749 consensus_queue.cc:237] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.454922  2904 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.448172  2814 raft_consensus.cc:493] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.490237  2814 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.448390  2883 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.492389  2883 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.457386  2766 raft_consensus.cc:3060] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:34.498155 30940 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.515314 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.515939 31588 leader_election.cc:400] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 14. Current term is 15.
I20260709 12:25:34.516350 31588 leader_election.cc:403] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:34.515766 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.440557  2864 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.546988 31587 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.555789 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.558027  2847 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.538038  2337 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.560045 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:34.560870 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.561300 31617 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:25:34.561635 31617 pending_rounds.cc:85] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 9
I20260709 12:25:34.561831 31617 pending_rounds.cc:107] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:34.562038 31617 raft_consensus.cc:2889] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.555649  2348 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:34.569509  2348 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.582903 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.582859 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.588400 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.589021 31046 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:34.569416  2905 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:34.568847  2411 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.599102 31587 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:34.600749 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.601799 30864 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:34.586169  2282 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.604226 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.560050  2337 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.596891  2660 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.616640 31616 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 15.
I20260709 12:25:34.608107  2411 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:34.623970 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.605541  2872 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:34.629801 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 195642us
I20260709 12:25:34.620251  2779 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for earlier term 14. Current term is 15.
I20260709 12:25:34.621618  2411 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.622901  2917 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:34.640290  2931 log.cc:927] Time spent T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:34.640944  2348 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.647758 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:34.649189 31619 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:25:34.649555 31619 pending_rounds.cc:85] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 9
I20260709 12:25:34.649783 31619 pending_rounds.cc:107] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:25:34.650066 31619 raft_consensus.cc:2889] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:34.654619 30894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37078 (request call id 2329) took 2112 ms (client timeout 1822 ms). Trace:
I20260709 12:25:34.647244 31013 leader_election.cc:304] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:34.657193 31013 leader_election.cc:304] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:34.655092 30894 rpcz_store.cc:269] 0709 12:25:32.533390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.583375 (+ 49985us) service_pool.cc:224] Handling call
0709 12:25:34.637541 (+2054166us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400098b54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:34.645341 (+  7800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171304192}
I20260709 12:25:34.647243  2411 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.645468  2917 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:34.668885 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 204414us
W20260709 12:25:34.669809 31589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.673594 30939 leader_election.cc:400] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:34.674579 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.676785 31045 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:34.654033  2911 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.631045  2872 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.683956 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.664717  2905 raft_consensus.cc:2804] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:34.688555 30894 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:34.691138 31615 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.677286  2917 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.680867  2796 raft_consensus.cc:2804] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:34.679806  2907 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.704501 31013 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:34.717607 31615 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:34.697042  2835 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:34.699906  2905 raft_consensus.cc:697] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:34.715706  2836 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.719532  2864 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.717936  2796 raft_consensus.cc:697] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:34.741130 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 44546us
W20260709 12:25:34.740777 30941 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.746011  2937 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:25:34.747007  2871 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.749418  2337 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.756108 30939 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:34.713819  2740 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.715834  2907 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:34.759258  2928 log.cc:927] Time spent T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.492s	user 0.004s	sys 0.000s
I20260709 12:25:34.733253  2778 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:34.731832  2870 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:34.791266  2905 consensus_queue.cc:237] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:34.792383  2951 log.cc:927] Time spent T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:34.797746  2766 raft_consensus.cc:2749] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505) with higher term. Message: Invalid argument: T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:34.735167  2836 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.733471  2948 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
W20260709 12:25:34.819180 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.819321 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 220283us
I20260709 12:25:34.820102 31587 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:34.822794 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 66769.2us
I20260709 12:25:34.813140  2836 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.829633 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:34.832774 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.825745  2766 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:34.834013  2766 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.834331  2955 consensus_queue.cc:1059] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:34.835130  2955 raft_consensus.cc:3055] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:34.835439  2955 raft_consensus.cc:740] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:34.836404 30900 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:34.839355 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:34.841450 30974 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:34.842315 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.843850 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.845160 31047 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:34.822304  2894 raft_consensus.cc:2749] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.852975  2894 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:34.807526  2870 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.807793  2778 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.857223  2778 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.823578  2702 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.843843  2950 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:34.916709  2870 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.916764  2950 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.918952  2950 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.824683  2887 raft_consensus.cc:493] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:34.863840 31045 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:34.863963 31047 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:25:34.864650 30901 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49788 (request call id 2088) took 2503 ms (client timeout 1919 ms). Trace:
W20260709 12:25:34.948134 30901 rpcz_store.cc:269] 0709 12:25:32.361161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.368655 (+  7494us) service_pool.cc:224] Handling call
0709 12:25:34.864483 (+2495828us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400098154. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:34.864585 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184622976}
I20260709 12:25:34.866609  2872 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.911521  1944 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:34.913921  2411 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.915360  2740 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.835997  2766 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:34.915913  2702 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.846257  2749 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:34.930606 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 80622.7us
I20260709 12:25:34.962107 30895 raft_consensus.cc:1240] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:34.878618 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:34.836692  2596 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:34.834039  2863 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:34.817066  2948 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:34.952286 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 124747us
I20260709 12:25:34.954439 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:34.964159 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 85656.9us
I20260709 12:25:34.968720 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.970901 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:34.971866 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.836303  2796 consensus_queue.cc:237] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.972657 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:34.962567  2781 consensus_meta.cc:287] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.005s
I20260709 12:25:34.971903 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.973323 30894 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
W20260709 12:25:34.975965  2731 consensus_meta.cc:287] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.584s	user 0.004s	sys 0.009s
I20260709 12:25:35.010417 31049 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:25:35.010855 31049 pending_rounds.cc:85] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 8
I20260709 12:25:35.011098 31049 pending_rounds.cc:107] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:25:35.011303 31049 raft_consensus.cc:2889] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:35.011778  2883 consensus_meta.cc:287] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 12:25:35.012295 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.012849  2778 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:35.010419 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.012876 30900 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:35.017482  2883 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:35.018245  2882 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:25:34.960418  2955 consensus_queue.cc:260] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.955740  2887 raft_consensus.cc:515] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.021278  2887 leader_election.cc:290] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.021064  2731 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.022392 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.022985 31622 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 7.
I20260709 12:25:35.023284  2731 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.975572 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.024510 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:34.979192  2917 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.982766  2907 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.961782  2451 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.985047  2411 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.031255 31051 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 12: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:34.988171  2960 log.cc:927] Time spent T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:25:34.966661  2740 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.959215  2936 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:34.990470  2702 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.990697 31616 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:25:35.035863 31616 pending_rounds.cc:85] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 7
I20260709 12:25:35.036118 31616 pending_rounds.cc:107] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:35.036339 31616 raft_consensus.cc:2889] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.991236 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:34.992300  2948 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.966495  2415 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:34.965436  2847 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:25:34.965595  2749 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:34.998565 31045 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:35.018024  2883 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:34.978639 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.026983 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:35.027391 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.027827 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.028472 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:35.046892 30893 raft_consensus.cc:2393] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 12: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:35.046916  2415 consensus_queue.cc:1243] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer 1a7b44e2d0ed440985e5f643a5a54587 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:35.048661  2887 raft_consensus.cc:493] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:35.052420  2887 raft_consensus.cc:515] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.053723  2833 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:35.054589  2887 leader_election.cc:290] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.031554 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:34.968314  2596 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:35.056057  2749 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.055806  2596 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.056573  2907 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.039633  2936 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.057077  2907 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.057905  2883 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.046643  2836 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.059053  2907 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:35.006278  2781 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.060273  2836 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:35.060719  2917 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:35.061026 31042 raft_consensus.cc:2393] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 11: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:35.061458  2781 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.062201 31050 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:35.034752  2451 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.064064  2936 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.064451  2451 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.065301 31048 raft_consensus.cc:2393] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 8: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
W20260709 12:25:35.065671 30942 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.066035  2891 raft_consensus.cc:493] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:35.066533  2891 raft_consensus.cc:515] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.068475  2891 leader_election.cc:290] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.068902  2950 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:35.069290 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.069437  2950 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:35.071026  2689 consensus_meta.cc:287] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 12:25:35.071348  2950 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.966535  2863 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.072528  2586 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.073271  2863 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.035025  2740 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.054275  2833 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.080346 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.065548 30901 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:35.083407 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.084687 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.084789 30970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.083205 31016 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.085520 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.086424 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.087913 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.088850  2491 raft_consensus.cc:2749] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.089502 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.090548 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acdd02ca27e84adea69d06954f5fe368" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.091437  2887 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:35.092007  2887 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.093180  2807 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.094002  2833 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:34.976683  2814 raft_consensus.cc:515] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.094977 31623 raft_consensus.cc:2368] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:35.075408 31014 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.076411 31618 raft_consensus.cc:1240] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:35.076289 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:35.077811 31622 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:35.078312 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.078383 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ef8a4823164a83ae72778108c8d593" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.050344  2948 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:25:35.089612 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e16650c05cc4ef7a21196d5cc0ca3de" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.074066  2740 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.105775 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.119065 30976 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:35.100126 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.121068 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.111855  2749 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:25:35.122264 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.109578 30974 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:35.123382 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.114017  2433 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:35.124226 31616 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:35.125008 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.125496 31616 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
I20260709 12:25:35.126186 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:35.127452 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.100646 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:35.124123  2814 leader_election.cc:290] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.128283 30894 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.103060 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:35.094707  2887 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:35.132206  2956 log.cc:927] Time spent T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.436s	user 0.000s	sys 0.006s
I20260709 12:25:35.119501 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1166342933745c5b82da4ee4032736c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.134542 30968 raft_consensus.cc:2468] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:35.128355 31622 raft_consensus.cc:2410] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:35.137812 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a1f37dacb24754935cf60327f898a9" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.143945 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.145133 30894 raft_consensus.cc:2468] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:35.146991  2887 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.148325 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:35.150269 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:35.156795 30897 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:35.157491 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 82153.4us
I20260709 12:25:35.152660 31616 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:35.159796 31014 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.140724 31618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.141100 30942 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.160972 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:35.032614 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 74865.3us
I20260709 12:25:35.161808 30894 raft_consensus.cc:2410] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:25:35.163219 30939 leader_election.cc:304] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:35.176127 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.176898 30893 raft_consensus.cc:2468] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:35.113210  2955 raft_consensus.cc:3060] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.179214 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.179927 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.192862 30975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.193612 30975 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 14.
I20260709 12:25:35.194543 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.206346 30893 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 14: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:35.207463 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:35.207281 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 57624.9us
I20260709 12:25:35.180313 31014 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.180568 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.181704 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:35.181258 30942 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.209198 30897 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:35.209903 30894 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:25:35.212582 31016 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.214308 31587 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:35.215924 30942 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:35.217870 31013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.223008 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:35.223275 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.223955 31046 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 8.
I20260709 12:25:35.225304 31047 raft_consensus.cc:1217] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-14.9]   Dedup: 9.6->[10.7-14.9]
I20260709 12:25:35.225818 31047 pending_rounds.cc:85] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 6
I20260709 12:25:35.226040 31047 pending_rounds.cc:107] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:35.226263 31047 raft_consensus.cc:2889] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:35.228681 30942 leader_election.cc:304] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.149433  2833 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.230365 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.071425  2689 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.178454  2491 raft_consensus.cc:2764] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:35.237996 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.242354 30864 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:35.206561  2451 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.212160  2419 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:35.213371  2586 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.250650 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.251202 30968 raft_consensus.cc:3060] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:35.251817 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.252399 31044 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:35.253165 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.253701 31044 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:35.232059  2778 raft_consensus.cc:2804] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:35.233642  2945 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.231329  2871 raft_consensus.cc:2749] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.256387 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.262774 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.231896  2897 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:35.249828 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 69580.1us
I20260709 12:25:35.247622  2887 raft_consensus.cc:2749] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.264065 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.246315  2847 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:35.231395  2342 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:35.255496  2766 raft_consensus.cc:2749] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.256285  2907 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.255537  2836 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.304446 30968 raft_consensus.cc:2468] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:35.239149  2337 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:35.245220  2940 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:25:35.266585  2897 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.245996  2891 consensus_queue.cc:1059] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:25:35.238906  2833 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:35.312589 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 48610.7us
I20260709 12:25:35.314572 31014 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.257243  2888 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:25:35.300911  2778 raft_consensus.cc:697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:35.322165 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.325614 31014 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.297546  2740 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.332971  2689 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.333446  2796 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.321193  2451 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.334137  2848 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:35.334590  2848 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.334951  2848 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:35.342861  2975 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:35.316471  2897 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:35.347990 31013 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:35.352619 30896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35494 (request call id 770) took 1729 ms (client timeout 2071 ms). Trace:
W20260709 12:25:35.353047 30896 rpcz_store.cc:269] 0709 12:25:33.623234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.635690 (+ 12456us) service_pool.cc:224] Handling call
0709 12:25:35.352420 (+1716730us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54002323d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:35.352561 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204555648}
I20260709 12:25:35.354158 30899 raft_consensus.cc:1275] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:35.355778 31013 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:35.309266  2847 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.330394  2887 raft_consensus.cc:3055] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:35.389631 30970 raft_consensus.cc:2393] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 11: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:35.355733  2971 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:35.317309  2337 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.362824  2451 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.410815  2964 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:35.411441  2964 raft_consensus.cc:493] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:35.411962  2964 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.412380 30967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59852 (request call id 817) took 1495 ms. Trace:
I20260709 12:25:35.412781 30967 rpcz_store.cc:276] 0709 12:25:33.917480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.917638 (+   158us) service_pool.cc:224] Handling call
0709 12:25:33.917939 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.921874 (+  3935us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:33.922159 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.002489 (+ 80330us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.003115 (+   626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.003159 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:34.003200 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.234763 (+1231563us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b1800391f00. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d50e2a6 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419
0709 12:25:35.412176 (+177413us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5400126e54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:35.412221 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.412328 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":436,"prepare.queue_time_us":1778,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":3592,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7608,"spinlock_wait_cycles":28546688,"thread_start_us":79127,"threads_started":1,"wal-append.queue_time_us":206128}
I20260709 12:25:35.388731  2796 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:35.392959  2887 raft_consensus.cc:740] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:35.436269 31620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44878 (request call id 1039) took 1401 ms. Trace:
I20260709 12:25:35.437722 31620 rpcz_store.cc:276] 0709 12:25:34.034653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.039231 (+  4578us) service_pool.cc:224] Handling call
0709 12:25:34.039505 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.202519 (+163014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.202549 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.202597 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:34.202626 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.436077 (+1233451us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540046ee54. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062de01 00007f033062c83e 00007f03355f1419 00007f032eb68bd4 00007f032eb68b62 00007f032eb68a91 00007f032eb68a0c 00007f032eb67cc2 00007f032e96848c 00007f032e9678c6
0709 12:25:35.436116 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.436216 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374446848}
I20260709 12:25:35.433540  2796 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:35.448525  2796 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.456724  2860 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.456561  2887 consensus_queue.cc:260] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.457906  2887 raft_consensus.cc:3060] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.440888  2282 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.459824  2967 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.462283 31048 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:25:35.462922 31048 pending_rounds.cc:85] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 7
I20260709 12:25:35.463158 31048 pending_rounds.cc:107] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:25:35.463404 31048 raft_consensus.cc:2889] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:35.466135  2740 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.464016  2282 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.470229  2282 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.457315  2860 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.417207  2778 consensus_queue.cc:237] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.460351  2967 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.483253  2833 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.485052 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.485692 31619 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:35.479266  2337 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.483872  2451 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:35.487041 31016 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:35.491845  2860 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.499841  2848 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.502404  2848 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.505362  2967 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.520175  2897 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.522523  2897 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.525197  2964 raft_consensus.cc:515] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.527757  2766 consensus_queue.cc:1048] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:35.541088 31049 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:35.543154 31050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34990 (request call id 792) took 1268 ms (client timeout 1520 ms). Trace:
W20260709 12:25:35.530124  2977 log.cc:927] Time spent T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:25:35.533262 30973 raft_consensus.cc:2410] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:25:35.543527 31050 rpcz_store.cc:269] 0709 12:25:34.274518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.275212 (+   694us) service_pool.cc:224] Handling call
0709 12:25:35.542982 (+1267770us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b540015a9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f03306312fa 00007f03355f2b17 00007f032eb6d6d4 00007f032eb6d662 00007f032eb6d591 00007f032eb6d50c 00007f032eb6c7c2 00007f032e96848c 00007f032e9678c6 00007f032e96726f
0709 12:25:35.543100 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688898432}
I20260709 12:25:35.527351 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:35.549352 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:35.549363 30939 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.551606 30939 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.552778  2900 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.544333  2894 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:35.553359  2847 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.552757 30939 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.553841  2894 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.554823  2900 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:35.556529  2894 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:35.557345 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 70390.8us
I20260709 12:25:35.557842  2964 leader_election.cc:290] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.558386  2964 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:35.558717  2964 raft_consensus.cc:493] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.559047  2964 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.559919 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:35.560434 31051 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.561372 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:35.551843  2952 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:35.562510  2952 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.562856  2952 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.563442  2830 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.564059 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.563942  2830 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.564735 31046 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 13: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:35.565836  2830 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.566962 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.567507 30967 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.569525 31051 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:35.573619 30968 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:35.574951  2862 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.575413  2862 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.577745 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:35.578413 31619 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:35.578984 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.579548 31623 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
I20260709 12:25:35.584134 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.577859  2862 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.586405  2766 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:35.586921  2766 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.587268 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.589222  2419 raft_consensus.cc:493] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:35.589668  2419 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.592036  2766 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.593083 30901 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:35.552094  2887 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:35.593083 30899 raft_consensus.cc:1275] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:35.595516 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.600222 31042 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:35.601354 31014 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.603788 31619 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:35.605878 30867 leader_election.cc:400] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10.
I20260709 12:25:35.606153 30867 leader_election.cc:403] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:35.593624 30972 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:35.610404 31014 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.618175 30967 raft_consensus.cc:2468] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:35.622756 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.624218  2971 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.625087 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:35.625473  2907 raft_consensus.cc:2804] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:35.625988  2907 raft_consensus.cc:697] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:35.626829  2907 consensus_queue.cc:237] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.627281 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.628835 31014 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.630182  2962 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.604132 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.600121  2952 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.630051  2807 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:25:35.633600 30970 raft_consensus.cc:1240] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:35.635382 31014 leader_election.cc:304] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:35.637369 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217b561ab05e4c71be81abf723e3c499" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
W20260709 12:25:35.637639 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 81533.9us
I20260709 12:25:35.638651 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:35.639329 31623 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:35.641776 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.645197  2952 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.646754 30867 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.648134 30867 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.648981  2971 raft_consensus.cc:2804] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:35.593704  2887 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:35.649608  2887 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:35.651980 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9423709bcf457ab89f49d71d157085" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.652052  2833 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:35.652321  2964 raft_consensus.cc:515] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.653191 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.654220 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.654304  2964 leader_election.cc:290] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.654878 30968 raft_consensus.cc:2393] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 9: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:35.644268 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.659250 30967 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:35.660497 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:35.661248 30967 raft_consensus.cc:2410] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:35.655622 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.661863 30968 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 14.
I20260709 12:25:35.658200  2867 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.666337  2867 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.663820  2415 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10.
I20260709 12:25:35.667534  2860 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.668313 30864 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.670492  2971 raft_consensus.cc:697] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:35.670938  2849 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:35.672339 31042 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 9.
I20260709 12:25:35.671392  2971 consensus_queue.cc:237] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.667572  2415 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:25:35.670459  2703 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.676381 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.677950 31043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:35.676723 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.685443  2964 consensus_queue.cc:1048] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:25:35.688191 30901 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 15 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:35.685753  2887 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.694964 30971 raft_consensus.cc:1275] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:25:35.695354 30971 pending_rounds.cc:85] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 5
I20260709 12:25:35.695571 30971 pending_rounds.cc:107] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:35.695817 30971 raft_consensus.cc:2889] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:35.700390 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:35.701093 31047 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 14.
I20260709 12:25:35.697835  2954 consensus_queue.cc:1059] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:25:35.699613 30867 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.709215  2954 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:35.709633  2954 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:35.707217 30942 leader_election.cc:400] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:35.711377 30942 leader_election.cc:403] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:35.639032 31588 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.715919 31044 raft_consensus.cc:1240] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:35.716538  2912 raft_consensus.cc:2749] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:35.717437 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 78485us
W20260709 12:25:35.719353 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 49428.1us
I20260709 12:25:35.738168 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6741df8b39c94364bb06b6b75ab50bac" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.694289  2887 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:35.781687 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 61071.8us
W20260709 12:25:35.782342 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 61322.5us
W20260709 12:25:35.791000 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 52340.3us
I20260709 12:25:35.791699 30867 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.809929 30867 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.810566 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.811195 30972 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
I20260709 12:25:35.710400  2954 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:35.816351 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:35.818749 30867 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:35.807293  2586 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.820116  2586 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.822041  2586 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.809157  2935 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:35.824072  2867 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:35.776635  2848 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.828133 30972 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:35.824409  2342 raft_consensus.cc:2749] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.788884  2952 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9.
I20260709 12:25:35.808938  2970 consensus_queue.cc:1048] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:25:35.839012 30867 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:35.842165 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:35.843217 30867 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:35.835104  2419 raft_consensus.cc:515] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.848145  2935 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:35.848686  2935 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:35.847697 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 129621us
I20260709 12:25:35.849452  2935 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.850354  2419 leader_election.cc:290] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:35.721804  2891 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:25:35.809270  2932 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:35.851999  2700 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:35.843070  2675 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:35.850476 31588 leader_election.cc:304] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.878830 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:35.879434 31620 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.886147 31620 raft_consensus.cc:2468] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 13.
I20260709 12:25:35.840023  2847 raft_consensus.cc:2749] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.839174  2954 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.893342 31588 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.912624 31588 leader_election.cc:304] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.913903 31588 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:35.852451  2932 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:35.928262 30867 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 85101.7us
I20260709 12:25:35.931135  2663 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:35.931613  2663 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:35.932030 31013 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:35.932441  2663 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:35.864953  2863 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:35.934026  2863 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.934412  2863 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.936482 30899 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:35.937170 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.937525 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.938220 30897 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 14: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:35.940270 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4045483bdd0047e8a04aade3faadf9d6" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:35.941098 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:35.942313 31016 leader_election.cc:304] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:35.938095 30895 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:35.865188  2796 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:35.890281  2675 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:35.963378 30867 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:35.966820 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:35.946456 30901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.943671  2962 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.945012  2964 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:35.970240 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 134395us
I20260709 12:25:35.970639 30939 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:35.973961 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:35.918414  2917 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.944005  2912 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:35.973397  2675 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.990283  2912 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.990711  2912 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.002599 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:35.890888  2882 raft_consensus.cc:2749] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.979898 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c16ae54ff14e49b6877d162ad00f3ac4" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
W20260709 12:25:35.962953  2978 log.cc:927] Time spent T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:25:36.019215 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 341439us
W20260709 12:25:35.967926  2981 log.cc:927] Time spent T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:35.984263  2848 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:35.983773 31621 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:35.976656  2970 raft_consensus.cc:2804] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:36.008358 30898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:36.031108 30898 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:36.010272 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:36.032078 31047 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:36.012198 31049 raft_consensus.cc:1240] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.015473 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:35.943848  2894 raft_consensus.cc:2749] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:36.016088 30895 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.035669 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:36.017385 30865 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:35.983736  2900 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:36.023691 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:36.025563 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:36.027590 31616 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:36.013990  2941 raft_consensus.cc:2749] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.975586  2807 raft_consensus.cc:493] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:36.040340 30865 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:36.045846  2342 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:36.046222  2342 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:36.046566  2342 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:36.006096 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:36.052016 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:36.052762 31621 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 8: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:36.053929 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:36.054940  2433 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:36.055321  2433 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:25:36.055655  2433 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.055814 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:36.056584 31621 raft_consensus.cc:2393] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 13: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:36.058280  2778 consensus_queue.cc:1059] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:36.059875 31045 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 8.
I20260709 12:25:36.040967 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:36.033728  2848 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.068058 30895 raft_consensus.cc:2468] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:36.071141 31013 leader_election.cc:304] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:36.041710  2846 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.024564  2665 consensus_queue.cc:1059] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:25:36.087680  2665 raft_consensus.cc:3055] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.067337  2807 raft_consensus.cc:515] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.090025  2807 leader_election.cc:290] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.091948 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:36.088047  2665 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:36.096405  2665 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:36.097541  2665 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.082644  2848 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.108165  2897 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:36.108671 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26d779b278e4014b0368920ddf7529f" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:36.108788  2897 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.111393  2897 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.113405  2807 raft_consensus.cc:2804] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:36.113927  2807 raft_consensus.cc:697] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:35.979408  2796 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.042876  2970 raft_consensus.cc:697] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:36.117326 31014 leader_election.cc:304] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:36.099220  2342 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:36.084367  2917 raft_consensus.cc:3055] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:36.083470  2900 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:36.121683  2419 raft_consensus.cc:2749] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:36.159636  2433 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.160327  2970 consensus_queue.cc:237] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.161475  2675 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.162320  2433 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.163923 31043 raft_consensus.cc:1240] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 LEADER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:36.165196  2900 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.168897  2912 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.169953 31617 raft_consensus.cc:1240] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:25:36.170828  2912 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
I20260709 12:25:36.153056  2917 raft_consensus.cc:740] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:36.172035  2917 consensus_queue.cc:260] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.173264  2917 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:36.163579  2675 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.194669  2863 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.195133  2796 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.195928  2342 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.222169 30899 raft_consensus.cc:2368] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 13. Current term is 14.
I20260709 12:25:36.237793  2675 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.238387  2675 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.175335  2807 consensus_queue.cc:237] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.294160  2863 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.298352  2848 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.303944 30970 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:36.304296 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:36.307657 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:36.303813 30971 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 12:25:36.307958 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 252700us
I20260709 12:25:36.308617 30971 pending_rounds.cc:85] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 8
I20260709 12:25:36.308914 30971 pending_rounds.cc:107] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:36.309128 30971 raft_consensus.cc:2889] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:36.308593 31616 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.311604 30976 raft_consensus.cc:1240] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:36.313850 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:36.312824 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:36.314839  2779 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:25:36.303365  2882 consensus_queue.cc:1059] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:25:36.310199  2849 consensus_queue.cc:1059] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:25:36.325030  2849 raft_consensus.cc:3055] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:36.325384  2849 raft_consensus.cc:740] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:36.326120  2849 consensus_queue.cc:260] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.327203  2849 raft_consensus.cc:3060] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:36.311126  2348 consensus_queue.cc:1059] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:25:36.339591 31616 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 14.
I20260709 12:25:36.331702  2894 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:36.348500  1944 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:36.357066  2848 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.342770  2348 raft_consensus.cc:3055] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:36.357609  2894 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:36.370867 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 58130.8us
I20260709 12:25:36.372351 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:36.373099  2897 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.375252 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:36.378326 30967 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Rejecting Update request from peer 5e9d2b069edc4166802ee0456ebcb706 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.366413  2348 raft_consensus.cc:740] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:36.372211  2894 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.381965 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:36.380663 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:36.384423 30974 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.376211  2897 raft_consensus.cc:2749] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:36.385246 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:36.387349 30967 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:36.390106 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:36.391927 30972 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 13.
I20260709 12:25:36.394491  2867 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:36.394888  2867 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.395218  2867 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.380051  2675 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.399549 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:36.401232  2900 raft_consensus.cc:2749] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.402602 30939 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:36.404929  2932 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.406461  2900 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:36.407608  2900 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:36.408491  2900 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.414340 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:36.414629 30967 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.423321  2348 consensus_queue.cc:260] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.424862  2348 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.424957  2863 consensus_queue.cc:1059] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:36.425891  2863 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.426218  2863 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
W20260709 12:25:36.426901  2675 consensus_queue.cc:1175] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f868402d5ae640e7b362b9fddacbaf44" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 8 } }
W20260709 12:25:36.427882 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 207919us
I20260709 12:25:36.436400 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:36.441826  2779 raft_consensus.cc:3055] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.442231  2779 raft_consensus.cc:740] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:36.442998  2779 consensus_queue.cc:260] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.448560 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:36.449273 31045 raft_consensus.cc:2393] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 13: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:36.452207 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:36.452785 31046 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.451649 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:36.454545 31044 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:36.454820 31051 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:36.458926 31051 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:36.447937 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:36.460996 31616 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:36.426898  2863 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:36.465651 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:36.466331 30895 raft_consensus.cc:2368] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
I20260709 12:25:36.466850  2863 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.466804  2867 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:36.469220  2867 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.472294 30867 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:36.473482 30899 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:36.474924 30974 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 14.
I20260709 12:25:36.481842 31046 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 10.
W20260709 12:25:36.498754 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 96205.9us
I20260709 12:25:36.405834 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:36.506484 30939 leader_election.cc:400] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 13. Current term is 14.
I20260709 12:25:36.506904 30939 leader_election.cc:403] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:36.509203 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:36.509971 30895 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:36.510582 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 104816us
I20260709 12:25:36.514636 30865 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:36.492584  2846 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:36.526525 30942 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:36.521201 30895 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 14.
I20260709 12:25:36.525323 31013 leader_election.cc:400] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
I20260709 12:25:36.532505 31013 leader_election.cc:403] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:36.510964  2867 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 for earlier term 13. Current term is 14.
I20260709 12:25:36.531802  2934 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:25:36.498947  2433 consensus_queue.cc:1059] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:25:36.509279  2897 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:25:36.515192  3003 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:36.541075 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:36.545053 30939 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:36.538282  2860 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:25:36.515703  2778 consensus_queue.cc:1059] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:36.549471  2778 consensus_queue.cc:1243] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer f868402d5ae640e7b362b9fddacbaf44 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:36.551668 30865 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:36.533187  2950 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:36.551693  2847 raft_consensus.cc:2764] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:25:36.555485 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:36.556082 30894 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:36.554510 30864 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:36.554915 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:36.561785 30895 raft_consensus.cc:1275] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:36.532923  2891 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:25:36.567382 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:36.568265 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:36.569373 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:36.569924 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:36.570348 31048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ebc983d26c40eda93f030abf94ac78" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:36.575874  2833 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:36.562625  2419 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249) with higher term. Message: Invalid argument: T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
I20260709 12:25:36.579883  2415 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:36.562934  2954 raft_consensus.cc:2804] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:36.563200  2894 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.545094  3003 raft_consensus.cc:493] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:36.583176  2781 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:36.585433  2846 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:36.591665 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:36.592484 31587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.594367 31048 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.595465 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251fc9e7cd1b4a0a83ccb0059840fc8b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:36.600251 31049 raft_consensus.cc:3060] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.597313 31616 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.585999  2848 raft_consensus.cc:2749] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:36.602919 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:36.612287 31623 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:36.617188 31622 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:36.616976 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:36.598359  2781 consensus_queue.cc:1243] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer f868402d5ae640e7b362b9fddacbaf44 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:36.607821  2912 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.595628  3003 raft_consensus.cc:3060] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.600271  2342 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.616043  2867 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.624361  2954 raft_consensus.cc:697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 14 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:36.653203 30900 raft_consensus.cc:1240] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.625102  3001 consensus_queue.cc:1048] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:25:36.627790  2830 consensus_queue.cc:1059] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 12:25:36.672969 30865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 65015.1us
W20260709 12:25:36.673518 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 78843us
I20260709 12:25:36.627743  2882 consensus_queue.cc:1059] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:25:36.675065 30864 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
W20260709 12:25:36.677420 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 60507.7us
I20260709 12:25:36.678251 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:36.661697  2778 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:36.685213  2897 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.685631  2897 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:36.686414  2897 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.426585 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.655177  2912 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:36.682359  3012 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:36.657316  2846 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.692752 30896 raft_consensus.cc:2410] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:36.687533  2897 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.694821 31049 raft_consensus.cc:2468] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 14.
I20260709 12:25:36.704572  2778 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.696403  2779 raft_consensus.cc:3060] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.739784  2833 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:36.696390  2419 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:25:36.705190  3016 raft_consensus.cc:3055] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:36.750061  3016 raft_consensus.cc:740] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:36.751016  3016 consensus_queue.cc:260] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.747476 31616 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:36.753259  3016 raft_consensus.cc:3060] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.708149  2954 consensus_queue.cc:237] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:36.752169  2917 raft_consensus.cc:3055] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:36.756453  2917 raft_consensus.cc:740] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:36.757313  2917 consensus_queue.cc:260] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.758575  3013 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:36.740833  3018 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:36.758600  2917 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:36.810945 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 132760us
W20260709 12:25:36.809074  3017 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:25:36.828500  3022 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.810088  2894 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.809022  3018 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:36.769618  2833 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.770455  3003 raft_consensus.cc:515] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.857986  2912 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.860401  3014 raft_consensus.cc:3055] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.860831  3014 raft_consensus.cc:740] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:36.853965  3022 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.861605  3014 consensus_queue.cc:260] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.862741  3014 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.862903  3022 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:36.864355  2833 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.869189  3018 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:36.899314 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 127162us
I20260709 12:25:36.909094 31617 raft_consensus.cc:2410] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e9d2b069edc4166802ee0456ebcb706 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:36.926854 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:36.928215 31615 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:36.941037  3003 leader_election.cc:290] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:36.946766  2807 raft_consensus.cc:493] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:36.947819  2807 raft_consensus.cc:515] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:36.950800  2807 leader_election.cc:290] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:36.963112 31016 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:36.977887  2964 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:36.978434  2964 raft_consensus.cc:493] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:36.978854  2964 raft_consensus.cc:3060] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:36.986124 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:36.987317 30896 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 12: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:36.987795 30897 raft_consensus.cc:1275] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:25:36.989078 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 152065us
W20260709 12:25:37.010842  3029 log.cc:927] Time spent T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.170s	user 0.000s	sys 0.004s
I20260709 12:25:37.012176 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:37.014143 31014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.020810 30895 raft_consensus.cc:1275] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:37.024253 31618 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:37.028626  2451 consensus_queue.cc:1048] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:37.061920 30971 raft_consensus.cc:1275] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:25:37.097605 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 102888us
W20260709 12:25:37.095973  3031 log.cc:927] Time spent T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.250s	user 0.004s	sys 0.010s
I20260709 12:25:37.102852 30794 catalog_manager.cc:5697] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 5 to 6, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 6 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:37.125192  3026 log.cc:927] Time spent T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.077s	user 0.007s	sys 0.014s
I20260709 12:25:37.139928  2491 consensus_queue.cc:1048] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:25:37.143486 31043 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:37.145885  2749 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.146586  2749 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.157248  2887 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.157979  2887 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:37.163331  3013 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:25:37.172180 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:37.172648 30974 raft_consensus.cc:1275] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:37.175175 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.177523 30974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e712edd3ac45e9b088a4dbd226c616" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.177729 30972 pending_rounds.cc:85] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 7
I20260709 12:25:37.178762 30972 pending_rounds.cc:107] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:25:37.179066 30972 raft_consensus.cc:2889] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:37.233872 30794 catalog_manager.cc:5697] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 7 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:37.234889 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.240940 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:37.241986 30900 raft_consensus.cc:2393] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 14: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:37.242620 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:37.240834  2887 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:37.248953 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:37.249958 31046 raft_consensus.cc:2393] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 10: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:37.252554  2749 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:37.255403  3025 log.cc:927] Time spent T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.356s	user 0.000s	sys 0.014s
I20260709 12:25:37.259793  2836 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:37.260592  2836 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.263553  2836 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.269048  2491 consensus_queue.cc:1048] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:37.271291 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:37.271833 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:37.272480 31046 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 8.
W20260709 12:25:37.272603 30795 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53550 (request call id 397) took 25381 ms (client timeout 15000 ms). Trace:
I20260709 12:25:37.277395 31616 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:25:37.277832 31616 pending_rounds.cc:85] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Aborting all ops after (but not including) 7
I20260709 12:25:37.278086 31616 pending_rounds.cc:107] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:25:37.278322 31616 raft_consensus.cc:2889] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:37.283048  2964 raft_consensus.cc:515] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.239020 30794 catalog_manager.cc:5697] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 8, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:37.264194 31049 raft_consensus.cc:1240] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Rejecting Update request from peer 9f38f761eded4f28b9d802f6570ee71e for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:37.286291  2884 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.289320 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a99465fc591541cf808078e4fb820f06" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:37.268034  2836 raft_consensus.cc:493] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
W20260709 12:25:37.274783 30795 rpcz_store.cc:269] 0709 12:25:11.967102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.973523 (+  6421us) service_pool.cc:224] Handling call
0709 12:25:37.270665 (+25297142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:34.026330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:34.083711 (+ 57381us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:34.083772 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:25:34.083789 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:34.084723 (+   934us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:34.084777 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:34.084807 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:25:34.085550 (+   743us) tablet.cc:701] Row locks acquired
0709 12:25:34.085563 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:25:34.085706 (+   143us) write_op.cc:270] Start()
0709 12:25:34.085815 (+   109us) write_op.cc:276] Timestamp: P: 1783599934085663 usec, L: 0
0709 12:25:34.085834 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:34.142006 (+ 56172us) log.cc:844] Serialized 3924 byte log entry
0709 12:25:34.663809 (+521803us) op_driver.cc:464] REPLICATION: finished
0709 12:25:35.106834 (+443025us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b18002d1360. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d5403f3 00007f032d5427c1 00007f032d542779 00007f032d542709 00007f032d5426d1 00007f032d5419cd 0000000000388634 0000000000388479 00007f032d52383a
0709 12:25:35.106982 (+   148us) write_op.cc:301] APPLY: starting
0709 12:25:35.107055 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:35.213478 (+106423us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:35.227558 (+ 14080us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:35.502484 (+274926us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:35.502731 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:25:35.502772 (+    41us) write_op.cc:312] APPLY: finished
0709 12:25:35.504360 (+  1588us) log.cc:844] Serialized 97 byte log entry
0709 12:25:35.513426 (+  9066us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:35.541419 (+ 27993us) write_op.cc:454] Released schema lock
0709 12:25:35.544143 (+  2724us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:35.552267 (+  8124us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:35.552306 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201738,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":140158,"apply.run_cpu_time_us":17527,"apply.run_wall_time_us":444781,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45807,"num_ops":10,"prepare.queue_time_us":377163,"prepare.run_cpu_time_us":18711,"prepare.run_wall_time_us":205491,"raft.queue_time_us":142535,"raft.run_cpu_time_us":39076,"raft.run_wall_time_us":178535,"replication_time_us":558501,"spinlock_wait_cycles":15892864,"thread_start_us":389416,"threads_started":4,"wal-append.queue_time_us":87857,"wal-append.run_cpu_time_us":16814,"wal-append.run_wall_time_us":2248979}]]}
I20260709 12:25:37.310719  2952 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:37.311287 31621 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:37.317798 31044 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 14.
W20260709 12:25:37.318658  3040 log.cc:927] Time spent T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:25:37.323956  2884 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.328568 31621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.271310  2491 consensus_queue.cc:1048] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:37.311424  2952 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.332688  2952 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.333611 30976 raft_consensus.cc:2468] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 14.
I20260709 12:25:37.314028 30794 catalog_manager.cc:5697] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.342088 31051 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:25:37.342690 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 45875.1us
I20260709 12:25:37.346364  2847 raft_consensus.cc:493] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.348695  2675 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:37.342171 30794 catalog_manager.cc:5697] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:37.352991  2847 raft_consensus.cc:515] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.354213 30794 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:37.358911  2917 consensus_meta.cc:287] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.010s
I20260709 12:25:37.358525 30794 catalog_manager.cc:5697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 8 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:37.366772 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:37.365780 31014 leader_election.cc:304] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.371491 30895 raft_consensus.cc:2393] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 12: Already voted for candidate 5e9d2b069edc4166802ee0456ebcb706 in this term.
I20260709 12:25:37.355427  2847 leader_election.cc:290] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.376188 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.369172  2491 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:37.381373  2491 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:37.383414  2491 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:37.385478  2884 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.370509 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.368624 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:37.394591  2796 raft_consensus.cc:2749] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.353048  2964 leader_election.cc:290] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.412386 30794 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:37.417215 30794 catalog_manager.cc:5697] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 9 to 11, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 11 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:37.420957 31014 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.427590 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.431423 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.452312 31616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b078c36427749489d90f67c6504ea82" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:37.429003  2964 raft_consensus.cc:2749] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.366639  2836 raft_consensus.cc:515] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.455547 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:37.462194 31046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:37.436146  2796 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.466545 30794 catalog_manager.cc:5697] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 5 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 9 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:37.459465 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:37.478253 30975 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:37.482033 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:37.483171  2846 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:37.485057 30969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.472198 30794 catalog_manager.cc:5697] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.489703 31587 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.490705 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.492477 31622 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:37.458860  2887 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:37.493981 31013 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.494997  2833 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.492419 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.503940 31615 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 9.
I20260709 12:25:37.476471  2796 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.506454  2796 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.507064 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.507251 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2426f61afbf24698969bfa651d747ae9" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.508965  2836 leader_election.cc:290] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.509693 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:37.513041 31047 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:37.487521 30794 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 4 to 7, term changed from 5 to 7, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 7 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:37.521242 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:37.521673 31622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f278da50d600410dbed3af60b0147046" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.528939 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.529599 31623 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:37.544060  3043 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:37.544852  3043 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.547197  3043 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.549808 30794 catalog_manager.cc:5697] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 7 to 10, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 10 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:37.563025 30794 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 6 to 9, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 9 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.568360 30794 catalog_manager.cc:5697] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 11 to 12, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 12 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.571324 30794 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 7 to 12, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 12 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:37.575789 31051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:37.536217  2917 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.586804 31047 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:37.587654  3038 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:25:37.592371 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 102815us
I20260709 12:25:37.594712 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.596457  2779 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:37.605801 30794 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 7 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 9 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:37.608367 31016 leader_election.cc:304] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:37.609304  2796 raft_consensus.cc:2749] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.609494 31016 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.584733  2887 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:37.610842  2964 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:37.612080  2964 raft_consensus.cc:493] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.612432  2964 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:37.607496 30794 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:37.629166 31621 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:37.588213  3038 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.636209  2847 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:37.638971 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:37.640513 30864 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:37.641142 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 46548.7us
I20260709 12:25:37.642302  2934 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:37.643394  2934 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:37.644032  3046 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:37.646152 30942 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:37.647475  2749 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:37.649756  2891 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:37.653712 30942 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:37.658219  2964 raft_consensus.cc:515] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.660288  2867 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.660742  2867 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.661101  2867 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.664235  3038 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:37.646086  3043 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:25:37.672915  2941 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:37.683619 30896 raft_consensus.cc:1275] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:37.684605 30865 leader_election.cc:304] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.686062 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.688259 30896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:37.688971 30896 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:37.693802 31616 raft_consensus.cc:2468] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:37.695062 31016 leader_election.cc:304] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:37.696177  2451 raft_consensus.cc:2804] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:37.696673  2451 raft_consensus.cc:697] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:37.697676  2451 consensus_queue.cc:237] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.700259  2867 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.709033 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:37.713621 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:37.717759 31046 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:37.708846  2934 raft_consensus.cc:2749] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:37.727895  2847 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.733306  2847 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:37.736021  2954 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.736634  2954 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:37.736694  2900 consensus_queue.cc:1048] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:25:37.737073  2954 raft_consensus.cc:3060] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.736091 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.745303  2964 leader_election.cc:290] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.746366  2779 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:37.746773  2779 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.747112  2779 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.748634 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:37.751614 31587 leader_election.cc:304] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:37.751854  2867 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:37.752666  3034 raft_consensus.cc:2804] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:37.753509 31042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:37.754134 31042 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:37.755483  3034 raft_consensus.cc:697] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 14 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:37.756593  3034 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.758002 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:37.758740 31615 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:37.761561 30864 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:37.763216  2348 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:37.763569  2348 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.763921  2348 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:37.769325 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:37.769954 30968 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 11.
I20260709 12:25:37.771153  2900 consensus_queue.cc:1059] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:37.771916  2867 raft_consensus.cc:3055] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:37.772275  2867 raft_consensus.cc:740] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:37.773141  2867 consensus_queue.cc:260] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.774682  2867 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:37.782454 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a0dad5f8a44e9b54943368c8d3758" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:37.783062 31615 raft_consensus.cc:3060] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:37.735563  2847 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:37.795161 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:37.802462 31623 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.806864 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ba14cb7054588ae9fdcdedf04b081" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:37.825098 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:37.859704  3038 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.884922  2779 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:37.887102  2779 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:37.899976 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 80882.8us
I20260709 12:25:37.901722 31587 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:37.900146 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:37.894683  2348 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:37.983752 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 49229us
I20260709 12:25:37.988919 31620 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:25:37.991932  3049 log.cc:927] Time spent T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:25:37.998451  3061 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:25:38.017907  3067 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:38.030977 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 45414.2us
W20260709 12:25:38.031831  3060 log.cc:927] Time spent T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.134s	user 0.000s	sys 0.005s
I20260709 12:25:38.039878  2807 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:38.047276 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:38.047864 30968 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.048657  2348 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.047063  2807 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.055405  2807 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:38.058142  3014 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:38.058724  3014 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.060781  3014 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:38.064232 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:38.064823 31047 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.072541 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:38.073354 30897 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:38.078063 31013 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:38.078866  2836 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:38.079268  2836 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:38.079599  2836 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.080936 31615 raft_consensus.cc:2468] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:38.082523 31623 raft_consensus.cc:2468] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:38.083272 31622 raft_consensus.cc:1240] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:38.084784 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:38.086879 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:38.089623 30973 raft_consensus.cc:2368] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
W20260709 12:25:38.090493 30939 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.106202 30968 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:38.108117 30967 raft_consensus.cc:2393] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 11: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:38.109503 30865 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:38.111989 31047 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:38.115302  2867 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.060633  2954 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.129508 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:38.133841 31014 leader_election.cc:400] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
I20260709 12:25:38.134214 31014 leader_election.cc:403] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:38.135016 31624 raft_consensus.cc:2368] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
I20260709 12:25:38.126596  2451 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:38.138370  2451 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.134786  2867 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:38.109598 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 207941us
I20260709 12:25:38.141538 31016 leader_election.cc:304] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:38.150511 31016 leader_election.cc:400] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869) with higher term. Message: Invalid argument: T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
I20260709 12:25:38.151208 30942 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:38.140713  2348 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:38.168309 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:38.156167  2796 raft_consensus.cc:2804] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:38.185381 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 45297.6us
I20260709 12:25:38.186021  3045 consensus_queue.cc:1059] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:38.180235  2348 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:38.204483  2348 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:38.209959 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 58848.8us
I20260709 12:25:38.197999  2891 raft_consensus.cc:2804] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.195370  2796 raft_consensus.cc:697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:38.232594  2891 raft_consensus.cc:697] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:38.252568 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.242389  2419 raft_consensus.cc:3060] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:25:38.259193  3070 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:25:38.260591  2796 consensus_queue.cc:237] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.261782 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
W20260709 12:25:38.262236  3071 log.cc:927] Time spent T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:38.316119  2891 consensus_queue.cc:237] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.270884  2954 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:38.334398 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:38.337519 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 90663.1us
I20260709 12:25:38.345098 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:38.331348  2451 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:38.357033 30967 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:38.370362  2887 raft_consensus.cc:3055] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:38.370858  2887 raft_consensus.cc:740] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:38.389637  2419 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 9. Current term is 10.
I20260709 12:25:38.396555  2867 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.399317  2887 consensus_queue.cc:260] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.405653  2887 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:38.409618  3083 log.cc:927] Time spent T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
I20260709 12:25:38.412494 30894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:38.413265 30894 raft_consensus.cc:606] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:38.413414  3068 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:38.414738 30894 raft_consensus.cc:614] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:38.414675  3070 log.cc:927] Time spent T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:38.432596 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:38.439888 30900 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:38.443070 31016 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:38.444903  2907 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.452113 31617 raft_consensus.cc:1275] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:38.453480  2419 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:38.455243 31049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:38.455888 31049 raft_consensus.cc:606] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:38.457252  3092 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.457784  3092 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.458344 30896 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:38.459816  3092 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.459883 30894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:38.460515 30894 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:38.468798  2836 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.469926 31047 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
I20260709 12:25:38.470636 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:38.473623 30897 raft_consensus.cc:2468] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:38.478246 31045 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:38.498092  3084 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.498603  3084 raft_consensus.cc:493] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.498924  3084 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.500613 30897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.506481  2836 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:38.518191 31615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f8452db3546feaba1bef22141480f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:38.518939 31615 raft_consensus.cc:2393] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 10: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:38.520408 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:38.522985 31620 raft_consensus.cc:1240] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Rejecting Update request from peer f868402d5ae640e7b362b9fddacbaf44 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:38.523123 30894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a99465fc591541cf808078e4fb820f06"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:38.523662 30894 raft_consensus.cc:606] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:38.524042 30894 raft_consensus.cc:614] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:38.536579 30971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:38.538990 30897 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:38.543298 30939 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:38.554418 31013 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:38.522104  2964 consensus_queue.cc:1048] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:38.540426  3092 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.556725  2941 raft_consensus.cc:2804] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.562898  2796 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:38.547044  3069 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:25:38.563403  2796 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:38.564772  3067 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:38.566694  3084 raft_consensus.cc:515] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.567795 30971 raft_consensus.cc:2368] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12.
I20260709 12:25:38.564476  2796 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.576489  2941 raft_consensus.cc:697] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:38.581660 31014 leader_election.cc:400] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Vote denied by peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975) with higher term. Message: Invalid argument: T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12.
I20260709 12:25:38.578392 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:38.583709 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:38.584263  2419 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.602094 30899 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:38.602444 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:38.602969 30895 raft_consensus.cc:606] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:38.605173  2419 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.608819 31049 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:38.609751  2419 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:38.620108 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea71eb6769834992980701da50fb499d"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:38.620757 30895 raft_consensus.cc:606] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:38.622550 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:38.624387 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:38.620985 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:38.627411 31617 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:38.609587  2941 consensus_queue.cc:237] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.636415 31016 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:38.651492  2964 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.655820 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:38.656550 30895 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:38.652566  2964 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.657927  2964 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.672456  3084 leader_election.cc:290] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.674407 30893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.674991 30893 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.678570 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7ff3f21bc8406f850dc7aa742d339b" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:38.682000  2781 raft_consensus.cc:993] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:38.682428  2781 raft_consensus.cc:1081] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:38.683496  3095 raft_consensus.cc:993] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:38.684130  3095 raft_consensus.cc:1081] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:38.685465 31617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44888
I20260709 12:25:38.685832 30967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:59150
I20260709 12:25:38.686074 31617 raft_consensus.cc:493] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.686384 30967 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.686440 31617 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.686908 30967 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.696421 30893 raft_consensus.cc:2468] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:38.697131 30967 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.697546 30939 leader_election.cc:304] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587
I20260709 12:25:38.704101  2887 raft_consensus.cc:2804] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:38.704612  2887 raft_consensus.cc:697] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:38.704838 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.717370 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.717983 30899 raft_consensus.cc:3055] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:38.718250 30899 raft_consensus.cc:740] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:38.719072 30967 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.718993 30899 consensus_queue.cc:260] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.721110 30899 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.721201  2887 consensus_queue.cc:237] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.729005 30967 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:38.730326  3095 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:38.732017 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33f71fccef4bc399b382d9c520fc89" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:38.733170 31044 raft_consensus.cc:3060] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.735253 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:38.736478  3034 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.736912  3034 raft_consensus.cc:493] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.737314  3034 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.736336  2964 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.743360 31617 raft_consensus.cc:515] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.745262 31617 leader_election.cc:290] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.750738 31044 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:38.755466 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:38.756963 31044 raft_consensus.cc:3055] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:38.757614 31044 raft_consensus.cc:740] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:38.761669 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 45491.4us
I20260709 12:25:38.765480 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:38.766193 30939 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:38.784511 30899 raft_consensus.cc:2468] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:38.786384 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.786983 30895 raft_consensus.cc:3060] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.787650 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ffaf8ce697442c8bbb38cea5ba4136" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.770911  2964 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:38.801219 31044 consensus_queue.cc:260] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.805289 30900 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.810227 31044 raft_consensus.cc:3060] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.823839  2941 raft_consensus.cc:2804] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.824493  2941 raft_consensus.cc:697] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:38.825441  2941 consensus_queue.cc:237] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.843760 30895 raft_consensus.cc:2468] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 12.
I20260709 12:25:38.846040 30900 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:38.847479 31587 leader_election.cc:304] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:38.846553 31044 raft_consensus.cc:2468] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
W20260709 12:25:38.860982 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 64403.5us
I20260709 12:25:38.861936 31044 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:38.861001  3003 raft_consensus.cc:2804] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:38.887372 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 98901.1us
I20260709 12:25:38.892263 31044 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:38.894624 31013 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706; no voters: 
I20260709 12:25:38.888382  3074 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:25:38.895288  3003 raft_consensus.cc:697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:38.905336  3003 consensus_queue.cc:237] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.908002  2964 raft_consensus.cc:2804] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:38.908537  2964 raft_consensus.cc:697] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:38.908481  2954 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:38.909548  2964 consensus_queue.cc:237] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.914183  2865 raft_consensus.cc:993] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:38.914709  3094 raft_consensus.cc:1081] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:38.891193  3034 raft_consensus.cc:515] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:38.916484  3034 leader_election.cc:290] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.917204 31619 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 12: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:38.923678 30976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea71eb6769834992980701da50fb499d"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:59150
I20260709 12:25:38.924311 30976 raft_consensus.cc:493] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.925431 30976 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.927417 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.928165 30899 raft_consensus.cc:2393] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 12: Already voted for candidate 1a7b44e2d0ed440985e5f643a5a54587 in this term.
I20260709 12:25:38.936172 31620 raft_consensus.cc:1275] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:38.939390  2867 consensus_queue.cc:1048] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:38.944692 30976 raft_consensus.cc:515] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.946636 30976 leader_election.cc:290] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:38.948488 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62100297c3841e0914543cebffb2ce0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:38.949425 31049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:38.949748 31587 leader_election.cc:304] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:38.949970 31049 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.953121 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea71eb6769834992980701da50fb499d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:38.953631 30895 raft_consensus.cc:3055] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:38.953898 30895 raft_consensus.cc:740] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:38.954556 30895 consensus_queue.cc:260] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.956130  3034 raft_consensus.cc:2749] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.955685 30895 raft_consensus.cc:3060] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.968866 31049 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:38.972545 30939 leader_election.cc:304] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:38.973352  2887 raft_consensus.cc:2804] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.974979  2887 raft_consensus.cc:697] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:38.976020  2887 consensus_queue.cc:237] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:38.979645 30973 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:25:38.980509 30973 pending_rounds.cc:85] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Aborting all ops after (but not including) 7
I20260709 12:25:38.980754 30973 pending_rounds.cc:107] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:25:38.981029 30973 raft_consensus.cc:2889] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:38.982659 30895 raft_consensus.cc:2468] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:39.023782 30973 raft_consensus.cc:1240] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Rejecting Update request from peer 1a7b44e2d0ed440985e5f643a5a54587 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:39.032651  2796 consensus_queue.cc:1059] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:39.034072  2796 consensus_queue.cc:1243] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Peer f868402d5ae640e7b362b9fddacbaf44 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:39.034578  2796 raft_consensus.cc:3055] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:39.034858  2796 raft_consensus.cc:740] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:39.020722  3013 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:25:39.061414 31619 raft_consensus.cc:1275] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:39.035597  2796 consensus_queue.cc:260] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:39.065821  2796 raft_consensus.cc:3060] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:39.085865  2491 consensus_queue.cc:1048] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:39.095181 30895 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:39.101109  2952 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:39.143657 31623 raft_consensus.cc:1275] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:39.146929  2941 consensus_queue.cc:1048] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:39.186717 30796 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.188882 30796 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 10, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 10 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.219646 30796 catalog_manager.cc:5697] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.221164 30796 catalog_manager.cc:5697] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 9, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 9 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.228856 30900 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:39.232080 31044 raft_consensus.cc:1275] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:25:39.232483 31044 pending_rounds.cc:85] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Aborting all ops after (but not including) 7
I20260709 12:25:39.232685 31044 pending_rounds.cc:107] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:25:39.232897 31044 raft_consensus.cc:2889] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:39.238698  2941 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:39.239602  3084 consensus_queue.cc:1048] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:39.241627 30900 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:39.243021  2954 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:39.249344 30796 catalog_manager.cc:5697] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.251340 30796 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 8, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 8 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.253271 30796 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 10, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 10 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.267628 30796 catalog_manager.cc:5697] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 11, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 11 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.270357 30796 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 9 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.273594 30796 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 8, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 8 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.275840 30796 catalog_manager.cc:5697] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 11, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.277438 30796 catalog_manager.cc:5697] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 8, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 8 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.293957 30796 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 10 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.303900 30900 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:39.307195 30794 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53558 (request call id 357) took 8173 ms. Trace:
I20260709 12:25:39.308924  3092 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:39.318099 31047 raft_consensus.cc:1275] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:39.326663  2941 consensus_queue.cc:1048] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:39.334692 30796 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.336329 30796 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 13, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 13 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.343237 30796 catalog_manager.cc:5697] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 5 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.310427 30794 rpcz_store.cc:276] 0709 12:25:31.131267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.145555 (+ 14288us) service_pool.cc:224] Handling call
0709 12:25:39.304018 (+8158463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:38.024325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:38.025018 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:38.025073 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:25:38.025093 (+    20us) tablet.cc:662] Decoding operations
0709 12:25:38.056779 (+ 31686us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:38.056879 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:38.056910 (+    31us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:25:38.058257 (+  1347us) tablet.cc:701] Row locks acquired
0709 12:25:38.058306 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:25:38.058474 (+   168us) write_op.cc:270] Start()
0709 12:25:38.058614 (+   140us) write_op.cc:276] Timestamp: P: 1783599938058401 usec, L: 0
0709 12:25:38.058659 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:25:38.059373 (+   714us) log.cc:844] Serialized 6982 byte log entry
0709 12:25:38.615084 (+555711us) op_driver.cc:464] REPLICATION: finished
0709 12:25:38.648497 (+ 33413us) write_op.cc:301] APPLY: starting
0709 12:25:38.648595 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:38.684840 (+ 36245us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:38.684954 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:38.806504 (+121550us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b540021d9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330596571 00007f033062a32a 00007f03305aff14 00007f03305afec3 00007f03305afe38 00007f03305afdf3 00007f03305af0dc 00007f03305d8e16 00007f03305c0cbb 00007f03305ab39d 00007f03305aed75
0709 12:25:38.865378 (+ 58874us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:38.865739 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:25:38.865798 (+    59us) write_op.cc:312] APPLY: finished
0709 12:25:38.866232 (+   434us) log.cc:844] Serialized 164 byte log entry
0709 12:25:38.868361 (+  2129us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:38.868549 (+   188us) write_op.cc:454] Released schema lock
0709 12:25:38.868633 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:38.869115 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:38.869142 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1012470,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":33083,"apply.run_cpu_time_us":23126,"apply.run_wall_time_us":220604,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79151,"num_ops":18,"prepare.queue_time_us":181519,"prepare.run_cpu_time_us":41412,"prepare.run_wall_time_us":269704,"raft.queue_time_us":175208,"raft.run_cpu_time_us":16443,"raft.run_wall_time_us":218865,"replication_time_us":542646,"spinlock_wait_cycles":5488000,"thread_start_us":454153,"threads_started":4,"wal-append.queue_time_us":264331}]]}
I20260709 12:25:39.346354 30796 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.359298 30796 catalog_manager.cc:5697] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 9 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:39.400878 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 44220.8us
I20260709 12:25:39.564692 30796 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 12, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 12 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.566349 30796 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:39.601344 31619 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:39.602787  2796 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:39.608108  2796 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:39.608599  2796 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:39.610846  2796 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:39.613713 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:39.614472 31623 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:39.567698 30796 catalog_manager.cc:5697] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 9 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:39.570748 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 211635us
I20260709 12:25:39.657197 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f02e5ab61a44506bdae958f8a275d96 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46754
I20260709 12:25:39.659512 30900 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:25:39.693742 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 44865.1us
I20260709 12:25:39.700598 31044 raft_consensus.cc:1275] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:39.708577 30895 raft_consensus.cc:1275] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:39.709930 30967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:39.710562 30967 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:39.714710  2887 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:25:39.716445  3133 tablet_replica.cc:333] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:39.717454  3133 raft_consensus.cc:2243] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.717720 31045 raft_consensus.cc:1275] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:39.729317  3133 raft_consensus.cc:2272] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.741247  3133 ts_tablet_manager.cc:1916] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:39.778388 31014 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:39.779500  3127 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:39.779954  3127 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:25:39.780316  3127 raft_consensus.cc:3060] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:39.783967 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 62806.9us
I20260709 12:25:39.787568  3128 consensus_queue.cc:1048] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:39.790165  3132 consensus_queue.cc:1048] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:39.793434  3127 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:39.817672  3133 ts_tablet_manager.cc:1929] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:25:39.820252  3133 log.cc:1199] T 8f02e5ab61a44506bdae958f8a275d96 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/8f02e5ab61a44506bdae958f8a275d96
I20260709 12:25:39.822921 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 8f02e5ab61a44506bdae958f8a275d96 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:25:39.841653 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:39.842605 31619 raft_consensus.cc:2393] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a7b44e2d0ed440985e5f643a5a54587 in current term 9: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
W20260709 12:25:39.837548 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 169758us
I20260709 12:25:39.843874  3127 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:39.844662 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:39.854892 30973 raft_consensus.cc:2468] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:39.886725 31014 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:39.888763  2491 raft_consensus.cc:2804] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:39.895323  2491 raft_consensus.cc:697] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:39.897208  2491 consensus_queue.cc:237] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:39.910249  2917 consensus_queue.cc:1048] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:40.124938 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.232796 30799 catalog_manager.cc:5697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 6 to 8, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 8 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.238540 31619 consensus_queue.cc:237] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:40.242996 30799 catalog_manager.cc:5697] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 4 to 6, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 6 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.259665 31620 consensus_queue.cc:237] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:40.286126 30796 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48640 (request call id 263) took 4400 ms. Trace:
W20260709 12:25:40.290958 30864 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 44027us
W20260709 12:25:40.296182 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 53410.1us
I20260709 12:25:40.280263  3139 raft_consensus.cc:493] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.288836 30796 rpcz_store.cc:276] 0709 12:25:35.876587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.876765 (+   178us) service_pool.cc:224] Handling call
0709 12:25:40.276851 (+4400086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:39.833971 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:39.834531 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:39.834759 (+   228us) write_op.cc:435] Acquired schema lock
0709 12:25:39.834782 (+    23us) tablet.cc:662] Decoding operations
0709 12:25:39.893390 (+ 58608us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:39.893475 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:39.893509 (+    34us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:25:39.894888 (+  1379us) tablet.cc:701] Row locks acquired
0709 12:25:39.894906 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:25:39.895041 (+   135us) write_op.cc:270] Start()
0709 12:25:39.895152 (+   111us) write_op.cc:276] Timestamp: P: 1783599939894993 usec, L: 0
0709 12:25:39.895170 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:25:39.917601 (+ 22431us) log.cc:844] Serialized 8128 byte log entry
0709 12:25:39.980623 (+ 63022us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18000cd2a0. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0336408ab1 00007f0336415281 00007f032d522e07 00007f033637d9a9 00007f032d53f69b 00007f032d53d93f 00007f032d53d455 00007f03305aa190 00007f03305a3ae7 00007f03305a2dd9 00007f03305ad930
0709 12:25:39.992799 (+ 12176us) op_driver.cc:464] REPLICATION: finished
0709 12:25:40.009532 (+ 16733us) write_op.cc:301] APPLY: starting
0709 12:25:40.009611 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:40.044696 (+ 35085us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:40.044722 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:40.097808 (+ 53086us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:40.098111 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:25:40.098156 (+    45us) write_op.cc:312] APPLY: finished
0709 12:25:40.098532 (+   376us) log.cc:844] Serialized 188 byte log entry
0709 12:25:40.098692 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:40.098863 (+   171us) write_op.cc:454] Released schema lock
0709 12:25:40.098920 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:40.109587 (+ 10667us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:40.109620 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":806787,"reported_tablets":40,"spinlock_wait_cycles":286976,"child_traces":[["op",{"apply.queue_time_us":16493,"apply.run_cpu_time_us":23764,"apply.run_wall_time_us":100025,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91655,"num_ops":21,"prepare.queue_time_us":97525,"prepare.run_cpu_time_us":9662,"prepare.run_wall_time_us":126032,"raft.queue_time_us":25946,"raft.run_cpu_time_us":1214,"raft.run_wall_time_us":38178,"replication_time_us":97458,"spinlock_wait_cycles":28825472,"thread_start_us":173360,"threads_started":4,"wal-append.queue_time_us":43437}]]}
I20260709 12:25:40.309098  3139 raft_consensus.cc:515] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:40.329257  3139 leader_election.cc:290] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:40.331135 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:40.332031 30973 raft_consensus.cc:2410] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:40.347018 30895 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:40.350080 30973 raft_consensus.cc:1275] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:40.369287 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:40.370010 30895 raft_consensus.cc:606] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:40.370332 30895 raft_consensus.cc:614] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:40.359076  3072 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:40.401363  3067 consensus_queue.cc:1048] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:40.407469 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bf1075e43344e4c85d09b6aeac40c55"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:40.408155 30895 raft_consensus.cc:606] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:40.408537 30895 raft_consensus.cc:614] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:40.420886 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c42f8452db3546feaba1bef22141480f"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:40.421422 30895 raft_consensus.cc:606] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:40.421733 30895 raft_consensus.cc:614] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:40.426909 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:40.427994 30895 raft_consensus.cc:606] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:40.429401 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:40.431001 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.431780 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.439265 30967 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:40.448261  3127 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:40.470837 31617 raft_consensus.cc:1275] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:40.483331  3128 consensus_queue.cc:1048] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:40.491513 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 187495us
I20260709 12:25:40.585331 30895 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:40.591856 30799 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53570 (request call id 374) took 17107 ms (client timeout 15000 ms). Trace:
I20260709 12:25:40.614231 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2b6ed092748a1a4b34148ab6d2923" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:40.589330  2917 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:25:40.632388 31587 leader_election.cc:304] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:40.635587  3164 raft_consensus.cc:2749] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.638963 30798 catalog_manager.cc:5697] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 9 to 10, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 10 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.641327 30798 catalog_manager.cc:5697] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 6 to 13, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 13 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.644065  3164 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:40.643042 30798 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.654174 30798 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 8 to 14, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 14 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.651669 31045 raft_consensus.cc:1275] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:40.592304 30799 rpcz_store.cc:269] 0709 12:25:23.484836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.485110 (+   274us) service_pool.cc:224] Handling call
0709 12:25:40.591774 (+17106664us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:40.295429 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:40.305589 (+ 10160us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:40.307116 (+  1527us) write_op.cc:435] Acquired schema lock
0709 12:25:40.307134 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:40.307543 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:40.307601 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:40.307627 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:40.323557 (+ 15930us) tablet.cc:701] Row locks acquired
0709 12:25:40.323576 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:25:40.323758 (+   182us) write_op.cc:270] Start()
0709 12:25:40.323886 (+   128us) write_op.cc:276] Timestamp: P: 1783599940323694 usec, L: 0
0709 12:25:40.323905 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:40.324503 (+   598us) log.cc:844] Serialized 911 byte log entry
0709 12:25:40.358985 (+ 34482us) op_driver.cc:464] REPLICATION: finished
0709 12:25:40.371824 (+ 12839us) write_op.cc:301] APPLY: starting
0709 12:25:40.382331 (+ 10507us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:40.421109 (+ 38778us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:40.421208 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:40.422360 (+  1152us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:40.422549 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:25:40.422596 (+    47us) write_op.cc:312] APPLY: finished
0709 12:25:40.422794 (+   198us) log.cc:844] Serialized 33 byte log entry
0709 12:25:40.423568 (+   774us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:40.423661 (+    93us) write_op.cc:454] Released schema lock
0709 12:25:40.423703 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:40.424125 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:40.424152 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1034169,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":1165,"apply.run_cpu_time_us":4089,"apply.run_wall_time_us":56487,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8336,"num_ops":2,"prepare.queue_time_us":389,"prepare.run_cpu_time_us":2846,"prepare.run_wall_time_us":29356,"replication_time_us":20474}]]}
I20260709 12:25:40.676671 30900 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:40.680089  3067 consensus_queue.cc:1048] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:25:40.701330 30798 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 10 to 12, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 12 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.703085 30798 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 9 to 10, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:40.721726 30973 raft_consensus.cc:2955] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:40.722069 30798 catalog_manager.cc:5697] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 8 to 10, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 10 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.730217 30798 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 6 to 7, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 7 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:40.752959 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 64772.8us
I20260709 12:25:40.776317  3161 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:40.781687 30899 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:40.831925  3145 log.cc:927] Time spent T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:40.841329 30798 catalog_manager.cc:5697] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 8 to 10, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:40.918150 30786 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94b5c1c64c494cb59ba74a90317df87d with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:40.926632 30786 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c773fc74822844b7aec9509683eb266e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:41.012638  3129 raft_consensus.cc:993] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:41.013347  1944 raft_consensus.cc:1081] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:41.016119 30976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:59150
I20260709 12:25:41.016669 30976 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.017017 30976 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.063056 30976 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:41.093719 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 188657us
I20260709 12:25:41.095762 31047 raft_consensus.cc:2955] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 5 to 10, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.104691 30976 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:41.108108 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:41.108691 30899 raft_consensus.cc:3055] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.108975 30899 raft_consensus.cc:740] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:41.109652 30899 consensus_queue.cc:260] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:41.110775 30899 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.115517 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:41.116182 31620 raft_consensus.cc:3060] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.122236 30899 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:41.123520 30939 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:41.124284  3182 raft_consensus.cc:2804] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:41.124922  3182 raft_consensus.cc:697] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:41.127626  3182 consensus_queue.cc:237] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:41.122754 31620 raft_consensus.cc:2468] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 10.
I20260709 12:25:41.299973 30799 catalog_manager.cc:5697] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.301522 30799 catalog_manager.cc:5697] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.302810 30799 catalog_manager.cc:5697] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 10 to 12, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 12 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.304147 30799 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.305361 30799 catalog_manager.cc:5697] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 10, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 10 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.336697 30799 catalog_manager.cc:5697] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 12, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 12 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.338194 30799 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 11, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 11 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.339504 30799 catalog_manager.cc:5697] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 10, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.340797 30799 catalog_manager.cc:5697] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.361285 30799 catalog_manager.cc:5697] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 9, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 9 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.363085 30799 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.364396 30799 catalog_manager.cc:5697] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 9, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 9 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.381879 30798 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53550 (request call id 398) took 5537 ms. Trace:
I20260709 12:25:41.382704 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f02e5ab61a44506bdae958f8a275d96 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:46754
I20260709 12:25:41.382543 30799 catalog_manager.cc:5697] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.401701 30799 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.403023 30799 catalog_manager.cc:5697] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 3 to 7, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 8 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.406116 30799 catalog_manager.cc:5697] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 10 to 11, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.400481 30798 rpcz_store.cc:276] 0709 12:25:35.844714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.844931 (+   217us) service_pool.cc:224] Handling call
0709 12:25:36.178257 (+333326us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b54001d0510. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d5090b2 00007f0336482759 00007f033641aa76 00007f03363ebd58 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc
0709 12:25:41.381821 (+5203564us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:40.919515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:40.920049 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:40.920080 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:25:40.920098 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:40.920959 (+   861us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:40.921030 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:40.921057 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:25:40.921700 (+   643us) tablet.cc:701] Row locks acquired
0709 12:25:40.921720 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:25:40.921854 (+   134us) write_op.cc:270] Start()
0709 12:25:40.921962 (+   108us) write_op.cc:276] Timestamp: P: 1783599940921808 usec, L: 0
0709 12:25:40.921980 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:25:40.934251 (+ 12271us) log.cc:844] Serialized 3546 byte log entry
0709 12:25:41.113818 (+179567us) op_driver.cc:464] REPLICATION: finished
0709 12:25:41.142408 (+ 28590us) write_op.cc:301] APPLY: starting
0709 12:25:41.142495 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:41.209003 (+ 66508us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:41.209130 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:41.234771 (+ 25641us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:41.235026 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:25:41.235085 (+    59us) write_op.cc:312] APPLY: finished
0709 12:25:41.235397 (+   312us) log.cc:844] Serialized 89 byte log entry
0709 12:25:41.235593 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:41.263749 (+ 28156us) write_op.cc:454] Released schema lock
0709 12:25:41.263847 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:41.291975 (+ 28128us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:41.292006 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":475119,"reported_tablets":46,"spinlock_wait_cycles":3289856,"child_traces":[["op",{"apply.queue_time_us":28351,"apply.run_cpu_time_us":12143,"apply.run_wall_time_us":149553,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41639,"num_ops":9,"prepare.queue_time_us":21546,"prepare.run_cpu_time_us":3840,"prepare.run_wall_time_us":16889,"replication_time_us":191672,"spinlock_wait_cycles":81280,"thread_start_us":49366,"threads_started":2}]]}
I20260709 12:25:41.407421 30799 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 13 to 14, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 14 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.413625 30799 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 15, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 15 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.415053 30799 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.416220 30799 catalog_manager.cc:5697] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 11 to 12, leader changed from 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 12 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.417461 30799 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:41.431130  3153 raft_consensus.cc:493] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:41.431766  3153 raft_consensus.cc:515] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:41.434507  3153 leader_election.cc:290] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:41.434732 30899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:41.435055 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:41.437557 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773fc74822844b7aec9509683eb266e" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:41.439014 31016 leader_election.cc:304] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:41.440563  2491 raft_consensus.cc:2749] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:41.484601 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet 8f02e5ab61a44506bdae958f8a275d96 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:25:41.555182 30900 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:41.567557  3173 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:41.589915 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.643674 30794 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 8 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.645638 30794 catalog_manager.cc:5697] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 10 to 12, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 12 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:41.653162 30794 catalog_manager.cc:5697] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:41.654603 30794 catalog_manager.cc:5697] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 10 to 11, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.657702 30794 catalog_manager.cc:5697] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.660085 30794 catalog_manager.cc:5697] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 11 to 14, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 14 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } }
I20260709 12:25:41.662539  3173 raft_consensus.cc:493] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9f38f761eded4f28b9d802f6570ee71e)
I20260709 12:25:41.663339 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet c773fc74822844b7aec9509683eb266e with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46178
I20260709 12:25:41.663154  3173 raft_consensus.cc:515] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } attrs { replace: true } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:41.665848  3173 leader_election.cc:290] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:41.669142 31620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:41.674494 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e9d2b069edc4166802ee0456ebcb706" is_pre_election: true
I20260709 12:25:41.676312 30939 leader_election.cc:304] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:41.674487 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b5c1c64c494cb59ba74a90317df87d" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:41.682245 31620 consensus_queue.cc:237] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:41.661273 30794 catalog_manager.cc:5697] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 9 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.734246  3194 raft_consensus.cc:2749] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.760840  3189 tablet_replica.cc:333] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:25:41.769798 31619 raft_consensus.cc:1275] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:25:41.771831 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 95590.6us
I20260709 12:25:41.775395  3173 consensus_queue.cc:1048] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:41.783589  3189 raft_consensus.cc:2243] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:41.784366  3189 raft_consensus.cc:2272] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:41.796802 31044 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:41.801285  3189 ts_tablet_manager.cc:1916] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:41.808112 30976 raft_consensus.cc:1275] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:41.880920 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:41.881531 30895 raft_consensus.cc:606] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:41.887707 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2b6f99bf7a54d65868d8e55cbb466b0"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:41.888351 30895 raft_consensus.cc:606] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:41.888659 30895 raft_consensus.cc:614] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:41.896667 30799 catalog_manager.cc:5697] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 5 to 10, VOTER f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) evicted. New cstate: current_term: 12 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.904155 30895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:41.904834 30895 raft_consensus.cc:606] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Received request to transfer leadership to TS f868402d5ae640e7b362b9fddacbaf44
W20260709 12:25:41.946111 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 47318.8us
W20260709 12:25:41.947641 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 151626us
I20260709 12:25:42.068527  3189 ts_tablet_manager.cc:1929] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 12:25:42.069132  3189 log.cc:1199] T c773fc74822844b7aec9509683eb266e P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/c773fc74822844b7aec9509683eb266e
I20260709 12:25:42.075706 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet c773fc74822844b7aec9509683eb266e (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:25:42.077494  3067 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:42.081211 30794 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53570 (request call id 375) took 2457 ms. Trace:
I20260709 12:25:42.081926 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet c773fc74822844b7aec9509683eb266e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:46178
I20260709 12:25:42.083711 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet c773fc74822844b7aec9509683eb266e (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:25:42.082589 30794 rpcz_store.cc:276] 0709 12:25:39.624040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.624219 (+   179us) service_pool.cc:224] Handling call
0709 12:25:42.081132 (+2456913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:41.765685 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:41.766202 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:41.766234 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:25:41.766248 (+    14us) tablet.cc:662] Decoding operations
0709 12:25:41.767001 (+   753us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:41.767052 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:41.767079 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:25:41.767616 (+   537us) tablet.cc:701] Row locks acquired
0709 12:25:41.767635 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:25:41.767791 (+   156us) write_op.cc:270] Start()
0709 12:25:41.767910 (+   119us) write_op.cc:276] Timestamp: P: 1783599941767744 usec, L: 0
0709 12:25:41.767948 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:25:41.806303 (+ 38355us) log.cc:844] Serialized 2807 byte log entry
0709 12:25:41.813431 (+  7128us) op_driver.cc:464] REPLICATION: finished
0709 12:25:41.813845 (+   414us) write_op.cc:301] APPLY: starting
0709 12:25:41.813935 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:41.817232 (+  3297us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:41.817318 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:41.875318 (+ 58000us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:41.875505 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:25:41.875548 (+    43us) write_op.cc:312] APPLY: finished
0709 12:25:41.875816 (+   268us) log.cc:844] Serialized 73 byte log entry
0709 12:25:41.875980 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:41.876087 (+   107us) write_op.cc:454] Released schema lock
0709 12:25:41.876134 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:41.876444 (+   310us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:41.876468 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25530,"reported_tablets":46,"spinlock_wait_cycles":6912,"child_traces":[["op",{"apply.queue_time_us":213,"apply.run_cpu_time_us":8928,"apply.run_wall_time_us":62571,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29176,"num_ops":7,"prepare.queue_time_us":1050,"prepare.run_cpu_time_us":3510,"prepare.run_wall_time_us":43909,"replication_time_us":45353}]]}
I20260709 12:25:42.101047 30900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:42.101657 30900 raft_consensus.cc:606] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:42.091167 30795 catalog_manager.cc:5697] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.120921  3067 consensus_queue.cc:1048] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:42.122013 30900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:36354
I20260709 12:25:42.124078 30900 raft_consensus.cc:606] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:42.125963 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:42.127710 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:42.127187  3067 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:42.128646 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.144377 31045 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:42.147887  3213 raft_consensus.cc:993] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:42.148403  3213 raft_consensus.cc:1081] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:42.163169 30795 catalog_manager.cc:5697] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.199994 31620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:25:42.200598 31620 raft_consensus.cc:493] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.200961 31620 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.215181 31620 raft_consensus.cc:515] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.219393 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:42.219405 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "174b12b6011c47a2baad4ae805c60e15" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:42.221164 30786 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a99465fc591541cf808078e4fb820f06 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:42.221828 31044 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.221915 30895 raft_consensus.cc:3055] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:42.222273 30895 raft_consensus.cc:740] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:42.222957 30895 consensus_queue.cc:260] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.224078 30895 raft_consensus.cc:3060] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.220554  3151 raft_consensus.cc:993] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:42.228171  3151 raft_consensus.cc:1081] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:42.230443 30799 catalog_manager.cc:5697] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 10 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:42.232695 30895 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 13.
I20260709 12:25:42.233116 31617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:25:42.233644 31617 raft_consensus.cc:493] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.233978 31587 leader_election.cc:304] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:42.235023  3215 raft_consensus.cc:2804] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:42.235494  3215 raft_consensus.cc:697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 13 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:42.236292  3215 consensus_queue.cc:237] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.234001 31617 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.244195 31044 raft_consensus.cc:2468] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 13.
I20260709 12:25:42.218524 31620 leader_election.cc:290] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:42.258940 31617 raft_consensus.cc:515] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.261955 31617 leader_election.cc:290] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:42.262883 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:42.263473 31047 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.267156 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8311babaa554788b3a614d3f27a53f4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:42.267756 30895 raft_consensus.cc:3055] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:42.268915 30895 raft_consensus.cc:740] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:42.274936 31047 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:42.276319 31587 leader_election.cc:304] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:42.277182  3200 raft_consensus.cc:2804] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:42.278111  3200 raft_consensus.cc:697] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:42.278945  3200 consensus_queue.cc:237] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.298362 30794 catalog_manager.cc:5697] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: config changed from index 6 to 12, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New cstate: current_term: 14 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:42.277380 30895 consensus_queue.cc:260] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.302388 30895 raft_consensus.cc:3060] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.312268 30958 tablet_service.cc:1558] Processing DeleteTablet for tablet 94b5c1c64c494cb59ba74a90317df87d with delete_type TABLET_DATA_TOMBSTONED (TS f868402d5ae640e7b362b9fddacbaf44 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:39890
I20260709 12:25:42.319096 30795 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53558 (request call id 358) took 2409 ms. Trace:
I20260709 12:25:42.319543 30795 rpcz_store.cc:276] 0709 12:25:39.909506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.909675 (+   169us) service_pool.cc:224] Handling call
0709 12:25:39.962975 (+ 53300us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b540021d9d4. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f0330597090 00007f0330635f3a 00007f03363ebe9c 00007f03364ea04e 00007f03349ab2a4 00007f03349ab232 00007f03349ab161 00007f03349ab0dc 00007f03349aa392 00007f032e96848c 00007f032e9678c6
0709 12:25:42.209709 (+2246734us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:42.209734 (+    25us) write_op.cc:454] Released schema lock
0709 12:25:42.319030 (+109296us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:42.201262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:42.201748 (+   486us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:42.201781 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:25:42.201800 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:42.202156 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:42.202212 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:42.202237 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:42.202535 (+   298us) tablet.cc:701] Row locks acquired
0709 12:25:42.202551 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:25:42.202679 (+   128us) write_op.cc:270] Start()
0709 12:25:42.202782 (+   103us) write_op.cc:276] Timestamp: P: 1783599942202635 usec, L: 0
0709 12:25:42.202802 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:25:42.203340 (+   538us) log.cc:844] Serialized 911 byte log entry
0709 12:25:42.205237 (+  1897us) op_driver.cc:464] REPLICATION: finished
0709 12:25:42.205631 (+   394us) write_op.cc:301] APPLY: starting
0709 12:25:42.205707 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:42.206895 (+  1188us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:42.206980 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:42.208138 (+  1158us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:42.208284 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:25:42.208338 (+    54us) write_op.cc:312] APPLY: finished
0709 12:25:42.208518 (+   180us) log.cc:844] Serialized 33 byte log entry
0709 12:25:42.208655 (+   137us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:42.208734 (+    79us) write_op.cc:454] Released schema lock
0709 12:25:42.208772 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":22023,"reported_tablets":46,"spinlock_wait_cycles":104726784,"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":3396,"apply.run_wall_time_us":3988,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8336,"num_ops":2,"prepare.queue_time_us":583,"prepare.run_cpu_time_us":2349,"prepare.run_wall_time_us":2348,"replication_time_us":2311}]]}
I20260709 12:25:42.342546  3094 raft_consensus.cc:993] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:42.343091  3094 raft_consensus.cc:1081] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:42.344677 30895 raft_consensus.cc:2468] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:42.349242  3213 raft_consensus.cc:993] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706: : Instructing follower f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:42.353533 30887 tablet_service.cc:1558] Processing DeleteTablet for tablet a99465fc591541cf808078e4fb820f06 with delete_type TABLET_DATA_TOMBSTONED (TS 5e9d2b069edc4166802ee0456ebcb706 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46754
I20260709 12:25:42.354488 31620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44882
I20260709 12:25:42.353490  3213 raft_consensus.cc:1081] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Signalling peer f868402d5ae640e7b362b9fddacbaf44 to start an election
I20260709 12:25:42.355046 31620 raft_consensus.cc:493] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.355432 31620 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.345234 30968 raft_consensus.cc:2955] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 6 to 12, VOTER 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:42.359522 30799 catalog_manager.cc:5697] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 12 to 13, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 13 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.369124  3223 tablet_replica.cc:333] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:42.370221  3223 raft_consensus.cc:2243] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.384835  3223 raft_consensus.cc:2272] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.391623  3223 ts_tablet_manager.cc:1916] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:42.400251 30794 catalog_manager.cc:5697] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 10 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.406183 30968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
 from {username='slave'} at 127.0.0.1:59150
I20260709 12:25:42.406805 30968 raft_consensus.cc:493] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.407176 30968 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.412885  3224 tablet_replica.cc:333] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:42.413921  3224 raft_consensus.cc:2243] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:42.414513  3224 raft_consensus.cc:2272] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:42.414088 31620 raft_consensus.cc:515] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.420753 30895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:42.421299 30895 raft_consensus.cc:3055] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:42.421572 30895 raft_consensus.cc:740] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:42.422215 30895 consensus_queue.cc:260] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.423228 30895 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.441005 31620 leader_election.cc:290] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:42.441196 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f1d02ed7d148238e18e004aa55b7d4" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:42.441773 30972 raft_consensus.cc:3060] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.458436  3224 ts_tablet_manager.cc:1916] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:42.455485 30972 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:42.461140 31588 leader_election.cc:304] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:42.461982  3067 raft_consensus.cc:2804] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:42.462443  3067 raft_consensus.cc:697] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 12 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:42.463265  3067 consensus_queue.cc:237] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:42.474736  3223 ts_tablet_manager.cc:1929] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 12:25:42.475204  3223 log.cc:1199] T 94b5c1c64c494cb59ba74a90317df87d P f868402d5ae640e7b362b9fddacbaf44: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/wals/94b5c1c64c494cb59ba74a90317df87d
I20260709 12:25:42.480235 30784 catalog_manager.cc:5028] TS f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): tablet 94b5c1c64c494cb59ba74a90317df87d (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:25:42.487634 30968 raft_consensus.cc:515] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:42.489565 30968 leader_election.cc:290] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:42.490486 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:42.491045 31047 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.493441 30900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cc749e9de5450fa2de1c458a9deba7" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
I20260709 12:25:42.494007 30900 raft_consensus.cc:3055] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:42.494274 30900 raft_consensus.cc:740] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:42.494923 30900 consensus_queue.cc:260] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:42.496436 30900 raft_consensus.cc:3060] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.497014 30895 raft_consensus.cc:2468] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:42.497426 31047 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:42.498485 30939 leader_election.cc:304] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:42.500011  3188 raft_consensus.cc:2804] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:42.500506  3188 raft_consensus.cc:697] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:42.503352  3188 consensus_queue.cc:237] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:42.505613 30900 raft_consensus.cc:2468] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:42.530133 30799 catalog_manager.cc:5697] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 11 to 12, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 12 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.553403 30799 catalog_manager.cc:5697] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 12 to 13, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 13 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.581542  3224 ts_tablet_manager.cc:1929] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:25:42.582072  3224 log.cc:1199] T a99465fc591541cf808078e4fb820f06 P 5e9d2b069edc4166802ee0456ebcb706: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/wals/a99465fc591541cf808078e4fb820f06
I20260709 12:25:42.583873 30783 catalog_manager.cc:5028] TS 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): tablet a99465fc591541cf808078e4fb820f06 (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
I20260709 12:25:42.698387 31047 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:42.702927  3067 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:42.776347 30900 raft_consensus.cc:1275] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:42.778543  3067 consensus_queue.cc:1048] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:42.854990 31044 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:42.856258  3199 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:42.894109 30900 raft_consensus.cc:1275] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:42.895561  3200 consensus_queue.cc:1048] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:42.912629 30895 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:42.916054  3190 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:42.954619 30893 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:42.955978  3200 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:43.040795 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 102198us
I20260709 12:25:43.054152 31044 raft_consensus.cc:1275] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:43.080242  3190 consensus_queue.cc:1048] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:43.090301 30972 raft_consensus.cc:1275] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:43.093626  3199 consensus_queue.cc:1048] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:25:43.171008 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 72740.7us
W20260709 12:25:43.208292 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 58389.7us
I20260709 12:25:43.316636 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.339540 30893 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
W20260709 12:25:43.377708 30867 consensus_peers.cc:597] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 -> Peer 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869): Couldn't send request to peer 9f38f761eded4f28b9d802f6570ee71e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7101e773e94f44688e2e79f4540cad7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:43.379235 31044 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:43.381698  3094 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:43.388566 30973 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:43.390887  3240 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:43.439608  3151 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:25:43.441186 30972 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:25:43.487454 30794 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index -1 to 10, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New cstate: current_term: 14 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:25:43.501791 31044 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } } }
I20260709 12:25:43.692358 31044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8"
dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:42986
I20260709 12:25:43.692934 31044 raft_consensus.cc:606] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:43.778745 30972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:33264
I20260709 12:25:43.779327 30972 raft_consensus.cc:606] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 LEADER]: Received request to transfer leadership to TS 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:43.781848 30972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:33264
I20260709 12:25:43.782423 30972 raft_consensus.cc:606] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:43.784768 30972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:33264
I20260709 12:25:43.785312 30972 raft_consensus.cc:606] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:43.787595 30972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a"
dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
mode: GRACEFUL
new_leader_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:33264
I20260709 12:25:43.788182 30972 raft_consensus.cc:606] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Received request to transfer leadership to TS 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:43.789227 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:43.790817 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:43.791520 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.056695  3256 ts_tablet_manager.cc:933] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: Initiating tablet copy from peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
W20260709 12:25:44.057479 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 59710.9us
W20260709 12:25:44.100077 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 67318.1us
I20260709 12:25:44.108362  3256 tablet_copy_client.cc:323] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Beginning tablet copy session from remote peer at address 127.29.9.1:39249
W20260709 12:25:44.128328 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 46256.9us
I20260709 12:25:44.132834  3173 raft_consensus.cc:993] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:25:44.133384  3188 raft_consensus.cc:1081] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
W20260709 12:25:44.145654 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 56105.7us
I20260709 12:25:44.151352 30893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:37078
I20260709 12:25:44.152022 30893 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.152364 30893 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.155740 30911 tablet_copy_service.cc:140] P 5e9d2b069edc4166802ee0456ebcb706: Received BeginTabletCopySession request for tablet 7101e773e94f44688e2e79f4540cad7e from peer 9f38f761eded4f28b9d802f6570ee71e ({username='slave'} at 127.0.0.1:35494)
I20260709 12:25:44.156771 30911 tablet_copy_service.cc:161] P 5e9d2b069edc4166802ee0456ebcb706: Beginning new tablet copy session on tablet 7101e773e94f44688e2e79f4540cad7e from peer 9f38f761eded4f28b9d802f6570ee71e at {username='slave'} at 127.0.0.1:35494: session id = 9f38f761eded4f28b9d802f6570ee71e-7101e773e94f44688e2e79f4540cad7e
I20260709 12:25:44.167697 30893 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.170213 30893 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 16 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:44.173329 30911 tablet_copy_source_session.cc:215] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:44.178063 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:44.178681 31619 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.181586 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:44.182152 30972 raft_consensus.cc:3055] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:44.182433 30972 raft_consensus.cc:740] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:44.183120 30972 consensus_queue.cc:260] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.184517 30972 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.189881  3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7101e773e94f44688e2e79f4540cad7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:44.201170 31619 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 16.
I20260709 12:25:44.201416  3238 raft_consensus.cc:993] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:44.201977  3259 raft_consensus.cc:993] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:44.208834  3259 raft_consensus.cc:1081] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:44.209692  3259 raft_consensus.cc:1081] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:44.213158 31622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44878
I20260709 12:25:44.213214 31619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44878
I20260709 12:25:44.213716 31622 raft_consensus.cc:493] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.214221 31619 raft_consensus.cc:493] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.214483 31622 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.214614 31619 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.215445 30867 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:44.220551  3248 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:44.221109  3248 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 16 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:44.221989  3248 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.225598  3256 tablet_copy_client.cc:806] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:44.225631  3262 raft_consensus.cc:993] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: : Instructing follower 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:44.226313  3256 tablet_copy_client.cc:670] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Starting download of 1 WAL segments...
W20260709 12:25:44.228964 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 55728.7us
I20260709 12:25:44.226365  3262 raft_consensus.cc:1081] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Signalling peer 9f38f761eded4f28b9d802f6570ee71e to start an election
I20260709 12:25:44.234709 31619 raft_consensus.cc:515] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.239365 30972 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 16.
I20260709 12:25:44.240370 31620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee"
dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
 from {username='slave'} at 127.0.0.1:44878
I20260709 12:25:44.240998 31620 raft_consensus.cc:493] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.241345 31620 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.247138 31619 leader_election.cc:290] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:44.247632 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:44.247841 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf63aa28c9f4ce492e2f2d77216b2ed" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:44.248319 30972 raft_consensus.cc:3055] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:44.248394 31047 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.261032  3261 raft_consensus.cc:993] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: : Instructing follower 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:25:44.262594  3261 raft_consensus.cc:1081] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Signalling peer 5e9d2b069edc4166802ee0456ebcb706 to start an election
I20260709 12:25:44.248706 30972 raft_consensus.cc:740] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:44.274765 30972 consensus_queue.cc:260] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.279595 30972 raft_consensus.cc:3060] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.285282 31047 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:44.287176 30893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8"
dest_uuid: "5e9d2b069edc4166802ee0456ebcb706"
 from {username='slave'} at 127.0.0.1:49788
I20260709 12:25:44.287710 30893 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.288094 30893 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.290033 31587 leader_election.cc:304] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:44.290364 31620 raft_consensus.cc:515] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.291553  3242 raft_consensus.cc:2804] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.291689  3256 tablet_copy_client.cc:538] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:44.292104  3242 raft_consensus.cc:697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 12 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:44.294898 30968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:44.295456 30968 raft_consensus.cc:3055] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:44.295262  3242 consensus_queue.cc:237] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.295817 30968 raft_consensus.cc:740] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:44.302969 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661cc7685b074dd3a1a2ca4dbb1d2eee" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:44.302985  3256 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap starting.
I20260709 12:25:44.306782 31620 leader_election.cc:290] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:44.308197 31047 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.309995 30968 consensus_queue.cc:260] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.311297 30968 raft_consensus.cc:3060] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.314602 30798 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 15 to 16, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 16 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.289717 31622 raft_consensus.cc:515] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.338311 31622 leader_election.cc:290] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:44.342329 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:44.342514 30972 raft_consensus.cc:2468] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:44.343062 30973 raft_consensus.cc:3055] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:44.343451 30973 raft_consensus.cc:740] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:44.344342 30973 consensus_queue.cc:260] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.339654 30893 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:44.346021 31045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6c2e2c3cd614b10b823dd15a66b564a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:44.346644 31045 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.348637 30972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:44.349166 30972 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.354733 31047 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:44.355705 31587 leader_election.cc:304] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:44.356642  3255 raft_consensus.cc:2804] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:44.357173  3255 raft_consensus.cc:697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:44.359473 30972 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:44.358047  3255 consensus_queue.cc:237] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.361145 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "5e9d2b069edc4166802ee0456ebcb706" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:44.361699 31044 raft_consensus.cc:3055] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:44.361984 31044 raft_consensus.cc:740] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:44.362659 31044 consensus_queue.cc:260] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:44.363665 31044 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.363612 30865 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:44.367069 30799 catalog_manager.cc:5697] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 11 to 12, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 12 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.371635 31044 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e9d2b069edc4166802ee0456ebcb706 in term 12.
I20260709 12:25:44.372295  3094 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.372794  3094 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Becoming Leader. State: Replica: 5e9d2b069edc4166802ee0456ebcb706, State: Running, Role: LEADER
I20260709 12:25:44.373626  3094 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:44.377681 30893 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [CANDIDATE]: Term 12 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:44.392572 30973 raft_consensus.cc:3060] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.397337 31045 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:44.398586 31587 leader_election.cc:304] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:44.399456  3242 raft_consensus.cc:2804] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:44.400488  3242 raft_consensus.cc:697] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:44.401422  3242 consensus_queue.cc:237] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:44.403009 30968 raft_consensus.cc:2468] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:44.420173 30973 raft_consensus.cc:2468] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 9.
I20260709 12:25:44.490690  3256 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:44.495153  3256 tablet_bootstrap.cc:492] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: Bootstrap complete.
I20260709 12:25:44.496706  3256 ts_tablet_manager.cc:1403] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: Time spent bootstrapping tablet: real 0.194s	user 0.030s	sys 0.012s
I20260709 12:25:44.504086  3256 raft_consensus.cc:359] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:25:44.508073  3256 raft_consensus.cc:740] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Initialized, Role: LEARNER
I20260709 12:25:44.508803  3256 consensus_queue.cc:260] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: NON_VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: true } }
I20260709 12:25:44.511947  3256 ts_tablet_manager.cc:1434] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:44.523178 30911 tablet_copy_service.cc:342] P 5e9d2b069edc4166802ee0456ebcb706: Request end of tablet copy session 9f38f761eded4f28b9d802f6570ee71e-7101e773e94f44688e2e79f4540cad7e received from {username='slave'} at 127.0.0.1:35494
I20260709 12:25:44.523626 30911 tablet_copy_service.cc:434] P 5e9d2b069edc4166802ee0456ebcb706: ending tablet copy session 9f38f761eded4f28b9d802f6570ee71e-7101e773e94f44688e2e79f4540cad7e on tablet 7101e773e94f44688e2e79f4540cad7e with peer 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:44.525465 30798 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 reported cstate change: term changed from 11 to 12, leader changed from 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) to 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1). New cstate: current_term: 12 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.546181 30799 catalog_manager.cc:5697] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 9 to 10, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 10 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.548293 30799 catalog_manager.cc:5697] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 8 to 9, leader changed from f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 9 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.581909 31622 raft_consensus.cc:1217] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:25:44.716706 30968 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:44.720733  3248 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:44.754701 30973 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:44.757225  3274 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:44.761353 30973 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:44.762943  3151 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:44.791833 30968 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:44.793203  3274 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:44.810159 31622 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:44.811806  3248 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:44.897678 31044 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:25:44.902084 31045 raft_consensus.cc:1275] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:44.903484  3255 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:44.904567  3200 consensus_queue.cc:1048] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:44.902031 30972 raft_consensus.cc:1275] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:25:44.918051  3200 consensus_queue.cc:1048] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:44.932976  3286 log.cc:927] Time spent T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:25:44.936784 31044 raft_consensus.cc:1275] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:44.940495  3200 consensus_queue.cc:1048] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:44.948809 31051 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:44.961405  3240 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 12:25:45.023659 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 62164.2us
W20260709 12:25:45.148391 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 104352us
W20260709 12:25:45.324226  3290 log.cc:927] Time spent T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.170s	user 0.000s	sys 0.002s
W20260709 12:25:45.324982  3288 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:25:45.335069  3240 raft_consensus.cc:1064] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: attempting to promote NON_VOTER 9f38f761eded4f28b9d802f6570ee71e to VOTER
W20260709 12:25:45.337874  3294 log.cc:927] Time spent T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
W20260709 12:25:45.348979 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 304109us
I20260709 12:25:45.364509 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.337658  3240 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:45.469594 30942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 47799.4us
I20260709 12:25:45.541934 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.543744 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:45.544497 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:45.545713 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 58155.1us
W20260709 12:25:45.739073 31587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 124388us
W20260709 12:25:45.764484 31588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 130658us
I20260709 12:25:45.769307 31622 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 LEARNER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:45.775604 31047 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:45.775956  3304 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:45.778702  3094 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:45.782932 30976 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:45.784395  3311 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:45.886756 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.955653  3312 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:45.957962 31622 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:45.961242 31047 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:45.986685 30795 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: config changed from index 10 to 11, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:46.045775 30973 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } attrs { replace: true } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:46.132077 30895 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:46.137952 31622 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:46.138365 30973 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Refusing update from remote peer 5e9d2b069edc4166802ee0456ebcb706: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:46.139917  3311 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:46.141741  3311 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:46.144047 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
I20260709 12:25:46.151516 31622 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:46.156297 30973 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:46.150012  3312 raft_consensus.cc:2955] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
W20260709 12:25:46.208027 31587 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 12:25:46.205896 30794 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: config changed from index 11 to 12, VOTER 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3) evicted. New cstate: current_term: 14 leader_uuid: "5e9d2b069edc4166802ee0456ebcb706" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } } }
I20260709 12:25:46.219767 30783 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7101e773e94f44688e2e79f4540cad7e with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:25:46.257040 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.268905 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.297915 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.298889 31013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:39249, user_credentials={real_user=slave}} blocked reactor thread for 53604.7us
W20260709 12:25:46.309640 30939 consensus_peers.cc:597] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.313958 30939 consensus_peers.cc:597] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.313903 31037 tablet_service.cc:1558] Processing DeleteTablet for tablet 7101e773e94f44688e2e79f4540cad7e with delete_type TABLET_DATA_TOMBSTONED (TS 1a7b44e2d0ed440985e5f643a5a54587 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46178
W20260709 12:25:46.347168 31587 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.347860 31587 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.357352 31013 consensus_peers.cc:597] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.360952 31013 consensus_peers.cc:597] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.382716 30939 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.372411  3349 tablet_replica.cc:333] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
W20260709 12:25:46.384526 31013 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.393137 31013 consensus_peers.cc:597] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.393766 31587 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.395835  3349 raft_consensus.cc:2243] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.399041  3349 raft_consensus.cc:2272] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.402424  3349 ts_tablet_manager.cc:1916] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:46.398373 30939 consensus_peers.cc:597] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.405254 30939 consensus_peers.cc:597] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.398140 31013 consensus_peers.cc:597] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.408438 30939 consensus_peers.cc:597] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.458292 31013 consensus_peers.cc:597] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.466248  3349 ts_tablet_manager.cc:1929] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
W20260709 12:25:46.480408 30939 consensus_peers.cc:597] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.482229  3349 log.cc:1199] T 7101e773e94f44688e2e79f4540cad7e P 1a7b44e2d0ed440985e5f643a5a54587: Deleting WAL directory at /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/wals/7101e773e94f44688e2e79f4540cad7e
I20260709 12:25:46.495527 30783 catalog_manager.cc:5028] TS 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): tablet 7101e773e94f44688e2e79f4540cad7e (table test-workload [id=f4138ea07d3b4dbcb22401a05f134e85]) successfully deleted
W20260709 12:25:46.498173 31587 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.499698 30939 consensus_peers.cc:597] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.522326 31013 consensus_peers.cc:597] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.522692 30939 consensus_peers.cc:597] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.536703 30939 consensus_peers.cc:597] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.540663 30939 consensus_peers.cc:597] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:46.557320 31013 consensus_peers.cc:597] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.564059 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:46.565136 29732 tablet_replica.cc:333] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
W20260709 12:25:46.565569 31587 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.566164 29732 raft_consensus.cc:2243] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.566668 29732 raft_consensus.cc:2272] T f09ba14cb7054588ae9fdcdedf04b081 P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.569051 29732 tablet_replica.cc:333] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.569790 29732 raft_consensus.cc:2243] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.570782 29732 raft_consensus.cc:2272] T bbcdd6eee3294377852452b4989be45f P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.573297 29732 tablet_replica.cc:333] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.574115 29732 raft_consensus.cc:2243] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.575047 29732 raft_consensus.cc:2272] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.577589 29732 tablet_replica.cc:333] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.578351 29732 raft_consensus.cc:2243] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.579301 29732 raft_consensus.cc:2272] T db4086d50310462885b584b6297df730 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:46.581802 31587 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.581837 29732 tablet_replica.cc:333] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.582919 29732 raft_consensus.cc:2243] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.583488 29732 raft_consensus.cc:2272] T acdd02ca27e84adea69d06954f5fe368 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.589612 29732 tablet_replica.cc:333] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.590333 29732 raft_consensus.cc:2243] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.590903 29732 raft_consensus.cc:2272] T 9bf1075e43344e4c85d09b6aeac40c55 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.594172 29732 tablet_replica.cc:333] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.594962 29732 raft_consensus.cc:2243] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.595806 29732 raft_consensus.cc:2272] T 174b12b6011c47a2baad4ae805c60e15 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.598428 29732 tablet_replica.cc:333] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.599216 29732 raft_consensus.cc:2243] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.601495 29732 raft_consensus.cc:2272] T 1dbd739a4ac24132b2b04caeed573906 P 5e9d2b069edc4166802ee0456ebcb706 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.604719 29732 tablet_replica.cc:333] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.605438 29732 raft_consensus.cc:2243] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.606014 29732 raft_consensus.cc:2272] T bb8d20fced0547649402e6668241468c P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.608569 29732 tablet_replica.cc:333] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.609290 29732 raft_consensus.cc:2243] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.610220 29732 raft_consensus.cc:2272] T a623118fdd9441959cededdcb6981b04 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.612751 29732 tablet_replica.cc:333] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.613519 29732 raft_consensus.cc:2243] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.614179 29732 raft_consensus.cc:2272] T 4045483bdd0047e8a04aade3faadf9d6 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.616518 29732 tablet_replica.cc:333] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
W20260709 12:25:46.620242 30939 consensus_peers.cc:597] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.626505 29732 raft_consensus.cc:2243] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.628211 29732 raft_consensus.cc:2272] T 9b078c36427749489d90f67c6504ea82 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.630689 29732 tablet_replica.cc:333] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.632295 29732 raft_consensus.cc:2243] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.633288 29732 raft_consensus.cc:2272] T 07b3f75bb9e3426a95aa33d2f0472a36 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.635685 29732 tablet_replica.cc:333] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.636502 29732 raft_consensus.cc:2243] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.637053 29732 raft_consensus.cc:2272] T c16ae54ff14e49b6877d162ad00f3ac4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.639531 29732 tablet_replica.cc:333] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.640273 29732 raft_consensus.cc:2243] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.641060 29732 raft_consensus.cc:2272] T 94b5c1c64c494cb59ba74a90317df87d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.643424 29732 tablet_replica.cc:333] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.644204 29732 raft_consensus.cc:2243] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.644690 29732 raft_consensus.cc:2272] T f62100297c3841e0914543cebffb2ce0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.647074 29732 tablet_replica.cc:333] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.647809 29732 raft_consensus.cc:2243] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.649094 29732 raft_consensus.cc:2272] T 16bdfcb6fd114ab2865524877be18bd1 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.652174 29732 tablet_replica.cc:333] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.652921 29732 raft_consensus.cc:2243] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.653889 29732 raft_consensus.cc:2272] T 90927dbf8a094626a555e5e7b3d0f803 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.660789 29732 tablet_replica.cc:333] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.661515 29732 raft_consensus.cc:2243] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.662066 29732 raft_consensus.cc:2272] T 3e64945a8b39400e851326d79a2f4d8d P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.665409 29732 tablet_replica.cc:333] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.666172 29732 raft_consensus.cc:2243] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.667060 29732 raft_consensus.cc:2272] T 7101e773e94f44688e2e79f4540cad7e P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.671121 29732 tablet_replica.cc:333] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.672649 29732 raft_consensus.cc:2243] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.673225 29732 raft_consensus.cc:2272] T 4e16650c05cc4ef7a21196d5cc0ca3de P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.675462 29732 tablet_replica.cc:333] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.676196 29732 raft_consensus.cc:2243] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.676679 29732 raft_consensus.cc:2272] T e0f1d02ed7d148238e18e004aa55b7d4 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.679297 29732 tablet_replica.cc:333] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.680017 29732 raft_consensus.cc:2243] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.680521 29732 raft_consensus.cc:2272] T 6741df8b39c94364bb06b6b75ab50bac P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.684119 29732 tablet_replica.cc:333] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.684795 29732 raft_consensus.cc:2243] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.685304 29732 raft_consensus.cc:2272] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.687949 29732 tablet_replica.cc:333] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.688589 29732 raft_consensus.cc:2243] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.689517 29732 raft_consensus.cc:2272] T 367bf3d3c48d46dc88329ac7bc92fceb P 5e9d2b069edc4166802ee0456ebcb706 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.691924 29732 tablet_replica.cc:333] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.692572 29732 raft_consensus.cc:2243] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.693037 29732 raft_consensus.cc:2272] T d2cc749e9de5450fa2de1c458a9deba7 P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.695422 29732 tablet_replica.cc:333] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.696101 29732 raft_consensus.cc:2243] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.696596 29732 raft_consensus.cc:2272] T 3c7ff3f21bc8406f850dc7aa742d339b P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.709944 29732 tablet_replica.cc:333] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.710649 29732 raft_consensus.cc:2243] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.711421 29732 raft_consensus.cc:2272] T f8311babaa554788b3a614d3f27a53f4 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.717465 29732 tablet_replica.cc:333] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
W20260709 12:25:46.719328 30939 consensus_peers.cc:597] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.786798 29732 raft_consensus.cc:2243] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.787465 29732 raft_consensus.cc:2272] T df33f71fccef4bc399b382d9c520fc89 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.814971 29732 tablet_replica.cc:333] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.815753 29732 raft_consensus.cc:2243] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.822546 29732 raft_consensus.cc:2272] T 16482c443f7041fa88ccf619697bd7b6 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.825245 29732 tablet_replica.cc:333] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.825955 29732 raft_consensus.cc:2243] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.831926 29732 raft_consensus.cc:2272] T f278da50d600410dbed3af60b0147046 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.837951 29732 tablet_replica.cc:333] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.848326 29732 raft_consensus.cc:2243] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.856076 29732 raft_consensus.cc:2272] T c41891dd6716497eaa34a9558f696ee1 P 5e9d2b069edc4166802ee0456ebcb706 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.864739 29732 tablet_replica.cc:333] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.865483 29732 raft_consensus.cc:2243] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.878798 29732 raft_consensus.cc:2272] T f7010d5d8a0647a9ab67a7f9250845ea P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.894824 29732 tablet_replica.cc:333] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.895560 29732 raft_consensus.cc:2243] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.928220 29732 raft_consensus.cc:2272] T bb928f25f0c549d8a16221f877f4e73c P 5e9d2b069edc4166802ee0456ebcb706 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.946303 29732 tablet_replica.cc:333] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.948496 29732 raft_consensus.cc:2243] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:25:46.959872 31016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:39869, user_credentials={real_user=slave}} blocked reactor thread for 80267.3us
I20260709 12:25:46.967464 29732 raft_consensus.cc:2272] T 412c07102f934870a9035bbc8463f79a P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.970317 29732 tablet_replica.cc:333] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.971024 29732 raft_consensus.cc:2243] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.971928 29732 raft_consensus.cc:2272] T 46a1f37dacb24754935cf60327f898a9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.974531 29732 tablet_replica.cc:333] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.975160 29732 raft_consensus.cc:2243] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.976150 29732 raft_consensus.cc:2272] T 01464274c44b4333a93e3d0f02ab076c P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.979529 29732 tablet_replica.cc:333] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.980244 29732 raft_consensus.cc:2243] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.980805 29732 raft_consensus.cc:2272] T 2426f61afbf24698969bfa651d747ae9 P 5e9d2b069edc4166802ee0456ebcb706 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.983090 29732 tablet_replica.cc:333] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.983801 29732 raft_consensus.cc:2243] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.984257 29732 raft_consensus.cc:2272] T d2b6f99bf7a54d65868d8e55cbb466b0 P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.986649 29732 tablet_replica.cc:333] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.987279 29732 raft_consensus.cc:2243] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.988045 29732 raft_consensus.cc:2272] T c773fc74822844b7aec9509683eb266e P 5e9d2b069edc4166802ee0456ebcb706 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.990458 29732 tablet_replica.cc:333] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.991075 29732 raft_consensus.cc:2243] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:46.992045 29732 raft_consensus.cc:2272] T cce46c39c1e64c35bd5af558239d31e0 P 5e9d2b069edc4166802ee0456ebcb706 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:46.995663 29732 tablet_replica.cc:333] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:46.996332 29732 raft_consensus.cc:2243] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:46.997488 29732 raft_consensus.cc:2272] T 73ffaf8ce697442c8bbb38cea5ba4136 P 5e9d2b069edc4166802ee0456ebcb706 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.000034 29732 tablet_replica.cc:333] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:47.000672 29732 raft_consensus.cc:2243] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.001138 29732 raft_consensus.cc:2272] T ea71eb6769834992980701da50fb499d P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.055567 29732 tablet_replica.cc:333] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706: stopping tablet replica
I20260709 12:25:47.057260 29732 raft_consensus.cc:2243] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:47.058776 29732 raft_consensus.cc:2272] T c42f8452db3546feaba1bef22141480f P 5e9d2b069edc4166802ee0456ebcb706 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:47.604085  3356 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.604939  3356 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.608860  3356 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:47.651595 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:47.678890 30939 leader_election.cc:336] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.680064 30939 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:47.680948  3350 raft_consensus.cc:2749] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.695995  3364 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.698259  3363 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.698988  3274 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.699357  3363 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.699697  3274 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.702962  3363 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:47.703859 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:47.704409  3351 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.705145  3351 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:47.705596 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:47.705976  3352 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.702385  3274 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:47.706553  3352 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.706225 30976 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:47.708397 31588 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:47.711058  3352 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:47.711702  3274 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.712209  3274 raft_consensus.cc:493] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.712641  3274 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.717689  3351 leader_election.cc:290] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:47.718207 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:47.699697  3364 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.723620  3364 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:47.726611 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:47.739113 31013 leader_election.cc:336] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.748106 31013 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
W20260709 12:25:47.749265 31013 leader_election.cc:336] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.753166 31013 leader_election.cc:304] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:47.750128  3350 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.760322  3350 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:47.761749  3316 raft_consensus.cc:2749] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:47.762423  3350 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:47.750190  3364 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.749738  3351 raft_consensus.cc:2749] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.764186 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:47.764132  3364 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.765196 31047 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
W20260709 12:25:47.765962 30939 leader_election.cc:336] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.766649 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:47.767194  3364 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:47.768234 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:47.770264  3301 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.770696  3301 raft_consensus.cc:493] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.771023  3301 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.772047 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:47.745069  3274 raft_consensus.cc:515] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.785902  3301 raft_consensus.cc:515] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:47.787213  3274 leader_election.cc:290] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:47.770438 31587 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.788194 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a623118fdd9441959cededdcb6981b04" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:47.796167 31587 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:47.796346 30976 raft_consensus.cc:3060] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:47.797740 31587 leader_election.cc:336] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.798183  3364 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:47.798554 31587 leader_election.cc:336] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.800514  3350 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.801120  3350 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.802214 31587 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:47.805048  3364 raft_consensus.cc:2749] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:47.809146 30939 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.809667  3350 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:47.813892 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:47.814483 31623 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 11.
W20260709 12:25:47.816232 31587 leader_election.cc:336] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.816697 31587 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:47.817498  3363 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:47.822064 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
W20260709 12:25:47.822593 30939 leader_election.cc:336] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.823277  3350 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.823807  3350 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.824270  3350 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.833822 30976 raft_consensus.cc:2468] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:47.835034 31588 leader_election.cc:304] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:47.835804  3274 raft_consensus.cc:2804] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:47.836313  3274 raft_consensus.cc:697] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:47.838057  3274 consensus_queue.cc:237] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.842760  3365 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.843305  3365 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.845548  3365 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:47.846679  3351 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.847285  3351 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:47.849524  3351 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:47.850521 30939 leader_election.cc:336] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.842193  3301 leader_election.cc:290] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:47.850783 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4086d50310462885b584b6297df730" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:47.852146 31044 raft_consensus.cc:3060] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.852277 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:47.858511  3365 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.860460  3365 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:47.862083 31013 leader_election.cc:336] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.862429  3365 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:47.853163 31587 leader_election.cc:336] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.864756 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:47.866956 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:47.867321 30939 leader_election.cc:336] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:47.867559 31623 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 16.
I20260709 12:25:47.867152  3350 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.871625  3364 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.871867 31013 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:47.872239  3364 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.872901  3351 raft_consensus.cc:2749] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.876500 31044 raft_consensus.cc:2468] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:47.878553 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:47.874063 30939 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:47.878032 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:47.875798  3364 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:47.880254 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbcdd6eee3294377852452b4989be45f" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:47.880834 31623 raft_consensus.cc:3060] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.881163  3365 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:47.881585  3365 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.881961  3365 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.877679  3363 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.888401  3363 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.890436  3363 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:47.895996  3362 raft_consensus.cc:2749] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:47.897028 30866 connection.cc:466] server connection from 127.0.0.1:37078 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2707) could send its response
I20260709 12:25:47.873886  3350 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:25:47.905553 29732 connection.cc:466] server connection from 127.0.0.1:37078 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37078 (request call id 2706) could send its response
I20260709 12:25:47.906746 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:47.907433 31044 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
W20260709 12:25:47.911763 31587 connection.cc:769] client connection to 127.29.9.1:39249 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:25:47.915403 31587 leader_election.cc:336] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:25:47.915956 31587 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:25:47.916335 31587 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:47.918777 31623 raft_consensus.cc:2468] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:47.915607 30798 catalog_manager.cc:5697] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 10 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 11 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.922892 30939 leader_election.cc:304] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:47.923619  3274 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:47.924240  3362 raft_consensus.cc:2804] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:47.924790  3362 raft_consensus.cc:697] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:47.925756  3362 consensus_queue.cc:237] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:47.928124 30939 connection.cc:769] client connection to 127.29.9.1:39249 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:25:47.928221  3254 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:47.928606 30939 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:25:47.928220 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:47.930452  3254 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:47.930469 30942 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:47.933104  3254 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:47.930470  3274 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.935024  3274 raft_consensus.cc:493] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.931583  3365 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.935463  3274 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.936317  3301 raft_consensus.cc:2804] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:47.936854  3301 raft_consensus.cc:697] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:47.937770  3301 consensus_queue.cc:237] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.940689 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:47.941355 30976 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:47.942649 31014 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:47.942888  3365 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 17 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:47.945317  3254 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.947381  3254 raft_consensus.cc:493] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.947821  3254 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.955145 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dbd739a4ac24132b2b04caeed573906" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:47.955883 31619 raft_consensus.cc:3060] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.968027 31619 raft_consensus.cc:2468] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 17.
I20260709 12:25:47.969615 30942 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:47.972985  3274 raft_consensus.cc:515] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:47.974385  3350 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:47.976766  3350 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:47.977625 31013 leader_election.cc:336] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:47.979413  3350 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:47.986275  3274 leader_election.cc:290] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:47.988508 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:47.988582  3254 raft_consensus.cc:515] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:47.989197 31044 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 12.
I20260709 12:25:47.991130 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07b3f75bb9e3426a95aa33d2f0472a36" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:47.991617 31044 raft_consensus.cc:3060] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:47.993531 31587 leader_election.cc:336] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:47.998322 31044 raft_consensus.cc:2468] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:47.991617  3301 raft_consensus.cc:2804] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:48.001745 31587 leader_election.cc:304] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.002097  3301 raft_consensus.cc:697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 17 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:48.003072  3301 consensus_queue.cc:237] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.005599 30799 catalog_manager.cc:5697] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 11 to 12, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 12 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.007203  3363 raft_consensus.cc:2804] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:48.008733  3363 raft_consensus.cc:697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:48.009619  3363 consensus_queue.cc:237] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.000748 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:48.017788 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90927dbf8a094626a555e5e7b3d0f803" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:48.018349 30976 raft_consensus.cc:3060] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.016345  3254 leader_election.cc:290] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:48.026698 31013 leader_election.cc:336] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.028723 30976 raft_consensus.cc:2468] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 11.
I20260709 12:25:48.017201  3362 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:48.029711 30939 leader_election.cc:336] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
W20260709 12:25:48.030826 30939 leader_election.cc:336] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.030483 31014 leader_election.cc:304] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.032721  3362 raft_consensus.cc:493] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.033403  3362 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.033915  3254 raft_consensus.cc:2804] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:48.034703  3254 raft_consensus.cc:697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:48.035633  3254 consensus_queue.cc:237] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.040203  3299 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.040735  3299 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.041712  3362 raft_consensus.cc:515] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.043033  3299 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:48.047329  3299 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.047046 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
W20260709 12:25:48.048185 30939 leader_election.cc:336] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.048106  3299 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:48.050200 31013 leader_election.cc:336] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.051486  3299 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.052567 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:48.052596 31014 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:48.053411 31617 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:25:48.053908  3299 raft_consensus.cc:2749] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:48.054598 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:48.058550  3299 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:48.059507  3299 raft_consensus.cc:493] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
W20260709 12:25:48.059034 31013 leader_election.cc:336] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.059947  3362 leader_election.cc:290] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:48.059985  3299 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:48.061364 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3512a5343c47d9aec2fa9ca2e680d8" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:48.061959 31047 raft_consensus.cc:3060] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.073720 31047 raft_consensus.cc:2468] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:48.075583 30939 leader_election.cc:304] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.075810  3299 raft_consensus.cc:515] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.076573  3350 raft_consensus.cc:2804] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:48.077486  3350 raft_consensus.cc:697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:48.078439  3350 consensus_queue.cc:237] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.096748  3301 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.097714 30798 catalog_manager.cc:5697] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 10 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 11 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.100456 31617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16bdfcb6fd114ab2865524877be18bd1" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:48.097416  3301 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.101043 31617 raft_consensus.cc:3060] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:48.102435  3301 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.103372  3274 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.103863 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:48.104024  3274 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.106244  3274 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:48.097008  3299 leader_election.cc:290] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.106698 30794 catalog_manager.cc:5697] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 10 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 11 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:48.107965 30939 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.110790 31619 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 14.
I20260709 12:25:48.110893 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:48.108286  3358 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.113536 31617 raft_consensus.cc:2468] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:48.111493 30976 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 14.
I20260709 12:25:48.115034 31016 leader_election.cc:304] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:48.116400 31588 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:48.119578  3352 raft_consensus.cc:2804] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:48.120148  3358 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.119632  3363 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.121186  3363 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.121541  3363 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.122735  3358 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.120217  3352 raft_consensus.cc:697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
W20260709 12:25:48.124171 31013 leader_election.cc:336] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.124737  3352 consensus_queue.cc:237] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:48.125236 31587 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
W20260709 12:25:48.127059 30939 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.127349 30942 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.128161 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:48.128820 31619 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 14.
I20260709 12:25:48.129606  3358 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.130034  3358 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.130388  3358 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.134454 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.135489  3301 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.136016  3301 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.136435  3301 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.145058  3363 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.147746  3301 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:48.151701 31587 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
W20260709 12:25:48.161844 30939 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.161100  3358 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.164140  3301 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.173434 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "367bf3d3c48d46dc88329ac7bc92fceb" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:48.174003 31619 raft_consensus.cc:3060] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.189785  3363 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:25:48.195150 31619 raft_consensus.cc:2468] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 15.
I20260709 12:25:48.202466 30942 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.203305  3361 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.203876  3361 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:48.204670 30939 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.205806  3361 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:48.206084  3301 raft_consensus.cc:2804] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:48.206670  3301 raft_consensus.cc:697] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 15 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:48.207835  3301 consensus_queue.cc:237] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.213260 30976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:48.213732 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:48.213953 30976 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f38f761eded4f28b9d802f6570ee71e in current term 15: Already voted for candidate f868402d5ae640e7b362b9fddacbaf44 in this term.
I20260709 12:25:48.214334 31047 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 13.
I20260709 12:25:48.215396 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 
I20260709 12:25:48.216207  3362 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:48.216665  3362 raft_consensus.cc:493] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.217075  3362 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:48.207749  3316 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.217694  3316 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:48.219835 30939 leader_election.cc:336] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.226437 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:48.219668  3316 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.235843 31588 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:25:48.236445  3358 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.236667  3274 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:48.238912 31013 leader_election.cc:336] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.239395 31013 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:48.243111  3351 raft_consensus.cc:2749] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:48.244670 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:48.245378 31619 raft_consensus.cc:2393] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f868402d5ae640e7b362b9fddacbaf44 in current term 15: Already voted for candidate 9f38f761eded4f28b9d802f6570ee71e in this term.
I20260709 12:25:48.246506 30942 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:48.247345  3358 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:48.254812  3358 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.255383  3358 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.257316  3358 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:48.259063 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
W20260709 12:25:48.266196 30939 leader_election.cc:336] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.266597 30939 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f868402d5ae640e7b362b9fddacbaf44; no voters: 1a7b44e2d0ed440985e5f643a5a54587, 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.271379 30798 catalog_manager.cc:5697] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 10 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.273602 30799 catalog_manager.cc:5697] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 11 to 12, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 12 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.278795  3361 raft_consensus.cc:2749] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:48.283035 30799 catalog_manager.cc:5697] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 16 to 17, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 17 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.284577 30799 catalog_manager.cc:5697] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 12 to 13, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 13 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.293845  3363 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.294432  3363 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.296414  3363 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:48.299955 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:48.300628 31047 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 12.
I20260709 12:25:48.305786 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:25:48.307600  3363 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:48.308050  3363 raft_consensus.cc:493] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.308468  3363 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.307658  3362 raft_consensus.cc:515] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.318550 30798 catalog_manager.cc:5697] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 14 to 15, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 15 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:48.320650 31587 leader_election.cc:336] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
W20260709 12:25:48.322697 30939 leader_election.cc:336] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.325261  3362 leader_election.cc:290] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:48.326542 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb928f25f0c549d8a16221f877f4e73c" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:48.333061 31047 raft_consensus.cc:3060] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:48.348121 31047 raft_consensus.cc:2468] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 14.
I20260709 12:25:48.354250  3363 raft_consensus.cc:515] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.365121  3363 leader_election.cc:290] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:48.370163 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cce46c39c1e64c35bd5af558239d31e0" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:48.371549 31047 raft_consensus.cc:3060] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.378937 30939 leader_election.cc:304] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.384496  3362 raft_consensus.cc:2804] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:48.384943 31587 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.386559  3362 raft_consensus.cc:697] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 14 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:48.392099 31044 raft_consensus.cc:1275] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:48.387956  3362 consensus_queue.cc:237] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:48.393115 31587 leader_election.cc:336] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.395685 31047 raft_consensus.cc:2468] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 13.
I20260709 12:25:48.396224  3254 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.393343  3361 consensus_queue.cc:1048] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:25:48.406488  3254 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.412708 31587 leader_election.cc:304] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.413543  3363 raft_consensus.cc:2804] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:48.414021  3363 raft_consensus.cc:697] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 13 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
W20260709 12:25:48.415112 31013 leader_election.cc:336] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.416607  3363 consensus_queue.cc:237] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.417765  3254 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:48.420128 31619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:25:48.422130 31016 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, 9f38f761eded4f28b9d802f6570ee71e
I20260709 12:25:48.422931  3254 raft_consensus.cc:2749] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:48.438558  3274 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.439224  3274 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:48.440897 30798 catalog_manager.cc:5697] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 12 to 13, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 13 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.445506 30976 raft_consensus.cc:1275] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:48.441627  3274 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:25:48.446386  3351 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.446952  3351 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.447038  3363 consensus_queue.cc:1048] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:48.448967  3351 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:48.449921 31587 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:48.453778 31587 leader_election.cc:336] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.454424 31047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587" is_pre_election: true
I20260709 12:25:48.454357 30799 catalog_manager.cc:5697] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 13 to 14, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 14 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.454738 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44" is_pre_election: true
I20260709 12:25:48.455085 31047 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 10.
I20260709 12:25:48.458720 30973 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
W20260709 12:25:48.459055 31013 leader_election.cc:336] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.471236 31013 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.471987  3351 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:48.472371  3351 raft_consensus.cc:493] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.472739  3351 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:48.476428 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.477547  3274 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:48.477927  3274 raft_consensus.cc:493] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e9d2b069edc4166802ee0456ebcb706)
I20260709 12:25:48.478283  3274 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:48.481917 30939 consensus_peers.cc:597] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.486678  3351 raft_consensus.cc:515] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:25:48.489041  3274 raft_consensus.cc:515] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:48.495244 31587 leader_election.cc:336] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
W20260709 12:25:48.507612 31013 leader_election.cc:336] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:48.508859  3351 leader_election.cc:290] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:25:48.511198 30939 consensus_peers.cc:597] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.513320 30973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01464274c44b4333a93e3d0f02ab076c" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f868402d5ae640e7b362b9fddacbaf44"
I20260709 12:25:48.513890 30973 raft_consensus.cc:3060] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:48.534189  3274 leader_election.cc:290] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
W20260709 12:25:48.537282 30939 consensus_peers.cc:597] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.539405 31044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412c07102f934870a9035bbc8463f79a" candidate_uuid: "9f38f761eded4f28b9d802f6570ee71e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1a7b44e2d0ed440985e5f643a5a54587"
I20260709 12:25:48.539992 31044 raft_consensus.cc:3060] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.540417 30973 raft_consensus.cc:2468] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:25:48.544070 31014 leader_election.cc:304] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.545053  3254 raft_consensus.cc:2804] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:48.545507  3254 raft_consensus.cc:697] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:25:48.546327  3254 consensus_queue.cc:237] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:25:48.557905 30939 consensus_peers.cc:597] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.560802 31619 raft_consensus.cc:1275] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 17 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:48.562150 31617 raft_consensus.cc:1275] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:48.561962  3362 consensus_queue.cc:1048] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:25:48.563302 31013 consensus_peers.cc:597] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.563256  3361 consensus_queue.cc:1048] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:48.554662 31044 raft_consensus.cc:2468] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f38f761eded4f28b9d802f6570ee71e in term 11.
I20260709 12:25:48.568216 31587 leader_election.cc:304] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:48.569792  3274 raft_consensus.cc:2804] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:48.570519  3274 raft_consensus.cc:697] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Becoming Leader. State: Replica: 9f38f761eded4f28b9d802f6570ee71e, State: Running, Role: LEADER
I20260709 12:25:48.571388  3274 consensus_queue.cc:237] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:48.594478 31013 consensus_peers.cc:597] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:48.598877 31044 raft_consensus.cc:1275] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:25:48.600029 31013 consensus_peers.cc:597] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:48.600095  3350 consensus_queue.cc:1048] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:48.600729 31013 consensus_peers.cc:597] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.608150 31044 raft_consensus.cc:1275] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:48.612453  3360 consensus_queue.cc:1048] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:48.617082 31623 raft_consensus.cc:1275] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:48.620863 30973 raft_consensus.cc:1275] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:48.623131  3254 consensus_queue.cc:1048] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:48.625777  3254 consensus_queue.cc:1048] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:48.628368 30798 catalog_manager.cc:5697] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 reported cstate change: term changed from 9 to 10, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3). New cstate: current_term: 10 leader_uuid: "1a7b44e2d0ed440985e5f643a5a54587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.662587 31623 raft_consensus.cc:1275] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:48.666294  3350 consensus_queue.cc:1048] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:48.662317 30799 catalog_manager.cc:5697] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e reported cstate change: term changed from 10 to 11, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4). New cstate: current_term: 11 leader_uuid: "9f38f761eded4f28b9d802f6570ee71e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:48.680588 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.684496 30939 consensus_peers.cc:597] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.730259 30939 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.754236 30939 consensus_peers.cc:597] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.757261 31587 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.762876 30939 consensus_peers.cc:597] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.775166 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.780781 31013 consensus_peers.cc:597] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.790773 30939 consensus_peers.cc:597] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:48.795560 31587 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.806990 31013 consensus_peers.cc:597] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.809324 30939 consensus_peers.cc:597] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:48.844993 30939 consensus_peers.cc:597] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:48.868573 31049 raft_consensus.cc:1275] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:25:48.875329 31013 consensus_peers.cc:597] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:48.876158  3361 consensus_queue.cc:1048] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:48.933211 29732 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:48.944353 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.947533 30939 consensus_peers.cc:597] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:48.958308 30972 raft_consensus.cc:1275] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Refusing update from remote peer 1a7b44e2d0ed440985e5f643a5a54587: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:48.959791  3316 consensus_queue.cc:1048] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:48.968255 30939 consensus_peers.cc:597] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:48.983820 31587 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.009042 31587 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:49.009490 31587 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:49.010200 31013 consensus_peers.cc:597] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:49.039187 30939 consensus_peers.cc:597] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:49.040442 31044 raft_consensus.cc:1275] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:49.047261  3274 consensus_queue.cc:1048] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:25:49.051641 31013 consensus_peers.cc:597] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.074669 31013 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.076495 31587 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.092717 31013 consensus_peers.cc:597] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:49.102671 31044 raft_consensus.cc:1275] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Refusing update from remote peer 9f38f761eded4f28b9d802f6570ee71e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:25:49.134946 30939 consensus_peers.cc:597] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:49.135943  3274 consensus_queue.cc:1048] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:25:49.153664 31587 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.158219 31587 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.200393 30939 consensus_peers.cc:597] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.267460 30939 consensus_peers.cc:597] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.343287 30939 consensus_peers.cc:597] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.485394 30939 consensus_peers.cc:597] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:49.933708 29732 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30922)
I20260709 12:25:50.133459  3361 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.134029  3361 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:50.140575  3361 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:50.140753 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
W20260709 12:25:50.144784 30939 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:50.145069 31623 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 15.
I20260709 12:25:50.158473 30942 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:50.159227  3361 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:50.159624  3361 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.160034  3361 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.186031  3361 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:25:50.219990 30939 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:25:50.224459  3361 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 16 election: Requested vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:25:50.224642 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7101e773e94f44688e2e79f4540cad7e" candidate_uuid: "f868402d5ae640e7b362b9fddacbaf44" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:25:50.225286 31623 raft_consensus.cc:3060] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.234884 31623 raft_consensus.cc:2468] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f868402d5ae640e7b362b9fddacbaf44 in term 16.
I20260709 12:25:50.236311 30942 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44; no voters: 5e9d2b069edc4166802ee0456ebcb706
I20260709 12:25:50.238775  3301 raft_consensus.cc:2804] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:50.239223  3301 raft_consensus.cc:697] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 16 LEADER]: Becoming Leader. State: Replica: f868402d5ae640e7b362b9fddacbaf44, State: Running, Role: LEADER
I20260709 12:25:50.240397  3301 consensus_queue.cc:237] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:25:50.306391 30794 catalog_manager.cc:5697] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 reported cstate change: term changed from 14 to 16, leader changed from 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1) to f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2). New cstate: current_term: 16 leader_uuid: "f868402d5ae640e7b362b9fddacbaf44" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.640451 31623 raft_consensus.cc:1275] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Refusing update from remote peer f868402d5ae640e7b362b9fddacbaf44: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:50.649082  3361 consensus_queue.cc:1048] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:25:50.658473 30939 consensus_peers.cc:597] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:50.903263 30939 consensus_peers.cc:597] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:50.934201 29732 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:50.960029 30939 consensus_peers.cc:597] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.023252 30939 consensus_peers.cc:597] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.030983 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.048805 31587 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.075995 31587 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.117902 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.213884 31587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111) [suppressed 405 similar messages]
W20260709 12:25:51.218698 31587 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.224634 30939 consensus_peers.cc:597] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.232295 30939 consensus_peers.cc:597] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.256412 30939 consensus_peers.cc:597] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.273608 31587 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.285009 30939 consensus_peers.cc:597] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.297057 30939 consensus_peers.cc:597] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.316640 30939 consensus_peers.cc:597] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.338551 30939 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.354959 31587 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.406080 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.413280 31587 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.455871 31013 consensus_peers.cc:597] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.460901 30939 consensus_peers.cc:597] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.464126 31587 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.487984 30939 consensus_peers.cc:597] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.503221 30939 consensus_peers.cc:597] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.541276 30939 consensus_peers.cc:597] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.610446 30939 consensus_peers.cc:597] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.657253 31013 consensus_peers.cc:597] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.660676 31013 consensus_peers.cc:597] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.717794 31013 consensus_peers.cc:597] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.737691 30939 consensus_peers.cc:597] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.760995 31587 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.767374 31013 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.774663 31013 consensus_peers.cc:597] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.822540 31587 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:51.825213 30939 consensus_peers.cc:597] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.872606 30939 consensus_peers.cc:597] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.875505 31587 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.926822 31013 consensus_peers.cc:597] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:51.934687 29732 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:51.989727 30939 consensus_peers.cc:597] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:52.038630 31013 consensus_peers.cc:597] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:52.184662 31013 consensus_peers.cc:597] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:52.320551 31013 consensus_peers.cc:597] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:52.479398 31013 consensus_peers.cc:597] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:52.935190 29732 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:53.207481 30939 consensus_peers.cc:597] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:53.328477 30939 consensus_peers.cc:597] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.346367 30939 consensus_peers.cc:597] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.374588 31014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39975, user_credentials={real_user=slave}} blocked reactor thread for 72382.5us
W20260709 12:25:53.444667 30939 consensus_peers.cc:597] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.472389 31587 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.502374 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.603322 31587 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.622740 31587 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.675091 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.775283 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.775849 31587 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.816035 30939 consensus_peers.cc:597] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.816490 30939 consensus_peers.cc:597] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.858556 30939 consensus_peers.cc:597] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.859018 30939 consensus_peers.cc:597] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.866418 30939 consensus_peers.cc:597] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.874408 30939 consensus_peers.cc:597] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.874902 30939 consensus_peers.cc:597] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.882275 31587 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.904263 30939 consensus_peers.cc:597] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.935663 29732 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:53.944876 31013 consensus_peers.cc:597] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:53.953239 31013 consensus_peers.cc:597] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.977687 30939 consensus_peers.cc:597] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.978338 30939 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:53.993356 30939 consensus_peers.cc:597] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.027449 31587 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:54.075964 30939 consensus_peers.cc:597] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.095744 31013 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.119627 31587 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.192855 30939 consensus_peers.cc:597] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.199285 31587 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:54.215160 30939 consensus_peers.cc:597] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.262101 31013 consensus_peers.cc:597] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.292092 31013 consensus_peers.cc:597] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.323700 31587 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.325070 31013 consensus_peers.cc:597] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:54.328321 30939 consensus_peers.cc:597] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.395363 31587 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.401023 31013 consensus_peers.cc:597] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.509675 31013 consensus_peers.cc:597] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.551846 31013 consensus_peers.cc:597] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.718778 30939 consensus_peers.cc:597] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:54.801592 31013 consensus_peers.cc:597] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:54.936180 29732 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:55.077706 31013 consensus_peers.cc:597] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:55.520733 30939 consensus_peers.cc:597] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:55.898324 31587 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:55.936797 29732 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:55.940757 30939 consensus_peers.cc:597] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:55.987010 30939 consensus_peers.cc:597] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.071192 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.109978 31587 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.162179 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.222007 31587 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.249413 31013 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 12:25:56.259316 31587 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.276887 30939 consensus_peers.cc:597] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.638252 31587 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.639816 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.657686 31587 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.663444 30939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:38505, user_credentials={real_user=slave}} blocked reactor thread for 46044.8us
W20260709 12:25:56.666921 31013 consensus_peers.cc:597] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.669399 31013 consensus_peers.cc:597] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.670048 31013 consensus_peers.cc:597] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.683524 31013 consensus_peers.cc:597] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.684325 31013 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.684921 30939 consensus_peers.cc:597] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.685432 30939 consensus_peers.cc:597] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.686944 30939 consensus_peers.cc:597] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.687521 30939 consensus_peers.cc:597] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.688050 30939 consensus_peers.cc:597] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.688364 30939 consensus_peers.cc:597] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.688804 30939 consensus_peers.cc:597] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.689396 30939 consensus_peers.cc:597] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.696316 30939 consensus_peers.cc:597] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.696640 31587 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.703882 30939 consensus_peers.cc:597] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.704452 30939 consensus_peers.cc:597] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.704790 30939 consensus_peers.cc:597] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:56.705092 30939 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.767001 30939 consensus_peers.cc:597] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.781447 31587 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:56.937292 29732 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:56.990439 30939 consensus_peers.cc:597] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.001279 31013 consensus_peers.cc:597] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.025157 31587 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.105075 31013 consensus_peers.cc:597] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:57.166287 31013 consensus_peers.cc:597] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.178812 31013 consensus_peers.cc:597] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.193033 31587 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:57.284808 31013 consensus_peers.cc:597] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.296581 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1ec0 after lost signal to thread 29735
W20260709 12:25:57.298732 30997 debug-util.cc:398] Leaking SignalData structure 0x7b080027f760 after lost signal to thread 30833
W20260709 12:25:57.305744 30997 debug-util.cc:398] Leaking SignalData structure 0x7b0800109360 after lost signal to thread 31000
W20260709 12:25:57.309013 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4de0 after lost signal to thread 31075
W20260709 12:25:57.316386 30997 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9b40 after lost signal to thread 31649
W20260709 12:25:57.624359 30939 consensus_peers.cc:597] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.777707 31013 consensus_peers.cc:597] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:57.940284 29732 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:58.050465 30939 consensus_peers.cc:597] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:58.434862 30939 consensus_peers.cc:597] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:25:58.451774 30939 consensus_peers.cc:597] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:58.651813 31587 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:58.712303 30939 consensus_peers.cc:597] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.715687 31587 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:58.732048 31587 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.781263 30939 consensus_peers.cc:597] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:58.792547 30939 consensus_peers.cc:597] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.800580 31587 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:58.815600 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.820749 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.897825 30939 consensus_peers.cc:597] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.898108 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.898500 30939 consensus_peers.cc:597] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:58.941303 29732 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 30922)
W20260709 12:25:58.961373 30939 consensus_peers.cc:597] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.967198 30939 consensus_peers.cc:597] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:58.973636 31587 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.001652 30939 consensus_peers.cc:597] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.004935 31013 consensus_peers.cc:597] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.015849 30939 consensus_peers.cc:597] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.043366 30939 consensus_peers.cc:597] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.060103 31013 consensus_peers.cc:597] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.065598 30939 consensus_peers.cc:597] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.133628 30939 consensus_peers.cc:597] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:59.151677 31587 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.174276 31013 consensus_peers.cc:597] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.180869 31013 consensus_peers.cc:597] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:59.181712 30939 consensus_peers.cc:597] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.238425 31587 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.272914 30939 consensus_peers.cc:597] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:59.425285 31013 consensus_peers.cc:597] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:59.476087 31587 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.496340 30939 consensus_peers.cc:597] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:59.512279 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
W20260709 12:25:59.565433 30939 consensus_peers.cc:597] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.621418 31013 consensus_peers.cc:597] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.660502 31013 consensus_peers.cc:597] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:59.663511 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
W20260709 12:25:59.667178 31587 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:25:59.686758 31588 consensus_peers.cc:597] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:59.700126 31013 consensus_peers.cc:597] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:25:59.702389 31014 consensus_peers.cc:597] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.713210 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:59.714648 29732 tablet_replica.cc:333] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.716306 29732 raft_consensus.cc:2243] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.717260 29732 raft_consensus.cc:2272] T 404ba35beca1446e838b7d720c8a6281 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.719964 29732 tablet_replica.cc:333] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.720817 29732 raft_consensus.cc:2243] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.721760 29732 raft_consensus.cc:2272] T b1166342933745c5b82da4ee4032736c P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.725203 29732 tablet_replica.cc:333] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.726016 29732 raft_consensus.cc:2243] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.726764 29732 raft_consensus.cc:2272] T 217b561ab05e4c71be81abf723e3c499 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.729550 29732 tablet_replica.cc:333] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.730298 29732 raft_consensus.cc:2243] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.731366 29732 raft_consensus.cc:2272] T f09ba14cb7054588ae9fdcdedf04b081 P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.734068 29732 tablet_replica.cc:333] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.734715 29732 raft_consensus.cc:2243] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.735560 29732 raft_consensus.cc:2272] T bbcdd6eee3294377852452b4989be45f P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.737809 29732 tablet_replica.cc:333] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.738366 29732 raft_consensus.cc:2243] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.739387 29732 raft_consensus.cc:2272] T 1d3512a5343c47d9aec2fa9ca2e680d8 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.741779 29732 tablet_replica.cc:333] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.742439 29732 raft_consensus.cc:2243] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.743453 29732 raft_consensus.cc:2272] T 9bf1075e43344e4c85d09b6aeac40c55 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.745992 29732 tablet_replica.cc:333] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.753348 29732 raft_consensus.cc:2243] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.754076 29732 raft_consensus.cc:2272] T acdd02ca27e84adea69d06954f5fe368 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.756749 29732 tablet_replica.cc:333] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.757516 29732 raft_consensus.cc:2243] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.758672 29732 raft_consensus.cc:2272] T db4086d50310462885b584b6297df730 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.761088 29732 tablet_replica.cc:333] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.761762 29732 raft_consensus.cc:2243] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.762197 29732 raft_consensus.cc:2272] T 8bf63aa28c9f4ce492e2f2d77216b2ed P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.764355 29732 tablet_replica.cc:333] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.764840 29732 raft_consensus.cc:2243] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.765347 29732 raft_consensus.cc:2272] T b9ebc983d26c40eda93f030abf94ac78 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.767529 29732 tablet_replica.cc:333] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.768039 29732 raft_consensus.cc:2243] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.768481 29732 raft_consensus.cc:2272] T 42ef8a4823164a83ae72778108c8d593 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.770263 29732 tablet_replica.cc:333] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.770763 29732 raft_consensus.cc:2243] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.771528 29732 raft_consensus.cc:2272] T 1dbd739a4ac24132b2b04caeed573906 P f868402d5ae640e7b362b9fddacbaf44 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.774184 29732 tablet_replica.cc:333] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.774864 29732 raft_consensus.cc:2243] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.775871 29732 raft_consensus.cc:2272] T bb8d20fced0547649402e6668241468c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.777841 29732 tablet_replica.cc:333] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.778405 29732 raft_consensus.cc:2243] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.778797 29732 raft_consensus.cc:2272] T 661cc7685b074dd3a1a2ca4dbb1d2eee P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.780686 29732 tablet_replica.cc:333] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.781185 29732 raft_consensus.cc:2243] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.781653 29732 raft_consensus.cc:2272] T 4e16650c05cc4ef7a21196d5cc0ca3de P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.783581 29732 tablet_replica.cc:333] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.784276 29732 raft_consensus.cc:2243] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.785095 29732 raft_consensus.cc:2272] T e0f1d02ed7d148238e18e004aa55b7d4 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:59.786875 31014 consensus_peers.cc:597] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.787854 29732 tablet_replica.cc:333] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.788688 29732 raft_consensus.cc:2243] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.789371 29732 raft_consensus.cc:2272] T 90927dbf8a094626a555e5e7b3d0f803 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.792064 29732 tablet_replica.cc:333] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.792831 29732 raft_consensus.cc:2243] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:25:59.793342 31588 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.793949 29732 raft_consensus.cc:2272] T 3e64945a8b39400e851326d79a2f4d8d P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.796571 29732 tablet_replica.cc:333] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.797227 29732 raft_consensus.cc:2243] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:25:59.798237 31014 consensus_peers.cc:597] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.798942 29732 raft_consensus.cc:2272] T 7101e773e94f44688e2e79f4540cad7e P f868402d5ae640e7b362b9fddacbaf44 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.801777 29732 tablet_replica.cc:333] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.802759 29732 raft_consensus.cc:2243] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:59.802800 31588 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.803745 29732 raft_consensus.cc:2272] T d26d779b278e4014b0368920ddf7529f P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.805760 29732 tablet_replica.cc:333] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.806290 29732 raft_consensus.cc:2243] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.807093 29732 raft_consensus.cc:2272] T 6741df8b39c94364bb06b6b75ab50bac P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.809091 29732 tablet_replica.cc:333] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.809648 29732 raft_consensus.cc:2243] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.810441 29732 raft_consensus.cc:2272] T 251fc9e7cd1b4a0a83ccb0059840fc8b P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.812297 29732 tablet_replica.cc:333] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.812769 29732 raft_consensus.cc:2243] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.813851 29732 raft_consensus.cc:2272] T 367bf3d3c48d46dc88329ac7bc92fceb P f868402d5ae640e7b362b9fddacbaf44 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.815743 29732 tablet_replica.cc:333] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.816222 29732 raft_consensus.cc:2243] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.817037 29732 raft_consensus.cc:2272] T d2cc749e9de5450fa2de1c458a9deba7 P f868402d5ae640e7b362b9fddacbaf44 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.818753 29732 tablet_replica.cc:333] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.819212 29732 raft_consensus.cc:2243] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.819643 29732 raft_consensus.cc:2272] T a623118fdd9441959cededdcb6981b04 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.821419 29732 tablet_replica.cc:333] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.821955 29732 raft_consensus.cc:2243] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.822736 29732 raft_consensus.cc:2272] T 3c7ff3f21bc8406f850dc7aa742d339b P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.824615 29732 tablet_replica.cc:333] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.825135 29732 raft_consensus.cc:2243] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.825863 29732 raft_consensus.cc:2272] T e9e712edd3ac45e9b088a4dbd226c616 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.827569 29732 tablet_replica.cc:333] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.828063 29732 raft_consensus.cc:2243] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.828583 29732 raft_consensus.cc:2272] T d6c2e2c3cd614b10b823dd15a66b564a P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.830511 29732 tablet_replica.cc:333] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.831046 29732 raft_consensus.cc:2243] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.831593 29732 raft_consensus.cc:2272] T 16482c443f7041fa88ccf619697bd7b6 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.833949 29732 tablet_replica.cc:333] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.834661 29732 raft_consensus.cc:2243] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.835305 29732 raft_consensus.cc:2272] T 8b8a0dad5f8a44e9b54943368c8d3758 P f868402d5ae640e7b362b9fddacbaf44 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.839322 29732 tablet_replica.cc:333] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.840119 29732 raft_consensus.cc:2243] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.841166 29732 raft_consensus.cc:2272] T 8f02e5ab61a44506bdae958f8a275d96 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:59.842669 31588 consensus_peers.cc:597] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:59.843418 31013 consensus_peers.cc:597] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:59.843827 29732 tablet_replica.cc:333] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
W20260709 12:25:59.843699 31014 consensus_peers.cc:597] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.844722 29732 raft_consensus.cc:2243] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.845461 29732 raft_consensus.cc:2272] T af9423709bcf457ab89f49d71d157085 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.848048 29732 tablet_replica.cc:333] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.848675 29732 raft_consensus.cc:2243] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:25:59.849161 31587 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:25:59.849691 29732 raft_consensus.cc:2272] T df33f71fccef4bc399b382d9c520fc89 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.851974 29732 tablet_replica.cc:333] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.852488 29732 raft_consensus.cc:2243] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.853523 29732 raft_consensus.cc:2272] T bb928f25f0c549d8a16221f877f4e73c P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:59.853497 31014 consensus_peers.cc:597] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.855683 29732 tablet_replica.cc:333] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.856235 29732 raft_consensus.cc:2243] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.856988 29732 raft_consensus.cc:2272] T c41891dd6716497eaa34a9558f696ee1 P f868402d5ae640e7b362b9fddacbaf44 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.859278 29732 tablet_replica.cc:333] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.859838 29732 raft_consensus.cc:2243] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.860540 29732 raft_consensus.cc:2272] T e9e2b6ed092748a1a4b34148ab6d2923 P f868402d5ae640e7b362b9fddacbaf44 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:59.860989 31588 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.862552 29732 tablet_replica.cc:333] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.863104 29732 raft_consensus.cc:2243] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.863538 29732 raft_consensus.cc:2272] T 01464274c44b4333a93e3d0f02ab076c P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.865327 29732 tablet_replica.cc:333] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.865803 29732 raft_consensus.cc:2243] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.866576 29732 raft_consensus.cc:2272] T c42f8452db3546feaba1bef22141480f P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.868554 29732 tablet_replica.cc:333] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.869072 29732 raft_consensus.cc:2243] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.869861 29732 raft_consensus.cc:2272] T ea71eb6769834992980701da50fb499d P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.871999 29732 tablet_replica.cc:333] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.872517 29732 raft_consensus.cc:2243] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.873126 29732 raft_consensus.cc:2272] T 46a1f37dacb24754935cf60327f898a9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.875633 29732 tablet_replica.cc:333] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.876340 29732 raft_consensus.cc:2243] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:59.876534 31013 consensus_peers.cc:597] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:25:59.877282 29732 raft_consensus.cc:2272] T a99465fc591541cf808078e4fb820f06 P f868402d5ae640e7b362b9fddacbaf44 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.880002 29732 tablet_replica.cc:333] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.880710 29732 raft_consensus.cc:2243] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:25:59.881839 29732 raft_consensus.cc:2272] T d2b6f99bf7a54d65868d8e55cbb466b0 P f868402d5ae640e7b362b9fddacbaf44 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.884460 29732 tablet_replica.cc:333] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.885193 29732 raft_consensus.cc:2243] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:59.886067 31588 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.886264 29732 raft_consensus.cc:2272] T c773fc74822844b7aec9509683eb266e P f868402d5ae640e7b362b9fddacbaf44 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.889477 29732 tablet_replica.cc:333] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44: stopping tablet replica
I20260709 12:25:59.889992 29732 raft_consensus.cc:2243] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.890568 29732 raft_consensus.cc:2272] T 2426f61afbf24698969bfa651d747ae9 P f868402d5ae640e7b362b9fddacbaf44 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:59.943415 31588 consensus_peers.cc:597] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:59.944339 31588 consensus_peers.cc:597] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:59.945793 31014 consensus_peers.cc:597] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.042689 31588 consensus_peers.cc:597] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.045143 31588 consensus_peers.cc:597] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.051335 31014 consensus_peers.cc:597] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.060855 31014 consensus_peers.cc:597] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.126223 31014 consensus_peers.cc:597] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.141391 31014 consensus_peers.cc:597] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.178138 31588 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.181878 31014 consensus_peers.cc:597] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.212529 31014 consensus_peers.cc:597] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.408994 31013 consensus_peers.cc:597] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:00.721668  3453 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.722348  3453 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.726641 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "404ba35beca1446e838b7d720c8a6281" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:26:00.726622  3453 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:26:00.727816  3436 raft_consensus.cc:493] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.728415  3436 raft_consensus.cc:515] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.730502  3436 leader_election.cc:290] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:26:00.734277 31587 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:00.740003 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
W20260709 12:26:00.741680 31014 leader_election.cc:336] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:00.742177 31014 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 9f38f761eded4f28b9d802f6570ee71e, f868402d5ae640e7b362b9fddacbaf44
W20260709 12:26:00.744805 31588 leader_election.cc:336] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:00.745349 31588 leader_election.cc:304] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:00.746266  3453 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.748592  3459 raft_consensus.cc:2749] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.783627  3453 raft_consensus.cc:493] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.784271  3453 raft_consensus.cc:515] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:26:00.786494  3453 leader_election.cc:290] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:26:00.794871 31014 leader_election.cc:336] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
W20260709 12:26:00.795848 31013 leader_election.cc:336] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:00.796685 31013 leader_election.cc:304] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:00.797781  3453 raft_consensus.cc:2749] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.852005 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
I20260709 12:26:00.861374  3459 raft_consensus.cc:493] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.861912  3459 raft_consensus.cc:515] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.864224  3459 leader_election.cc:290] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:26:00.869477  3459 raft_consensus.cc:493] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
W20260709 12:26:00.870150 31588 leader_election.cc:336] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
W20260709 12:26:00.871109 31587 leader_election.cc:336] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:00.871480 31587 leader_election.cc:304] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:00.869988  3459 raft_consensus.cc:515] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.873037  3456 raft_consensus.cc:2749] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.875747  3436 raft_consensus.cc:493] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.876215  3436 raft_consensus.cc:515] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.877138  3459 leader_election.cc:290] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:00.878108  3436 leader_election.cc:290] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249)
W20260709 12:26:00.884620 31588 leader_election.cc:336] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
W20260709 12:26:00.885114 31588 leader_election.cc:336] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
W20260709 12:26:00.887861 31587 leader_election.cc:336] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:00.889014 31587 leader_election.cc:304] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:00.890045  3436 raft_consensus.cc:2749] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:00.891286 31587 leader_election.cc:336] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:00.891714 31587 leader_election.cc:304] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:00.892647  3436 raft_consensus.cc:2749] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:00.899205 31587 consensus_peers.cc:597] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.916142 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:00.932018 31587 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:00.933753 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:00.934640 29732 tablet_replica.cc:333] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.935624 29732 raft_consensus.cc:2243] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:26:00.936585 29732 raft_consensus.cc:2272] T b1166342933745c5b82da4ee4032736c P 1a7b44e2d0ed440985e5f643a5a54587 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.938860 29732 tablet_replica.cc:333] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.939455 29732 raft_consensus.cc:2243] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:00.940335 29732 raft_consensus.cc:2272] T 217b561ab05e4c71be81abf723e3c499 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.942493 29732 tablet_replica.cc:333] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.943058 29732 raft_consensus.cc:2243] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.943563 29732 raft_consensus.cc:2272] T 404ba35beca1446e838b7d720c8a6281 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.944389  3459 raft_consensus.cc:493] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.944952  3459 raft_consensus.cc:515] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.945745 29732 tablet_replica.cc:333] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.946636 29732 raft_consensus.cc:2243] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:00.947119  3459 leader_election.cc:290] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:00.947608 29732 raft_consensus.cc:2272] T acdd02ca27e84adea69d06954f5fe368 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.950093 29732 tablet_replica.cc:333] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.950707 29732 raft_consensus.cc:2243] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.951179 29732 raft_consensus.cc:2272] T 1d3512a5343c47d9aec2fa9ca2e680d8 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:00.951375 31587 leader_election.cc:336] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:00.953480 29732 tablet_replica.cc:333] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.954083 29732 raft_consensus.cc:2243] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.954609 29732 raft_consensus.cc:2272] T db4086d50310462885b584b6297df730 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:00.956290 31588 leader_election.cc:336] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:00.956684 31588 leader_election.cc:304] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:00.957011 29732 tablet_replica.cc:333] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.957377  3459 raft_consensus.cc:2749] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.957787 29732 raft_consensus.cc:2243] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:00.958810 29732 raft_consensus.cc:2272] T 42ef8a4823164a83ae72778108c8d593 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.960827 29732 tablet_replica.cc:333] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.961333 29732 raft_consensus.cc:2243] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:00.962033 29732 raft_consensus.cc:2272] T b9ebc983d26c40eda93f030abf94ac78 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.963416  3459 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.963992  3459 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.964382 29732 tablet_replica.cc:333] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.965241 29732 raft_consensus.cc:2243] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.965939 29732 raft_consensus.cc:2272] T 174b12b6011c47a2baad4ae805c60e15 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.966712  3459 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:26:00.968374 29732 tablet_replica.cc:333] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.968920 29732 raft_consensus.cc:2243] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.969472 29732 raft_consensus.cc:2272] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.975163 29732 tablet_replica.cc:333] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.975953 29732 raft_consensus.cc:2243] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:00.977008 29732 raft_consensus.cc:2272] T 9b078c36427749489d90f67c6504ea82 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:00.978029 31587 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:00.979328  3453 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.980189 29732 tablet_replica.cc:333] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.980964 29732 raft_consensus.cc:2243] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:00.979841  3453 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:00.982036 29732 raft_consensus.cc:2272] T 4045483bdd0047e8a04aade3faadf9d6 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.983901 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e" is_pre_election: true
I20260709 12:26:00.984517 31623 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 9.
I20260709 12:26:00.984579 29732 tablet_replica.cc:333] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:00.985842 31016 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: 
I20260709 12:26:00.985976 29732 raft_consensus.cc:2243] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.986692 29732 raft_consensus.cc:2272] T 07b3f75bb9e3426a95aa33d2f0472a36 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.986856  3437 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:00.987342  3437 raft_consensus.cc:493] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.987751  3437 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:00.988250 31014 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:00.985020  3453 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
I20260709 12:26:00.989445 29732 tablet_replica.cc:333] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
W20260709 12:26:00.993367 31587 consensus_peers.cc:597] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:00.993359  3453 raft_consensus.cc:493] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:00.990211 29732 raft_consensus.cc:2243] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:00.994675 29732 raft_consensus.cc:2272] T bb8d20fced0547649402e6668241468c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:00.994227  3453 raft_consensus.cc:515] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
W20260709 12:26:00.996901 31587 consensus_peers.cc:597] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:01.000600 31013 leader_election.cc:336] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:00.995143  3437 raft_consensus.cc:515] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:01.003259 29732 tablet_replica.cc:333] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.004166 29732 raft_consensus.cc:2243] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.004449  3453 leader_election.cc:290] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:01.005065 29732 raft_consensus.cc:2272] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.005079 31588 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.005697 31588 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.006374  3459 raft_consensus.cc:2749] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:01.007773  3437 leader_election.cc:290] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Requested vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 9f38f761eded4f28b9d802f6570ee71e (127.29.9.4:39869)
W20260709 12:26:01.008793 31014 leader_election.cc:336] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.007972 31623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f02e5ab61a44506bdae958f8a275d96" candidate_uuid: "1a7b44e2d0ed440985e5f643a5a54587" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9f38f761eded4f28b9d802f6570ee71e"
I20260709 12:26:01.009646 31623 raft_consensus.cc:3060] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:01.010977 31014 leader_election.cc:336] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.011307 31014 leader_election.cc:304] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.012190  3453 raft_consensus.cc:2749] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:01.015935  3453 raft_consensus.cc:493] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:01.016281  3453 raft_consensus.cc:515] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } }
I20260709 12:26:01.016921 29732 tablet_replica.cc:333] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.017794 29732 raft_consensus.cc:2243] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.017907  3453 leader_election.cc:290] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:01.018894 29732 raft_consensus.cc:2272] T f62100297c3841e0914543cebffb2ce0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.021464 29732 tablet_replica.cc:333] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
W20260709 12:26:01.021807 31013 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:01.022243 29732 raft_consensus.cc:2243] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.016553 31623 raft_consensus.cc:2468] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7b44e2d0ed440985e5f643a5a54587 in term 10.
I20260709 12:26:01.023865 31016 leader_election.cc:304] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587, 9f38f761eded4f28b9d802f6570ee71e; no voters: f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.024224 29732 raft_consensus.cc:2272] T 16bdfcb6fd114ab2865524877be18bd1 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.024528 31014 leader_election.cc:336] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.024966 31014 leader_election.cc:304] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7b44e2d0ed440985e5f643a5a54587; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.026227  3453 raft_consensus.cc:2804] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:01.026803 29732 tablet_replica.cc:333] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.027572 29732 raft_consensus.cc:2243] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.028715  3437 raft_consensus.cc:2749] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.029991 29732 raft_consensus.cc:2272] T 4e16650c05cc4ef7a21196d5cc0ca3de P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.028575  3453 raft_consensus.cc:697] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Becoming Leader. State: Replica: 1a7b44e2d0ed440985e5f643a5a54587, State: Running, Role: LEADER
I20260709 12:26:01.032210  3453 consensus_queue.cc:237] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:01.036437 29732 tablet_replica.cc:333] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.037310 29732 raft_consensus.cc:2243] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.038338 29732 raft_consensus.cc:2272] T c16ae54ff14e49b6877d162ad00f3ac4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.040971 29732 tablet_replica.cc:333] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.041692 29732 raft_consensus.cc:2243] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.042416 29732 raft_consensus.cc:2272] T 94b5c1c64c494cb59ba74a90317df87d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.044989 29732 tablet_replica.cc:333] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.045703 29732 raft_consensus.cc:2243] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.046485 29732 pending_rounds.cc:70] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Trying to abort 1 pending ops.
I20260709 12:26:01.046798 29732 pending_rounds.cc:77] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587: Aborting op as it isn't in flight: id { term: 10 index: 10 } timestamp: 7305625440397041664 op_type: NO_OP noop_request { }
I20260709 12:26:01.047242 29732 raft_consensus.cc:2889] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:01.047555 29732 raft_consensus.cc:2272] T 8f02e5ab61a44506bdae958f8a275d96 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.050077 29732 tablet_replica.cc:333] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.050822 29732 raft_consensus.cc:2243] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.051388 29732 raft_consensus.cc:2272] T 251fc9e7cd1b4a0a83ccb0059840fc8b P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.052865 31587 consensus_peers.cc:597] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:01.053851 29732 tablet_replica.cc:333] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.054664 29732 raft_consensus.cc:2243] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.054826  3459 raft_consensus.cc:493] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:01.055279  3459 raft_consensus.cc:515] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:01.055231 29732 raft_consensus.cc:2272] T d2cc749e9de5450fa2de1c458a9deba7 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.057231  3459 leader_election.cc:290] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:01.058317 29732 tablet_replica.cc:333] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.059074 29732 raft_consensus.cc:2243] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.059612 29732 raft_consensus.cc:2272] T e9e712edd3ac45e9b088a4dbd226c616 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.061579 31587 leader_election.cc:336] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:01.062106 29732 tablet_replica.cc:333] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
W20260709 12:26:01.062088 31588 leader_election.cc:336] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.062621 31588 leader_election.cc:304] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.062999 29732 raft_consensus.cc:2243] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.063145  3459 raft_consensus.cc:2749] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:01.063676 29732 raft_consensus.cc:2272] T d6c2e2c3cd614b10b823dd15a66b564a P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.066215 29732 tablet_replica.cc:333] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.066949 29732 raft_consensus.cc:2243] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.067930 29732 raft_consensus.cc:2272] T 8b8a0dad5f8a44e9b54943368c8d3758 P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.070365 29732 tablet_replica.cc:333] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.071075 29732 raft_consensus.cc:2243] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.071825 29732 raft_consensus.cc:2272] T d26d779b278e4014b0368920ddf7529f P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.074087 29732 tablet_replica.cc:333] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.074779 29732 raft_consensus.cc:2243] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.075299 29732 raft_consensus.cc:2272] T 3e64945a8b39400e851326d79a2f4d8d P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.077589 29732 tablet_replica.cc:333] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.078305 29732 raft_consensus.cc:2243] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.079347 29732 raft_consensus.cc:2272] T 90927dbf8a094626a555e5e7b3d0f803 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.081732 29732 tablet_replica.cc:333] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.082381 29732 raft_consensus.cc:2243] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.083416 29732 raft_consensus.cc:2272] T af9423709bcf457ab89f49d71d157085 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.084029  3459 raft_consensus.cc:493] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:01.084540  3459 raft_consensus.cc:515] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:01.085886 29732 tablet_replica.cc:333] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.086223  3436 raft_consensus.cc:493] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:01.086545  3459 leader_election.cc:290] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:01.086694 29732 raft_consensus.cc:2243] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.086819  3436 raft_consensus.cc:515] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:01.087551 29732 raft_consensus.cc:2272] T f8311babaa554788b3a614d3f27a53f4 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.089381  3436 leader_election.cc:290] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:01.090298 29732 tablet_replica.cc:333] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.091059 29732 raft_consensus.cc:2243] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.091646 29732 raft_consensus.cc:2272] T df33f71fccef4bc399b382d9c520fc89 P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.091773 31588 leader_election.cc:336] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.092943  3436 raft_consensus.cc:493] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:01.093415  3436 raft_consensus.cc:515] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:01.094179 29732 tablet_replica.cc:333] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.094916 29732 raft_consensus.cc:2243] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:01.094902 31588 leader_election.cc:336] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.096077 29732 raft_consensus.cc:2272] T 3c7ff3f21bc8406f850dc7aa742d339b P 1a7b44e2d0ed440985e5f643a5a54587 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.098714 29732 tablet_replica.cc:333] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.099434 29732 raft_consensus.cc:2243] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.095355  3436 leader_election.cc:290] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:01.100481 29732 raft_consensus.cc:2272] T f7010d5d8a0647a9ab67a7f9250845ea P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.101363 31587 leader_election.cc:336] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:01.101796 31587 leader_election.cc:304] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.102495  3436 raft_consensus.cc:2749] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:01.102967 29732 tablet_replica.cc:333] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
W20260709 12:26:01.103490 31587 leader_election.cc:336] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:01.104501 31587 leader_election.cc:304] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.103766 29732 raft_consensus.cc:2243] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.105258  3436 raft_consensus.cc:2749] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:01.105484 29732 raft_consensus.cc:2272] T bb928f25f0c549d8a16221f877f4e73c P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.106269 31587 leader_election.cc:336] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
W20260709 12:26:01.107188 31587 consensus_peers.cc:597] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.107786 31587 consensus_peers.cc:597] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.107892 31588 leader_election.cc:336] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.108268 29732 tablet_replica.cc:333] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.108284 31588 leader_election.cc:304] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.109076  3436 raft_consensus.cc:2749] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:01.109166 29732 raft_consensus.cc:2243] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.109917 29732 raft_consensus.cc:2272] T 412c07102f934870a9035bbc8463f79a P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.112397 29732 tablet_replica.cc:333] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.113044 29732 raft_consensus.cc:2243] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.114020 29732 raft_consensus.cc:2272] T a99465fc591541cf808078e4fb820f06 P 1a7b44e2d0ed440985e5f643a5a54587 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.116313 29732 tablet_replica.cc:333] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.116947 29732 raft_consensus.cc:2243] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.117875 29732 raft_consensus.cc:2272] T 46a1f37dacb24754935cf60327f898a9 P 1a7b44e2d0ed440985e5f643a5a54587 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.120141 29732 tablet_replica.cc:333] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.120759 29732 raft_consensus.cc:2243] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.121809 29732 raft_consensus.cc:2272] T 01464274c44b4333a93e3d0f02ab076c P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.124059 29732 tablet_replica.cc:333] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.124652 29732 raft_consensus.cc:2243] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.125069  3436 raft_consensus.cc:493] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:01.125598 29732 raft_consensus.cc:2272] T e9e2b6ed092748a1a4b34148ab6d2923 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.125514  3436 raft_consensus.cc:515] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:01.127338  3436 leader_election.cc:290] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
I20260709 12:26:01.128065 29732 tablet_replica.cc:333] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.128760 29732 raft_consensus.cc:2243] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.129410 29732 raft_consensus.cc:2272] T ea71eb6769834992980701da50fb499d P 1a7b44e2d0ed440985e5f643a5a54587 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.131826 29732 tablet_replica.cc:333] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.132421 29732 raft_consensus.cc:2243] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.133198 29732 raft_consensus.cc:2272] T f278da50d600410dbed3af60b0147046 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.135627 29732 tablet_replica.cc:333] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
W20260709 12:26:01.136126 31588 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.136281 29732 raft_consensus.cc:2243] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:01.136756 31587 leader_election.cc:336] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
I20260709 12:26:01.136978 29732 raft_consensus.cc:2272] T cce46c39c1e64c35bd5af558239d31e0 P 1a7b44e2d0ed440985e5f643a5a54587 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.137149 31587 leader_election.cc:304] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.137791  3459 raft_consensus.cc:2749] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.139607 29732 tablet_replica.cc:333] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587: stopping tablet replica
I20260709 12:26:01.140323 29732 raft_consensus.cc:2243] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.140935 29732 raft_consensus.cc:2272] T 73ffaf8ce697442c8bbb38cea5ba4136 P 1a7b44e2d0ed440985e5f643a5a54587 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:01.141417 31587 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.180900 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.185422 31587 consensus_peers.cc:597] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.204241 31587 consensus_peers.cc:597] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.220340 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.244668 31587 consensus_peers.cc:597] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:38505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.250510 31587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111) [suppressed 476 similar messages]
I20260709 12:26:01.252988  3436 raft_consensus.cc:493] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f868402d5ae640e7b362b9fddacbaf44)
I20260709 12:26:01.253624  3436 raft_consensus.cc:515] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e9d2b069edc4166802ee0456ebcb706" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 39249 } } peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
W20260709 12:26:01.259883 31587 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111)
W20260709 12:26:01.261729 31588 leader_election.cc:336] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:01.262130 31588 leader_election.cc:304] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 5e9d2b069edc4166802ee0456ebcb706, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:01.262959  3459 raft_consensus.cc:2749] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:01.263190 31587 consensus_peers.cc:597] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:01.263804  3436 leader_election.cc:290] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249), f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975)
W20260709 12:26:01.330991 31587 consensus_peers.cc:597] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:38505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.360526 31587 consensus_peers.cc:597] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:01.398039 31587 consensus_peers.cc:597] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e -> Peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Couldn't send request to peer 1a7b44e2d0ed440985e5f643a5a54587. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:38505: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:01.466856 31587 consensus_peers.cc:597] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:01.531469 31587 consensus_peers.cc:597] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:01.535099 31587 consensus_peers.cc:597] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:01.625574 31587 consensus_peers.cc:597] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:01.713399 31587 consensus_peers.cc:597] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:01.713917 31587 consensus_peers.cc:597] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e -> Peer 5e9d2b069edc4166802ee0456ebcb706 (127.29.9.1:39249): Couldn't send request to peer 5e9d2b069edc4166802ee0456ebcb706. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:39249: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:01.798134 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
W20260709 12:26:01.857537 31588 consensus_peers.cc:597] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e -> Peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Couldn't send request to peer f868402d5ae640e7b362b9fddacbaf44. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:01.903889 29732 tablet_server.cc:179] TabletServer@127.29.9.4:0 shutting down...
I20260709 12:26:01.956060 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:01.956895 29732 tablet_replica.cc:333] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.957780 29732 raft_consensus.cc:2243] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.958470 29732 raft_consensus.cc:2272] T 7101e773e94f44688e2e79f4540cad7e P 9f38f761eded4f28b9d802f6570ee71e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.960891 29732 tablet_replica.cc:333] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.961480 29732 raft_consensus.cc:2243] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.962395 29732 raft_consensus.cc:2272] T c773fc74822844b7aec9509683eb266e P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.964676 29732 tablet_replica.cc:333] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.965252 29732 raft_consensus.cc:2243] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.965906 29732 raft_consensus.cc:2272] T 8f02e5ab61a44506bdae958f8a275d96 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.967896 29732 tablet_replica.cc:333] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.968438 29732 raft_consensus.cc:2243] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.969252 29732 raft_consensus.cc:2272] T 94b5c1c64c494cb59ba74a90317df87d P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.971251 29732 tablet_replica.cc:333] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.971872 29732 raft_consensus.cc:2243] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.972280 29732 raft_consensus.cc:2272] T 217b561ab05e4c71be81abf723e3c499 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.974304 29732 tablet_replica.cc:333] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.974821 29732 raft_consensus.cc:2243] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.975435 29732 raft_consensus.cc:2272] T 16bdfcb6fd114ab2865524877be18bd1 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.977358 29732 tablet_replica.cc:333] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.977919 29732 raft_consensus.cc:2243] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.978682 29732 raft_consensus.cc:2272] T e0f1d02ed7d148238e18e004aa55b7d4 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.980690 29732 tablet_replica.cc:333] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.981267 29732 raft_consensus.cc:2243] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.982045 29732 raft_consensus.cc:2272] T d6c2e2c3cd614b10b823dd15a66b564a P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.984660 29732 tablet_replica.cc:333] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.985464 29732 raft_consensus.cc:2243] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.986351 29732 raft_consensus.cc:2272] T f62100297c3841e0914543cebffb2ce0 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.988937 29732 tablet_replica.cc:333] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.989573 29732 raft_consensus.cc:2243] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.990497 29732 raft_consensus.cc:2272] T 8bf63aa28c9f4ce492e2f2d77216b2ed P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.992617 29732 tablet_replica.cc:333] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.993157 29732 raft_consensus.cc:2243] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.993882 29732 raft_consensus.cc:2272] T e9e712edd3ac45e9b088a4dbd226c616 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.995997 29732 tablet_replica.cc:333] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.996522 29732 raft_consensus.cc:2243] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:01.997259 29732 raft_consensus.cc:2272] T f278da50d600410dbed3af60b0147046 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.999348 29732 tablet_replica.cc:333] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:01.999933 29732 raft_consensus.cc:2243] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.000470 29732 raft_consensus.cc:2272] T c41891dd6716497eaa34a9558f696ee1 P 9f38f761eded4f28b9d802f6570ee71e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.002429 29732 tablet_replica.cc:333] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.002959 29732 raft_consensus.cc:2243] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.003762 29732 raft_consensus.cc:2272] T a99465fc591541cf808078e4fb820f06 P 9f38f761eded4f28b9d802f6570ee71e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.005760 29732 tablet_replica.cc:333] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.006264 29732 raft_consensus.cc:2243] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.006645 29732 raft_consensus.cc:2272] T 367bf3d3c48d46dc88329ac7bc92fceb P 9f38f761eded4f28b9d802f6570ee71e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.008615 29732 tablet_replica.cc:333] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.009115 29732 raft_consensus.cc:2243] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.009552 29732 raft_consensus.cc:2272] T b1166342933745c5b82da4ee4032736c P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.011386 29732 tablet_replica.cc:333] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.011917 29732 raft_consensus.cc:2243] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.012357 29732 raft_consensus.cc:2272] T 4045483bdd0047e8a04aade3faadf9d6 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.014214 29732 tablet_replica.cc:333] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.014794 29732 raft_consensus.cc:2243] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.015362 29732 raft_consensus.cc:2272] T 9b078c36427749489d90f67c6504ea82 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.017446 29732 tablet_replica.cc:333] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.018183 29732 raft_consensus.cc:2243] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.018770 29732 raft_consensus.cc:2272] T f7010d5d8a0647a9ab67a7f9250845ea P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.021119 29732 tablet_replica.cc:333] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.021795 29732 raft_consensus.cc:2243] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.022622 29732 raft_consensus.cc:2272] T 412c07102f934870a9035bbc8463f79a P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.023360  3459 raft_consensus.cc:493] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1a7b44e2d0ed440985e5f643a5a54587)
I20260709 12:26:02.023869  3459 raft_consensus.cc:515] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f868402d5ae640e7b362b9fddacbaf44" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39975 } } peers { permanent_uuid: "1a7b44e2d0ed440985e5f643a5a54587" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 38505 } } peers { permanent_uuid: "9f38f761eded4f28b9d802f6570ee71e" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 39869 } attrs { promote: false } }
I20260709 12:26:02.024946 29732 tablet_replica.cc:333] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.025776 29732 raft_consensus.cc:2243] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.026043  3459 leader_election.cc:290] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975), 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505)
I20260709 12:26:02.026840 29732 raft_consensus.cc:2272] T 73ffaf8ce697442c8bbb38cea5ba4136 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.029371 29732 tablet_replica.cc:333] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.030066 29732 raft_consensus.cc:2243] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.031155 29732 raft_consensus.cc:2272] T cce46c39c1e64c35bd5af558239d31e0 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:02.031574 31587 leader_election.cc:336] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1a7b44e2d0ed440985e5f643a5a54587 (127.29.9.3:38505): Network error: Client connection negotiation failed: client connection to 127.29.9.3:38505: connect: Connection refused (error 111)
W20260709 12:26:02.032301 31588 leader_election.cc:336] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f868402d5ae640e7b362b9fddacbaf44 (127.29.9.2:39975): Network error: Client connection negotiation failed: client connection to 127.29.9.2:39975: connect: Connection refused (error 111)
I20260709 12:26:02.032686 31588 leader_election.cc:304] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f38f761eded4f28b9d802f6570ee71e; no voters: 1a7b44e2d0ed440985e5f643a5a54587, f868402d5ae640e7b362b9fddacbaf44
I20260709 12:26:02.033357  3459 raft_consensus.cc:2749] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:02.033689 29732 tablet_replica.cc:333] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.034605 29732 raft_consensus.cc:2243] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.035199 29732 raft_consensus.cc:2272] T b9ebc983d26c40eda93f030abf94ac78 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.037181 29732 tablet_replica.cc:333] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.037675 29732 raft_consensus.cc:2243] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.038096 29732 raft_consensus.cc:2272] T c42f8452db3546feaba1bef22141480f P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.039919 29732 tablet_replica.cc:333] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.040413 29732 raft_consensus.cc:2243] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.040944 29732 raft_consensus.cc:2272] T f09ba14cb7054588ae9fdcdedf04b081 P 9f38f761eded4f28b9d802f6570ee71e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.042786 29732 tablet_replica.cc:333] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.043274 29732 raft_consensus.cc:2243] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.043874 29732 raft_consensus.cc:2272] T c16ae54ff14e49b6877d162ad00f3ac4 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.046111 29732 tablet_replica.cc:333] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.046838 29732 raft_consensus.cc:2243] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.047777 29732 raft_consensus.cc:2272] T f8311babaa554788b3a614d3f27a53f4 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.049726 29732 tablet_replica.cc:333] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.050251 29732 raft_consensus.cc:2243] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.051024 29732 raft_consensus.cc:2272] T 661cc7685b074dd3a1a2ca4dbb1d2eee P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.052688 29732 tablet_replica.cc:333] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.053172 29732 raft_consensus.cc:2243] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.053586 29732 raft_consensus.cc:2272] T 404ba35beca1446e838b7d720c8a6281 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.055469 29732 tablet_replica.cc:333] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.055969 29732 raft_consensus.cc:2243] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.056733 29732 raft_consensus.cc:2272] T d26d779b278e4014b0368920ddf7529f P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.058642 29732 tablet_replica.cc:333] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.059140 29732 raft_consensus.cc:2243] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.059541 29732 raft_consensus.cc:2272] T 1dbd739a4ac24132b2b04caeed573906 P 9f38f761eded4f28b9d802f6570ee71e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.061399 29732 tablet_replica.cc:333] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.061902 29732 raft_consensus.cc:2243] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.062322 29732 raft_consensus.cc:2272] T e9e2b6ed092748a1a4b34148ab6d2923 P 9f38f761eded4f28b9d802f6570ee71e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.064113 29732 tablet_replica.cc:333] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.064637 29732 raft_consensus.cc:2243] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.065376 29732 raft_consensus.cc:2272] T 2426f61afbf24698969bfa651d747ae9 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.067202 29732 tablet_replica.cc:333] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.067715 29732 raft_consensus.cc:2243] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.068135 29732 raft_consensus.cc:2272] T bbcdd6eee3294377852452b4989be45f P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.069808 29732 tablet_replica.cc:333] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.070303 29732 raft_consensus.cc:2243] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.071465 29732 raft_consensus.cc:2272] T a623118fdd9441959cededdcb6981b04 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.073850 29732 tablet_replica.cc:333] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.074458 29732 raft_consensus.cc:2243] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.075882 29732 raft_consensus.cc:2272] T 6741df8b39c94364bb06b6b75ab50bac P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.077689 29732 tablet_replica.cc:333] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.078142 29732 raft_consensus.cc:2243] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.078823 29732 raft_consensus.cc:2272] T 174b12b6011c47a2baad4ae805c60e15 P 9f38f761eded4f28b9d802f6570ee71e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.080864 29732 tablet_replica.cc:333] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.081367 29732 raft_consensus.cc:2243] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.081820 29732 raft_consensus.cc:2272] T d2b6f99bf7a54d65868d8e55cbb466b0 P 9f38f761eded4f28b9d802f6570ee71e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.084048 29732 tablet_replica.cc:333] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.084564 29732 raft_consensus.cc:2243] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.085024 29732 raft_consensus.cc:2272] T af9423709bcf457ab89f49d71d157085 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.086834 29732 tablet_replica.cc:333] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.087294 29732 raft_consensus.cc:2243] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.087868 29732 raft_consensus.cc:2272] T 9bf1075e43344e4c85d09b6aeac40c55 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.089614 29732 tablet_replica.cc:333] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.090140 29732 raft_consensus.cc:2243] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.090759 29732 raft_consensus.cc:2272] T 42ef8a4823164a83ae72778108c8d593 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.092558 29732 tablet_replica.cc:333] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.093017 29732 raft_consensus.cc:2243] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.094004 29732 raft_consensus.cc:2272] T 07b3f75bb9e3426a95aa33d2f0472a36 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.095811 29732 tablet_replica.cc:333] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.096267 29732 raft_consensus.cc:2243] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.097012 29732 raft_consensus.cc:2272] T 16482c443f7041fa88ccf619697bd7b6 P 9f38f761eded4f28b9d802f6570ee71e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.098592 29732 tablet_replica.cc:333] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e: stopping tablet replica
I20260709 12:26:02.099036 29732 raft_consensus.cc:2243] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.099449 29732 raft_consensus.cc:2272] T 8b8a0dad5f8a44e9b54943368c8d3758 P 9f38f761eded4f28b9d802f6570ee71e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.804266 29732 tablet_server.cc:196] TabletServer@127.29.9.4:0 shutdown complete.
I20260709 12:26:02.861585 29732 master.cc:562] Master@127.29.9.62:46357 shutting down...
I20260709 12:26:02.888572 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:02.889102 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.889387 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P 68e5ef8bf7224b3eb4f5bc33c89543d4: stopping tablet replica
I20260709 12:26:02.988889 29732 master.cc:584] Master@127.29.9.62:46357 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (162131 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:26:03.075563 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:34565
I20260709 12:26:03.076682 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:03.082091  3463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.082093  3462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.083174  3465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.084592 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:03.087276 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:03.087459 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:03.087569 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599963087558 us; error 0 us; skew 500 ppm
I20260709 12:26:03.088357 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:03.090651 29732 webserver.cc:533] Webserver started at http://127.29.9.62:38951/ using document root <none> and password file <none>
I20260709 12:26:03.091107 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:03.091269 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:03.091481 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:03.092562 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "d6b27c144de84ce9941a5f23151e47d5"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.097086 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:03.100373  3470 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.101085 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:03.101361 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "d6b27c144de84ce9941a5f23151e47d5"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.101608 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:03.127439 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:03.128679 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:03.164636 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:34565
I20260709 12:26:03.164721  3521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:34565 every 8 connection(s)
I20260709 12:26:03.168450  3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.178040  3522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5: Bootstrap starting.
I20260709 12:26:03.182605  3522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:03.186582  3522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5: No bootstrap required, opened a new log
I20260709 12:26:03.188643  3522 raft_consensus.cc:359] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b27c144de84ce9941a5f23151e47d5" member_type: VOTER }
I20260709 12:26:03.189019  3522 raft_consensus.cc:385] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:03.189191  3522 raft_consensus.cc:740] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b27c144de84ce9941a5f23151e47d5, State: Initialized, Role: FOLLOWER
I20260709 12:26:03.189702  3522 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b27c144de84ce9941a5f23151e47d5" member_type: VOTER }
I20260709 12:26:03.190142  3522 raft_consensus.cc:399] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:03.190326  3522 raft_consensus.cc:493] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:03.190529  3522 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:03.194661  3522 raft_consensus.cc:515] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b27c144de84ce9941a5f23151e47d5" member_type: VOTER }
I20260709 12:26:03.195107  3522 leader_election.cc:304] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6b27c144de84ce9941a5f23151e47d5; no voters: 
I20260709 12:26:03.196151  3522 leader_election.cc:290] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:03.196532  3525 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:03.197803  3525 raft_consensus.cc:697] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 1 LEADER]: Becoming Leader. State: Replica: d6b27c144de84ce9941a5f23151e47d5, State: Running, Role: LEADER
I20260709 12:26:03.198408  3525 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b27c144de84ce9941a5f23151e47d5" member_type: VOTER }
I20260709 12:26:03.198791  3522 sys_catalog.cc:565] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:03.202941  3527 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6b27c144de84ce9941a5f23151e47d5. Latest consensus state: current_term: 1 leader_uuid: "d6b27c144de84ce9941a5f23151e47d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b27c144de84ce9941a5f23151e47d5" member_type: VOTER } }
I20260709 12:26:03.203543  3527 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:03.204375  3526 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6b27c144de84ce9941a5f23151e47d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6b27c144de84ce9941a5f23151e47d5" member_type: VOTER } }
I20260709 12:26:03.204936  3526 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:03.206086  3533 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:03.213044  3533 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:03.214021 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:03.221385  3533 catalog_manager.cc:1383] Generated new cluster ID: ba3ac9ad3d854d489415b29378c39599
I20260709 12:26:03.221666  3533 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:03.237993  3533 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:03.239300  3533 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:03.253958  3533 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5: Generated new TSK 0
I20260709 12:26:03.254495  3533 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:03.280722 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:03.286582  3543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.287647  3544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.289196  3546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.289692 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:03.291234 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:03.291435 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:03.291586 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599963291569 us; error 0 us; skew 500 ppm
I20260709 12:26:03.292114 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:03.294236 29732 webserver.cc:533] Webserver started at http://127.29.9.1:36887/ using document root <none> and password file <none>
I20260709 12:26:03.294683 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:03.294840 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:03.295092 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:03.296201 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "b06c1f1461ec46289edf63122a5863ba"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.300530 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:03.303859  3551 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.304628 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:03.304906 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "b06c1f1461ec46289edf63122a5863ba"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.305146 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:03.336225 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:03.337383 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:03.338821 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:03.341045 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:03.341239 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.341462 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:03.341620 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.378952 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:37069
I20260709 12:26:03.379051  3613 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:37069 every 8 connection(s)
I20260709 12:26:03.383500 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:03.391197  3618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.391547  3619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.394529 29732 server_base.cc:1061] running on GCE node
W20260709 12:26:03.396143  3622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.397087  3614 heartbeater.cc:344] Connected to a master server at 127.29.9.62:34565
I20260709 12:26:03.397118 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:03.397492 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:03.397531  3614 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:03.397665 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599963397649 us; error 0 us; skew 500 ppm
I20260709 12:26:03.398329 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:03.398298  3614 heartbeater.cc:507] Master 127.29.9.62:34565 requested a full tablet report, sending...
I20260709 12:26:03.400490  3487 ts_manager.cc:194] Registered new tserver with Master: b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:03.401194 29732 webserver.cc:533] Webserver started at http://127.29.9.2:44331/ using document root <none> and password file <none>
I20260709 12:26:03.401809 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:03.402046 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:03.402347 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:03.402864  3487 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37342
I20260709 12:26:03.403838 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.408174 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:03.411818  3626 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.412516 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:03.412784 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.413050 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:03.428584 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:03.429715 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:03.431103 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:03.433364 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:03.433553 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.433756 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:03.433911 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.470925 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:40615
I20260709 12:26:03.471019  3688 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:40615 every 8 connection(s)
I20260709 12:26:03.475462 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:03.482245  3692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.484248  3693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.485042 29732 server_base.cc:1061] running on GCE node
W20260709 12:26:03.485802  3695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.486853 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:03.487111 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:03.487277 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599963487259 us; error 0 us; skew 500 ppm
I20260709 12:26:03.487401  3689 heartbeater.cc:344] Connected to a master server at 127.29.9.62:34565
I20260709 12:26:03.487823  3689 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:03.488039 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:03.488657  3689 heartbeater.cc:507] Master 127.29.9.62:34565 requested a full tablet report, sending...
I20260709 12:26:03.490553 29732 webserver.cc:533] Webserver started at http://127.29.9.3:35107/ using document root <none> and password file <none>
I20260709 12:26:03.490881  3487 ts_manager.cc:194] Registered new tserver with Master: ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:03.491189 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:03.491452 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:03.491791 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:03.492667  3487 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37354
I20260709 12:26:03.493248 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "98dcd37d8895403d96ceb94f8c67412a"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.497964 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:03.501087  3700 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.501784 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:03.502046 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "98dcd37d8895403d96ceb94f8c67412a"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.502300 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:03.536746 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:03.537900 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:03.539278 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:03.541389 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:03.541579 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.541805 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:03.541951 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.579119 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:35167
I20260709 12:26:03.579214  3762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:35167 every 8 connection(s)
I20260709 12:26:03.583561 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:03.590130  3766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.591560  3767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.593151  3769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.593647 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:03.595427 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:03.595644 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:03.595851 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599963595831 us; error 0 us; skew 500 ppm
I20260709 12:26:03.596218  3763 heartbeater.cc:344] Connected to a master server at 127.29.9.62:34565
I20260709 12:26:03.596479 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:03.596637  3763 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:03.597602  3763 heartbeater.cc:507] Master 127.29.9.62:34565 requested a full tablet report, sending...
I20260709 12:26:03.599629 29732 webserver.cc:533] Webserver started at http://127.29.9.4:37455/ using document root <none> and password file <none>
I20260709 12:26:03.599813  3487 ts_manager.cc:194] Registered new tserver with Master: 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:03.600267 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:03.600509 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:03.600766 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:03.601330  3487 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37362
I20260709 12:26:03.601841 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-3-root/instance:
uuid: "3c78ef175c2d468993c1cb82527bef05"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.606470 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:03.609719  3774 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.610394 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:03.610664 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-3-root
uuid: "3c78ef175c2d468993c1cb82527bef05"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:03.610931 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:03.634822 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:03.635991 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:03.637332 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:03.639415 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:03.639611 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.639853 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:03.640007 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.676312 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.4:37093
I20260709 12:26:03.676419  3836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.4:37093 every 8 connection(s)
I20260709 12:26:03.688969  3837 heartbeater.cc:344] Connected to a master server at 127.29.9.62:34565
I20260709 12:26:03.689388  3837 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:03.690068  3837 heartbeater.cc:507] Master 127.29.9.62:34565 requested a full tablet report, sending...
I20260709 12:26:03.691815  3487 ts_manager.cc:194] Registered new tserver with Master: 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:03.692873 29732 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013612079s
I20260709 12:26:03.693069  3487 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37372
I20260709 12:26:03.718328  3487 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37378:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:26:03.945333  3654 tablet_service.cc:1511] Processing CreateTablet for tablet fafdf9490c1f4d9b919cee9883ba04fd (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:03.946930  3654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafdf9490c1f4d9b919cee9883ba04fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.950662  3653 tablet_service.cc:1511] Processing CreateTablet for tablet 67c7c476412c475ea0783cadfd0ce30c (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:03.952968  3652 tablet_service.cc:1511] Processing CreateTablet for tablet e13f07f4920e4b38816a3a22b807b9c2 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:03.954316  3652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13f07f4920e4b38816a3a22b807b9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.956111  3653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c7c476412c475ea0783cadfd0ce30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.959576  3579 tablet_service.cc:1511] Processing CreateTablet for tablet 67c7c476412c475ea0783cadfd0ce30c (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:03.961067  3579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c7c476412c475ea0783cadfd0ce30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.960791  3575 tablet_service.cc:1511] Processing CreateTablet for tablet 97832336db4b4e6099c905fe241f299c (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:03.962167  3575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97832336db4b4e6099c905fe241f299c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.964219  3574 tablet_service.cc:1511] Processing CreateTablet for tablet 96dca18b7eac43e78683c65edac5c3bc (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:03.964841  3576 tablet_service.cc:1511] Processing CreateTablet for tablet 67cdf8ac45ef43ee978cae31e085a9c3 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:03.965520  3574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96dca18b7eac43e78683c65edac5c3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.966949  3577 tablet_service.cc:1511] Processing CreateTablet for tablet 93135771a5a14169b53fb7a726a9ce2e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:03.967620  3651 tablet_service.cc:1511] Processing CreateTablet for tablet 67cdf8ac45ef43ee978cae31e085a9c3 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:03.968215  3577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93135771a5a14169b53fb7a726a9ce2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.968914  3651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cdf8ac45ef43ee978cae31e085a9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.969870  3573 tablet_service.cc:1511] Processing CreateTablet for tablet 28797f7f5b4c4196b96911477adabf4d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:03.971159  3573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28797f7f5b4c4196b96911477adabf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.972234  3578 tablet_service.cc:1511] Processing CreateTablet for tablet e13f07f4920e4b38816a3a22b807b9c2 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:03.973464  3578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13f07f4920e4b38816a3a22b807b9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.974514  3576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cdf8ac45ef43ee978cae31e085a9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.975631  3572 tablet_service.cc:1511] Processing CreateTablet for tablet a40efc51adc448f18f9e55927e61618d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:03.976922  3572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40efc51adc448f18f9e55927e61618d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.981215  3571 tablet_service.cc:1511] Processing CreateTablet for tablet e70956e754284b1d94ac89b470281cca (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:03.982499  3571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70956e754284b1d94ac89b470281cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.987071  3570 tablet_service.cc:1511] Processing CreateTablet for tablet 16f7ac680c52440fbb826622012945b7 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:03.988374  3570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f7ac680c52440fbb826622012945b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.004658  3728 tablet_service.cc:1511] Processing CreateTablet for tablet fafdf9490c1f4d9b919cee9883ba04fd (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:04.006052  3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafdf9490c1f4d9b919cee9883ba04fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.008852  3721 tablet_service.cc:1511] Processing CreateTablet for tablet e70956e754284b1d94ac89b470281cca (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:04.010259  3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70956e754284b1d94ac89b470281cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.010036  3726 tablet_service.cc:1511] Processing CreateTablet for tablet 93135771a5a14169b53fb7a726a9ce2e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:04.011319  3726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93135771a5a14169b53fb7a726a9ce2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.012842  3725 tablet_service.cc:1511] Processing CreateTablet for tablet 67cdf8ac45ef43ee978cae31e085a9c3 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:04.014181  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cdf8ac45ef43ee978cae31e085a9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.015285  3720 tablet_service.cc:1511] Processing CreateTablet for tablet 87a16122c42b40248f485b77753956bc (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:04.016005  3724 tablet_service.cc:1511] Processing CreateTablet for tablet 96dca18b7eac43e78683c65edac5c3bc (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:04.016613  3720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a16122c42b40248f485b77753956bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.017285  3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96dca18b7eac43e78683c65edac5c3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.012893  3719 tablet_service.cc:1511] Processing CreateTablet for tablet 16f7ac680c52440fbb826622012945b7 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:04.019038  3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f7ac680c52440fbb826622012945b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.019901  3727 tablet_service.cc:1511] Processing CreateTablet for tablet 67c7c476412c475ea0783cadfd0ce30c (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:04.021212  3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c7c476412c475ea0783cadfd0ce30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.022490  3722 tablet_service.cc:1511] Processing CreateTablet for tablet 28797f7f5b4c4196b96911477adabf4d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:04.020866  3723 tablet_service.cc:1511] Processing CreateTablet for tablet a07c0d79152646f8aea06f98ab72cc07 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:04.025732  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28797f7f5b4c4196b96911477adabf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.026773  3575 tablet_service.cc:1511] Processing CreateTablet for tablet 546aeeaf20fb480bb5956ba5dc611e07 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:04.029029  3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07c0d79152646f8aea06f98ab72cc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.034811  3578 tablet_service.cc:1511] Processing CreateTablet for tablet 5ddc19e80d1e47bf9adba05e63b9c08f (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:04.038988  3577 tablet_service.cc:1511] Processing CreateTablet for tablet 5afddbeb03a24c0c80391699d45e6520 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:04.050647  3575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546aeeaf20fb480bb5956ba5dc611e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.053200  3578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ddc19e80d1e47bf9adba05e63b9c08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.054782  3650 tablet_service.cc:1511] Processing CreateTablet for tablet 97832336db4b4e6099c905fe241f299c (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:04.056262  3650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97832336db4b4e6099c905fe241f299c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.061623  3649 tablet_service.cc:1511] Processing CreateTablet for tablet a07c0d79152646f8aea06f98ab72cc07 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:04.063017  3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07c0d79152646f8aea06f98ab72cc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.071986  3573 tablet_service.cc:1511] Processing CreateTablet for tablet 7d0f0423423342ecbdfe71d740533bf9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:04.104388  3725 tablet_service.cc:1511] Processing CreateTablet for tablet 5ddc19e80d1e47bf9adba05e63b9c08f (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:04.106662  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ddc19e80d1e47bf9adba05e63b9c08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.106841  3576 tablet_service.cc:1511] Processing CreateTablet for tablet f6816ad0fe10401d80c7d91e289708d6 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:04.100176  3577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5afddbeb03a24c0c80391699d45e6520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.117522  3722 tablet_service.cc:1511] Processing CreateTablet for tablet 01be9c8eac8b49f581ef991385b23996 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:04.119086  3726 tablet_service.cc:1511] Processing CreateTablet for tablet 5afddbeb03a24c0c80391699d45e6520 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:04.120633  3574 tablet_service.cc:1511] Processing CreateTablet for tablet 3f126cd9dac7407c92dc21d66fc9e353 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:04.121886  3574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f126cd9dac7407c92dc21d66fc9e353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.119009  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01be9c8eac8b49f581ef991385b23996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.131637  3725 tablet_service.cc:1511] Processing CreateTablet for tablet f6816ad0fe10401d80c7d91e289708d6 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:04.133082  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6816ad0fe10401d80c7d91e289708d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.136673  3720 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6c49b7c4db4f3fa1f03c887186ee66 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:04.140580  3726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5afddbeb03a24c0c80391699d45e6520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.146072  3857 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:04.152338  3856 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:04.158298  3723 tablet_service.cc:1511] Processing CreateTablet for tablet 3f126cd9dac7407c92dc21d66fc9e353 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:04.166116  3579 tablet_service.cc:1511] Processing CreateTablet for tablet d4576aeb4fdf46b0ab7c91d7b4389291 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:04.169232  3573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d0f0423423342ecbdfe71d740533bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.172379  3647 tablet_service.cc:1511] Processing CreateTablet for tablet a40efc51adc448f18f9e55927e61618d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:04.173038  3645 tablet_service.cc:1511] Processing CreateTablet for tablet 546aeeaf20fb480bb5956ba5dc611e07 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:04.173700  3647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40efc51adc448f18f9e55927e61618d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.174304  3645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546aeeaf20fb480bb5956ba5dc611e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.174722  3648 tablet_service.cc:1511] Processing CreateTablet for tablet 28797f7f5b4c4196b96911477adabf4d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:04.175990  3648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28797f7f5b4c4196b96911477adabf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.176082  3579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4576aeb4fdf46b0ab7c91d7b4389291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.176415  3802 tablet_service.cc:1511] Processing CreateTablet for tablet fafdf9490c1f4d9b919cee9883ba04fd (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:04.177646  3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fafdf9490c1f4d9b919cee9883ba04fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.181347  3801 tablet_service.cc:1511] Processing CreateTablet for tablet e13f07f4920e4b38816a3a22b807b9c2 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:04.181994  3798 tablet_service.cc:1511] Processing CreateTablet for tablet 96dca18b7eac43e78683c65edac5c3bc (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:04.182678  3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13f07f4920e4b38816a3a22b807b9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.183279  3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96dca18b7eac43e78683c65edac5c3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.184370  3800 tablet_service.cc:1511] Processing CreateTablet for tablet 93135771a5a14169b53fb7a726a9ce2e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:04.181383  3793 tablet_service.cc:1511] Processing CreateTablet for tablet 546aeeaf20fb480bb5956ba5dc611e07 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:04.185724  3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93135771a5a14169b53fb7a726a9ce2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.186228  3649 tablet_service.cc:1511] Processing CreateTablet for tablet 16f7ac680c52440fbb826622012945b7 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:04.187436  3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f7ac680c52440fbb826622012945b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.188498  3797 tablet_service.cc:1511] Processing CreateTablet for tablet a07c0d79152646f8aea06f98ab72cc07 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:04.188395  3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546aeeaf20fb480bb5956ba5dc611e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.190357  3794 tablet_service.cc:1511] Processing CreateTablet for tablet 87a16122c42b40248f485b77753956bc (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:04.191653  3794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a16122c42b40248f485b77753956bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.193423  3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f126cd9dac7407c92dc21d66fc9e353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.196379  3796 tablet_service.cc:1511] Processing CreateTablet for tablet a40efc51adc448f18f9e55927e61618d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:04.193836  3576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6816ad0fe10401d80c7d91e289708d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.194307  3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07c0d79152646f8aea06f98ab72cc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.197698  3796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40efc51adc448f18f9e55927e61618d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.200402  3795 tablet_service.cc:1511] Processing CreateTablet for tablet e70956e754284b1d94ac89b470281cca (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:04.201717  3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e70956e754284b1d94ac89b470281cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.204368  3799 tablet_service.cc:1511] Processing CreateTablet for tablet 97832336db4b4e6099c905fe241f299c (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:04.205672  3575 tablet_service.cc:1511] Processing CreateTablet for tablet b17a4df1bf1a4a6192febd99cd97d5bb (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:04.207249  3575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17a4df1bf1a4a6192febd99cd97d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.184286  3646 tablet_service.cc:1511] Processing CreateTablet for tablet 87a16122c42b40248f485b77753956bc (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:04.208900  3646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a16122c42b40248f485b77753956bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.216352  3570 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfc6756ea0e486d869252fd8f102411 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:04.221271  3572 tablet_service.cc:1511] Processing CreateTablet for tablet 755d2f3e3f0a4ae7ba1f73aec0f49a2d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:04.205636  3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97832336db4b4e6099c905fe241f299c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.253880  3570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfc6756ea0e486d869252fd8f102411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.225948  3578 tablet_service.cc:1511] Processing CreateTablet for tablet fd7b1d038f32403881c972fd7d51e402 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:04.253298  3725 tablet_service.cc:1511] Processing CreateTablet for tablet b17a4df1bf1a4a6192febd99cd97d5bb (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:04.224102  3579 tablet_service.cc:1511] Processing CreateTablet for tablet 22aa1145b1384ae3a8fa929b5bbcfc19 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:04.225170  3728 tablet_service.cc:1511] Processing CreateTablet for tablet 99e2aa65e5fc4e0c9ba2625fea02a731 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:04.260933  3579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aa1145b1384ae3a8fa929b5bbcfc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.262254  3572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755d2f3e3f0a4ae7ba1f73aec0f49a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.274803  3722 tablet_service.cc:1511] Processing CreateTablet for tablet 4399494b9fc14dc7989c328e016df504 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:04.275996  3856 tablet_bootstrap.cc:654] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.219545  3721 tablet_service.cc:1511] Processing CreateTablet for tablet d4576aeb4fdf46b0ab7c91d7b4389291 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:04.287043  3578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7b1d038f32403881c972fd7d51e402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.288372  3654 tablet_service.cc:1511] Processing CreateTablet for tablet 22aa1145b1384ae3a8fa929b5bbcfc19 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:04.289996  3654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aa1145b1384ae3a8fa929b5bbcfc19. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:04.294049  3471 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 113817us
I20260709 12:26:04.289898  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17a4df1bf1a4a6192febd99cd97d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.300647  3720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6c49b7c4db4f3fa1f03c887186ee66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.301630  3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4576aeb4fdf46b0ab7c91d7b4389291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.288502  3651 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfc6756ea0e486d869252fd8f102411 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:04.268976  3726 tablet_service.cc:1511] Processing CreateTablet for tablet 755d2f3e3f0a4ae7ba1f73aec0f49a2d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:04.319388  3858 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:04.320946  3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e2aa65e5fc4e0c9ba2625fea02a731. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:04.321506  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:04.283206  3727 tablet_service.cc:1511] Processing CreateTablet for tablet 22aa1145b1384ae3a8fa929b5bbcfc19 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:04.335645  3719 tablet_service.cc:1511] Processing CreateTablet for tablet 25f1c4fb6ccb4909b6ed39a42499e6c4 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:04.337523  3651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfc6756ea0e486d869252fd8f102411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.341323  3577 tablet_service.cc:1511] Processing CreateTablet for tablet ac829ea617614c26806da188940d398d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:04.342576  3577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac829ea617614c26806da188940d398d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.288952  3652 tablet_service.cc:1511] Processing CreateTablet for tablet 01be9c8eac8b49f581ef991385b23996 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:04.344623  3652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01be9c8eac8b49f581ef991385b23996. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:04.346642  3474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 108253us
I20260709 12:26:04.350590  3571 tablet_service.cc:1511] Processing CreateTablet for tablet 25f1c4fb6ccb4909b6ed39a42499e6c4 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:04.356343  3571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f1c4fb6ccb4909b6ed39a42499e6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.358129  3650 tablet_service.cc:1511] Processing CreateTablet for tablet 5afddbeb03a24c0c80391699d45e6520 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:04.343381  3724 tablet_service.cc:1511] Processing CreateTablet for tablet 3317f960c9084fd08c81267ec5ea37d6 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:04.367058  3650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5afddbeb03a24c0c80391699d45e6520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.368842  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4399494b9fc14dc7989c328e016df504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.371043  3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aa1145b1384ae3a8fa929b5bbcfc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.378290  3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f1c4fb6ccb4909b6ed39a42499e6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.394547  3726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755d2f3e3f0a4ae7ba1f73aec0f49a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.396598  3653 tablet_service.cc:1511] Processing CreateTablet for tablet 7d0f0423423342ecbdfe71d740533bf9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:04.404137  3653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d0f0423423342ecbdfe71d740533bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.405534  3614 heartbeater.cc:499] Master 127.29.9.62:34565 was elected leader, sending a full tablet report...
W20260709 12:26:04.396077  3474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 48656.3us
I20260709 12:26:04.445937  3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3317f960c9084fd08c81267ec5ea37d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.453425  3858 tablet_bootstrap.cc:654] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:04.420261  3471 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 63766.1us
I20260709 12:26:04.453477  3649 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6c49b7c4db4f3fa1f03c887186ee66 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:04.495400  3689 heartbeater.cc:499] Master 127.29.9.62:34565 was elected leader, sending a full tablet report...
I20260709 12:26:04.497831  3793 tablet_service.cc:1511] Processing CreateTablet for tablet 3317f960c9084fd08c81267ec5ea37d6 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:04.499080  3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3317f960c9084fd08c81267ec5ea37d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.496397  3647 tablet_service.cc:1511] Processing CreateTablet for tablet 3f126cd9dac7407c92dc21d66fc9e353 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:04.504263  3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6c49b7c4db4f3fa1f03c887186ee66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.512125  3856 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:04.512676  3856 ts_tablet_manager.cc:1403] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.361s	user 0.009s	sys 0.032s
I20260709 12:26:04.515473  3856 raft_consensus.cc:359] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:04.516166  3856 raft_consensus.cc:385] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.516440  3856 raft_consensus.cc:740] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.517266  3856 consensus_queue.cc:260] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:04.518309  3725 tablet_service.cc:1511] Processing CreateTablet for tablet 6420cbab7b6a413bb6a9a3bdc07aa918 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:04.519611  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6420cbab7b6a413bb6a9a3bdc07aa918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.520337  3651 tablet_service.cc:1511] Processing CreateTablet for tablet fd7b1d038f32403881c972fd7d51e402 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:04.521569  3651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7b1d038f32403881c972fd7d51e402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.525636  3647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f126cd9dac7407c92dc21d66fc9e353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.525767  3860 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:04.506485  3857 tablet_bootstrap.cc:654] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.558531  3645 tablet_service.cc:1511] Processing CreateTablet for tablet b17a4df1bf1a4a6192febd99cd97d5bb (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:04.561105  3645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17a4df1bf1a4a6192febd99cd97d5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.572407  3648 tablet_service.cc:1511] Processing CreateTablet for tablet 99e2aa65e5fc4e0c9ba2625fea02a731 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 12:26:04.502489  3473 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 64071.6us
I20260709 12:26:04.576431  3794 tablet_service.cc:1511] Processing CreateTablet for tablet 5ddc19e80d1e47bf9adba05e63b9c08f (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:04.577708  3794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ddc19e80d1e47bf9adba05e63b9c08f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.567576  3860 tablet_bootstrap.cc:654] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.581039  3579 tablet_service.cc:1511] Processing CreateTablet for tablet d9c8b4d97a9042d9b1a9a19db2bea177 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:04.581488  3574 tablet_service.cc:1511] Processing CreateTablet for tablet 44d49c090caa4686add867d8afd82314 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:04.582283  3579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c8b4d97a9042d9b1a9a19db2bea177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.582075  3576 tablet_service.cc:1511] Processing CreateTablet for tablet 9174b8f24cdc43588daa58f89f3e0b95 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:04.582895  3574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d49c090caa4686add867d8afd82314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.583796  3573 tablet_service.cc:1511] Processing CreateTablet for tablet f48164492db145fda737e65bbfc255f5 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:04.584985  3573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48164492db145fda737e65bbfc255f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.579698  3796 tablet_service.cc:1511] Processing CreateTablet for tablet 01be9c8eac8b49f581ef991385b23996 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:04.580231  3648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e2aa65e5fc4e0c9ba2625fea02a731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.592204  3724 tablet_service.cc:1511] Processing CreateTablet for tablet e29a6aaafab344e1b9259bb9803dba3e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:04.592998  3798 tablet_service.cc:1511] Processing CreateTablet for tablet 7d0f0423423342ecbdfe71d740533bf9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:04.593518  3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29a6aaafab344e1b9259bb9803dba3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.593359  3795 tablet_service.cc:1511] Processing CreateTablet for tablet f6816ad0fe10401d80c7d91e289708d6 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:04.594197  3576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9174b8f24cdc43588daa58f89f3e0b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.600440  3723 tablet_service.cc:1511] Processing CreateTablet for tablet 9174b8f24cdc43588daa58f89f3e0b95 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:04.596920  3856 ts_tablet_manager.cc:1434] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.084s	user 0.019s	sys 0.025s
I20260709 12:26:04.603279  3578 tablet_service.cc:1511] Processing CreateTablet for tablet 6420cbab7b6a413bb6a9a3bdc07aa918 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:04.603916  3763 heartbeater.cc:499] Master 127.29.9.62:34565 was elected leader, sending a full tablet report...
I20260709 12:26:04.604516  3856 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:04.612545  3858 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:04.613041  3858 ts_tablet_manager.cc:1403] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.294s	user 0.009s	sys 0.020s
I20260709 12:26:04.614130  3796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01be9c8eac8b49f581ef991385b23996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.618817  3858 raft_consensus.cc:359] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:04.619521  3858 raft_consensus.cc:385] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.619828  3858 raft_consensus.cc:740] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.621819  3857 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:04.622282  3857 ts_tablet_manager.cc:1403] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.478s	user 0.020s	sys 0.006s
I20260709 12:26:04.624965  3857 raft_consensus.cc:359] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:04.625576  3857 raft_consensus.cc:385] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.625847  3857 raft_consensus.cc:740] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.626616  3858 consensus_queue.cc:260] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:04.602233  3862 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.628023  3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d0f0423423342ecbdfe71d740533bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.632642  3862 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:04.635164  3862 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
W20260709 12:26:04.640378  3615 tablet.cc:2406] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:04.628041  3722 tablet_service.cc:1511] Processing CreateTablet for tablet 6abb36e32e6d4008818136af56869542 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:04.651190  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abb36e32e6d4008818136af56869542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.663712  3570 tablet_service.cc:1511] Processing CreateTablet for tablet 6abb36e32e6d4008818136af56869542 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:04.664229  3802 tablet_service.cc:1511] Processing CreateTablet for tablet 0f6c49b7c4db4f3fa1f03c887186ee66 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:04.665218  3570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abb36e32e6d4008818136af56869542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.667239  3800 tablet_service.cc:1511] Processing CreateTablet for tablet fd7b1d038f32403881c972fd7d51e402 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:04.668766  3722 tablet_service.cc:1511] Processing CreateTablet for tablet b7f9d51f74f24d96a2aa074b6ed09f7a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:04.669885  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9d51f74f24d96a2aa074b6ed09f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.678082  3723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9174b8f24cdc43588daa58f89f3e0b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.688261  3797 tablet_service.cc:1511] Processing CreateTablet for tablet d4576aeb4fdf46b0ab7c91d7b4389291 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:04.689402  3856 tablet_bootstrap.cc:654] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.684509  3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6816ad0fe10401d80c7d91e289708d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.705005  3578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6420cbab7b6a413bb6a9a3bdc07aa918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.706106  3837 heartbeater.cc:499] Master 127.29.9.62:34565 was elected leader, sending a full tablet report...
I20260709 12:26:04.711236  3799 tablet_service.cc:1511] Processing CreateTablet for tablet 99e2aa65e5fc4e0c9ba2625fea02a731 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:04.713575  3858 ts_tablet_manager.cc:1434] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.005s
I20260709 12:26:04.715835  3577 tablet_service.cc:1511] Processing CreateTablet for tablet b7f9d51f74f24d96a2aa074b6ed09f7a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:04.717315  3793 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfc6756ea0e486d869252fd8f102411 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:04.717608  3571 tablet_service.cc:1511] Processing CreateTablet for tablet a8d333d5c60842c09b47c5f9bbf9df39 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:04.728083  3727 tablet_service.cc:1511] Processing CreateTablet for tablet 5a18a9b9a99d401eba8bd3955ea7dbb1 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:04.729490  3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a18a9b9a99d401eba8bd3955ea7dbb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.736799  3858 tablet_bootstrap.cc:492] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:04.749234  3856 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:04.749856  3856 ts_tablet_manager.cc:1403] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.005s
I20260709 12:26:04.752758  3856 raft_consensus.cc:359] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:04.771394  3856 raft_consensus.cc:385] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.775494  3856 raft_consensus.cc:740] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.756224  3868 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.776156  3868 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:04.757134  3720 tablet_service.cc:1511] Processing CreateTablet for tablet a8d333d5c60842c09b47c5f9bbf9df39 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:04.762418  3860 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:04.658242  3857 consensus_queue.cc:260] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:04.705178  3474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 72895.4us
I20260709 12:26:04.767912  3719 tablet_service.cc:1511] Processing CreateTablet for tablet d9c8b4d97a9042d9b1a9a19db2bea177 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:04.759430  3647 tablet_service.cc:1511] Processing CreateTablet for tablet ac829ea617614c26806da188940d398d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:04.770373  3649 tablet_service.cc:1511] Processing CreateTablet for tablet 4399494b9fc14dc7989c328e016df504 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:04.770686  3579 tablet_service.cc:1511] Processing CreateTablet for tablet 7269c445625d4453bc9b0c141c5fb9c9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:04.753297  3726 tablet_service.cc:1511] Processing CreateTablet for tablet 1968be972d704af08e92759ec0557c1e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:04.754781  3858 tablet_bootstrap.cc:654] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:04.766140  3725 tablet_service.cc:1511] Processing CreateTablet for tablet 7269c445625d4453bc9b0c141c5fb9c9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:04.784430  3571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d333d5c60842c09b47c5f9bbf9df39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.783952  3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4576aeb4fdf46b0ab7c91d7b4389291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.797770  3575 tablet_service.cc:1511] Processing CreateTablet for tablet b52a9fcd5d784adaa61ed8592e34820a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:04.792830  3860 ts_tablet_manager.cc:1403] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.266s	user 0.011s	sys 0.035s
I20260709 12:26:04.804250  3646 tablet_service.cc:1511] Processing CreateTablet for tablet e29a6aaafab344e1b9259bb9803dba3e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:04.805917  3868 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:04.806380  3720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d333d5c60842c09b47c5f9bbf9df39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.776093  3654 tablet_service.cc:1511] Processing CreateTablet for tablet 3317f960c9084fd08c81267ec5ea37d6 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:04.814473  3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4399494b9fc14dc7989c328e016df504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.818187  3650 tablet_service.cc:1511] Processing CreateTablet for tablet 6420cbab7b6a413bb6a9a3bdc07aa918 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:04.826704  3570 tablet_service.cc:1511] Processing CreateTablet for tablet fae0cee41d4341debb2be23519d02ca9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:04.802341  3856 consensus_queue.cc:260] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:04.829492  3856 ts_tablet_manager.cc:1434] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.000s
I20260709 12:26:04.830459  3856 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:04.830667  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:04.836733  3726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1968be972d704af08e92759ec0557c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.840240  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7269c445625d4453bc9b0c141c5fb9c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:04.842319  3554 leader_election.cc:343] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:04.842602  3572 tablet_service.cc:1511] Processing CreateTablet for tablet 03376bd538eb41c399158480df7d762a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:04.853947  3647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac829ea617614c26806da188940d398d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.845245  3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e2aa65e5fc4e0c9ba2625fea02a731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.860056  3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfc6756ea0e486d869252fd8f102411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.821442  3577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9d51f74f24d96a2aa074b6ed09f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.829427  3652 tablet_service.cc:1511] Processing CreateTablet for tablet 44d49c090caa4686add867d8afd82314 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:04.871893  3574 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfe10809994448c8380df975eff45a9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:04.872663  3801 tablet_service.cc:1511] Processing CreateTablet for tablet 755d2f3e3f0a4ae7ba1f73aec0f49a2d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:04.876077  3874 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.876610  3874 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:04.878557  3573 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb7c71c819749338585b76d644d3a94 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:04.861747  3860 raft_consensus.cc:359] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:04.888422  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:04.889097  3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c8b4d97a9042d9b1a9a19db2bea177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.889322  3575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52a9fcd5d784adaa61ed8592e34820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.889117  3738 raft_consensus.cc:2468] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:04.880524  3860 raft_consensus.cc:385] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.891937  3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd7b1d038f32403881c972fd7d51e402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.899827  3555 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:04.901057  3653 tablet_service.cc:1511] Processing CreateTablet for tablet b52a9fcd5d784adaa61ed8592e34820a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:04.902524  3646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29a6aaafab344e1b9259bb9803dba3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.899588  3645 tablet_service.cc:1511] Processing CreateTablet for tablet 6abb36e32e6d4008818136af56869542 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:04.903138  3874 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:04.903831  3860 raft_consensus.cc:740] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.909245  3651 tablet_service.cc:1511] Processing CreateTablet for tablet 1968be972d704af08e92759ec0557c1e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:04.923115  3862 raft_consensus.cc:2804] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:04.917904  3573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb7c71c819749338585b76d644d3a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.906028  3794 tablet_service.cc:1511] Processing CreateTablet for tablet 4399494b9fc14dc7989c328e016df504 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:04.927598  3862 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.939949  3862 raft_consensus.cc:3060] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:04.948302  3857 ts_tablet_manager.cc:1434] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.326s	user 0.026s	sys 0.007s
I20260709 12:26:04.934518  3652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d49c090caa4686add867d8afd82314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.949790  3860 consensus_queue.cc:260] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:04.949335  3857 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:04.953086  3858 tablet_bootstrap.cc:492] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:04.953589  3858 ts_tablet_manager.cc:1403] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.217s	user 0.012s	sys 0.014s
I20260709 12:26:04.955024  3796 tablet_service.cc:1511] Processing CreateTablet for tablet ac829ea617614c26806da188940d398d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:04.956452  3858 raft_consensus.cc:359] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:04.957167  3858 raft_consensus.cc:385] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:04.957441  3858 raft_consensus.cc:740] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:04.958168  3858 consensus_queue.cc:260] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:04.960222  3858 ts_tablet_manager.cc:1434] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:04.961174  3858 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:04.963764  3728 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfe10809994448c8380df975eff45a9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:04.964427  3724 tablet_service.cc:1511] Processing CreateTablet for tablet 03376bd538eb41c399158480df7d762a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:04.965026  3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfe10809994448c8380df975eff45a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.965600  3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03376bd538eb41c399158480df7d762a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.966742  3862 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:04.951202  3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755d2f3e3f0a4ae7ba1f73aec0f49a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.970742  3654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3317f960c9084fd08c81267ec5ea37d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.976549  3794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4399494b9fc14dc7989c328e016df504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.978281  3796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac829ea617614c26806da188940d398d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.980012  3650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6420cbab7b6a413bb6a9a3bdc07aa918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.971167  3574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfe10809994448c8380df975eff45a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.971398  3721 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb7c71c819749338585b76d644d3a94 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:04.981551  3721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb7c71c819749338585b76d644d3a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.982038  3798 tablet_service.cc:1511] Processing CreateTablet for tablet 1968be972d704af08e92759ec0557c1e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:04.983403  3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1968be972d704af08e92759ec0557c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.984051  3579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7269c445625d4453bc9b0c141c5fb9c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.988052  3570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae0cee41d4341debb2be23519d02ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.989014  3571 tablet_service.cc:1511] Processing CreateTablet for tablet ea70a27e95854669a0da5bb76b24e632 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:04.990236  3571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea70a27e95854669a0da5bb76b24e632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.995988  3651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1968be972d704af08e92759ec0557c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.996969  3576 tablet_service.cc:1511] Processing CreateTablet for tablet c09f7a90ab1c4f1b903c1c9b34494a93 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:04.998286  3576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09f7a90ab1c4f1b903c1c9b34494a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.971398  3722 tablet_service.cc:1511] Processing CreateTablet for tablet e7588d8d55964d0b898b81d0d67ed9ec (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:04.999621  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7588d8d55964d0b898b81d0d67ed9ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.000437  3648 tablet_service.cc:1511] Processing CreateTablet for tablet d9c8b4d97a9042d9b1a9a19db2bea177 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:05.013566  3862 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:05.015125  3645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6abb36e32e6d4008818136af56869542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.019438  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:05.020080  3738 raft_consensus.cc:3060] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.023962  3572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03376bd538eb41c399158480df7d762a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.013500  3857 tablet_bootstrap.cc:654] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.026973  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:05.028358  3648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c8b4d97a9042d9b1a9a19db2bea177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.029033  3793 tablet_service.cc:1511] Processing CreateTablet for tablet 25f1c4fb6ccb4909b6ed39a42499e6c4 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 12:26:05.032653  3554 leader_election.cc:343] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.029891  3647 tablet_service.cc:1511] Processing CreateTablet for tablet f48164492db145fda737e65bbfc255f5 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:05.035005  3720 tablet_service.cc:1511] Processing CreateTablet for tablet f54877140907478b8976ce4a6698da2e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:05.030371  3856 tablet_bootstrap.cc:654] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.036226  3720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54877140907478b8976ce4a6698da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.035395  3647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48164492db145fda737e65bbfc255f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.056025  3653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52a9fcd5d784adaa61ed8592e34820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.064656  3860 ts_tablet_manager.cc:1434] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.262s	user 0.015s	sys 0.000s
I20260709 12:26:05.065681  3860 tablet_bootstrap.cc:492] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:05.066809  3738 raft_consensus.cc:2468] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:05.068055  3555 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:05.068866  3862 raft_consensus.cc:2804] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.069373  3862 raft_consensus.cc:697] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:05.070143  3862 consensus_queue.cc:237] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.070565  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:05.051563  3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f6c49b7c4db4f3fa1f03c887186ee66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.079885  3883 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.080405  3883 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.084299  3883 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:05.092242  3872 raft_consensus.cc:493] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.092736  3872 raft_consensus.cc:515] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.095072  3872 leader_election.cc:290] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.097436  3727 tablet_service.cc:1511] Processing CreateTablet for tablet 0d268ccfd8994a26a344654a181b615d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:05.105775  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:05.107913  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:05.108793  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:05.109660  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:05.069000  3575 tablet_service.cc:1511] Processing CreateTablet for tablet 38d4a07cbac64bc1b4cfa2f52f4e4808 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:05.121186  3575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d4a07cbac64bc1b4cfa2f52f4e4808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.122792  3858 tablet_bootstrap.cc:654] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.124364  3589 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:05.126253  3627 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:05.127146  3872 raft_consensus.cc:2804] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.127501  3872 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.127832  3872 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:05.129616  3703 leader_election.cc:343] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.130105  3703 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:05.131354  3875 raft_consensus.cc:2749] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.132004  3725 tablet_service.cc:1511] Processing CreateTablet for tablet c09f7a90ab1c4f1b903c1c9b34494a93 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:05.133351  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09f7a90ab1c4f1b903c1c9b34494a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.137012  3857 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:05.137511  3857 ts_tablet_manager.cc:1403] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.005s
I20260709 12:26:05.091296  3799 tablet_service.cc:1511] Processing CreateTablet for tablet 44d49c090caa4686add867d8afd82314 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:05.148610  3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44d49c090caa4686add867d8afd82314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.153988  3801 tablet_service.cc:1511] Processing CreateTablet for tablet 9174b8f24cdc43588daa58f89f3e0b95 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:05.155603  3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9174b8f24cdc43588daa58f89f3e0b95. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:05.160598  3628 leader_election.cc:343] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.161038  3473 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 69068.3us
I20260709 12:26:05.161947  3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d268ccfd8994a26a344654a181b615d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.169869  3797 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 16) took 1018 ms. Trace:
I20260709 12:26:05.172071  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:05.175567  3797 rpcz_store.cc:276] 0709 12:26:04.151215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.687353 (+536138us) service_pool.cc:224] Handling call
0709 12:26:04.689125 (+  1772us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.689210 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.121087 (+431877us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.154727 (+ 33640us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.169810 (+ 15083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.177704  3797 tablet_service.cc:1511] Processing CreateTablet for tablet e29a6aaafab344e1b9259bb9803dba3e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:05.178918  3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29a6aaafab344e1b9259bb9803dba3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.163239  3577 tablet_service.cc:1511] Processing CreateTablet for tablet f54877140907478b8976ce4a6698da2e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 12:26:05.161331  3628 leader_election.cc:343] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.185015  3630 leader_election.cc:343] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.185462  3630 leader_election.cc:304] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:05.185983  3860 tablet_bootstrap.cc:654] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.186496  3868 raft_consensus.cc:2749] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.181090  3577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54877140907478b8976ce4a6698da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.089213  3653 tablet_service.cc:1511] Processing CreateTablet for tablet 5a18a9b9a99d401eba8bd3955ea7dbb1 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:05.179697  3650 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55528 (request call id 24) took 1001 ms. Trace:
W20260709 12:26:05.193012  3472 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 73178.8us
I20260709 12:26:05.163323  3652 tablet_service.cc:1511] Processing CreateTablet for tablet 7269c445625d4453bc9b0c141c5fb9c9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:05.198375  3794 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 20) took 1030 ms. Trace:
W20260709 12:26:05.193185  3474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 76128.7us
I20260709 12:26:05.193297  3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f1c4fb6ccb4909b6ed39a42499e6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.192159  3857 raft_consensus.cc:359] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.209743  3798 tablet_service.cc:1511] Processing CreateTablet for tablet b52a9fcd5d784adaa61ed8592e34820a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:05.215124  3486 catalog_manager.cc:5697] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.219565  3646 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55528 (request call id 26) took 1041 ms. Trace:
I20260709 12:26:05.221171  3856 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.223392  3645 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55528 (request call id 27) took 1044 ms. Trace:
I20260709 12:26:05.265429  3856 ts_tablet_manager.cc:1403] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.435s	user 0.015s	sys 0.007s
I20260709 12:26:05.265650  3645 rpcz_store.cc:276] 0709 12:26:04.178787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.898732 (+719945us) service_pool.cc:224] Handling call
0709 12:26:04.926958 (+ 28226us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.927088 (+   130us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.063523 (+136435us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.222916 (+159393us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.223336 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.228737  3575 tablet_service.cc:1511] Processing CreateTablet for tablet b5581ff41a8b438693f2fd8942489f74 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:05.268371  3856 raft_consensus.cc:359] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.269495  3856 raft_consensus.cc:385] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.231282  3652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7269c445625d4453bc9b0c141c5fb9c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.237473  3724 tablet_service.cc:1511] Processing CreateTablet for tablet b81d335504724d14bafd66069e9ab3f8 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:05.269853  3856 raft_consensus.cc:740] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.270699  3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81d335504724d14bafd66069e9ab3f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.238901  3722 tablet_service.cc:1511] Processing CreateTablet for tablet 80f5bd7b84f64e9c9817b9f7cfbe9928 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:05.236660  3719 tablet_service.cc:1511] Processing CreateTablet for tablet 0e54ed26c20349f49856c2fcbc57dfdd (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:05.243043  3872 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.270738  3856 consensus_queue.cc:260] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.241223  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:05.244489  3654 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55528 (request call id 23) took 1068 ms. Trace:
I20260709 12:26:05.272830  3872 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:05.226393  3794 rpcz_store.cc:276] 0709 12:26:04.168417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.859125 (+690708us) service_pool.cc:224] Handling call
0709 12:26:04.938677 (+ 79552us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.938806 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.032553 (+ 93747us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.194977 (+162424us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.198316 (+  3339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.273257  3856 ts_tablet_manager.cc:1434] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:05.273967  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:05.274241  3856 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.274719  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:05.275260  3589 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.276881  3794 tablet_service.cc:1511] Processing CreateTablet for tablet b7f9d51f74f24d96a2aa074b6ed09f7a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:26:05.278134  3628 leader_election.cc:343] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.280368  3793 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 22) took 1111 ms. Trace:
I20260709 12:26:05.280797  3793 rpcz_store.cc:276] 0709 12:26:04.168969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.006808 (+837839us) service_pool.cc:224] Handling call
0709 12:26:05.030857 (+ 24049us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:05.030943 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.258349 (+227406us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.279839 (+ 21490us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.280312 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.282684  3648 tablet_service.cc:1511] Processing CreateTablet for tablet 0d268ccfd8994a26a344654a181b615d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:05.276772  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:05.283627  3793 tablet_service.cc:1511] Processing CreateTablet for tablet f48164492db145fda737e65bbfc255f5 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:05.284256  3578 tablet_service.cc:1511] Processing CreateTablet for tablet b81d335504724d14bafd66069e9ab3f8 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:05.271833  3654 rpcz_store.cc:276] 0709 12:26:04.175654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.775197 (+599543us) service_pool.cc:224] Handling call
0709 12:26:04.898143 (+122946us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5800553e98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508e9c 00007f032d508a5b 00007f03364218d9 00007f033557bee0 00007f0335661831 00007f033563eac3 00007f03355ed400 00007f032ea72af4 00007f032ea72a82 00007f032ea729b1
0709 12:26:04.907935 (+  9792us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.920139 (+ 12204us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.037536 (+117397us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.244043 (+206507us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.244432 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7510784}
I20260709 12:26:05.241842  3647 tablet_service.cc:1511] Processing CreateTablet for tablet fae0cee41d4341debb2be23519d02ca9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:05.197798  3650 rpcz_store.cc:276] 0709 12:26:04.177941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.781613 (+603672us) service_pool.cc:224] Handling call
0709 12:26:04.902210 (+120597us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.902363 (+   153us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.128510 (+226147us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.179197 (+ 50687us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.179643 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.226353  3802 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 14) took 1075 ms. Trace:
I20260709 12:26:05.261205  3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52a9fcd5d784adaa61ed8592e34820a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.262795  3646 rpcz_store.cc:276] 0709 12:26:04.178515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.803382 (+624867us) service_pool.cc:224] Handling call
0709 12:26:04.902048 (+ 98666us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.902174 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.048693 (+146519us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.183937 (+135244us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.219507 (+ 35570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.226019  3649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55528 (request call id 20) took 1051 ms. Trace:
I20260709 12:26:05.261366  3857 raft_consensus.cc:385] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.269567  3575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5581ff41a8b438693f2fd8942489f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.287379  3654 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfe10809994448c8380df975eff45a9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:05.251323  3800 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 15) took 1100 ms. Trace:
I20260709 12:26:05.291913  3722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f5bd7b84f64e9c9817b9f7cfbe9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.280586  3571 tablet_service.cc:1511] Processing CreateTablet for tablet 0e54ed26c20349f49856c2fcbc57dfdd (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 12:26:05.281157  3777 leader_election.cc:343] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.295882  3719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e54ed26c20349f49856c2fcbc57dfdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.294303  3857 raft_consensus.cc:740] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.297706  3794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f9d51f74f24d96a2aa074b6ed09f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.298812  3858 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:05.299333  3858 ts_tablet_manager.cc:1403] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.338s	user 0.010s	sys 0.001s
I20260709 12:26:05.299995  3571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e54ed26c20349f49856c2fcbc57dfdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.303903  3648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d268ccfd8994a26a344654a181b615d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.263011  3795 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 13) took 1111 ms. Trace:
I20260709 12:26:05.305402  3856 tablet_bootstrap.cc:654] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.305184  3650 tablet_service.cc:1511] Processing CreateTablet for tablet ea70a27e95854669a0da5bb76b24e632 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:05.304870  3857 consensus_queue.cc:260] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.293583  3649 rpcz_store.cc:276] 0709 12:26:04.174759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.769509 (+594750us) service_pool.cc:224] Handling call
0709 12:26:04.808905 (+ 39396us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.814107 (+  5202us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.009074 (+194967us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.193452 (+184378us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.225964 (+ 32512us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:05.306836  3775 leader_election.cc:343] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.308370  3649 tablet_service.cc:1511] Processing CreateTablet for tablet c09f7a90ab1c4f1b903c1c9b34494a93 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:05.309149  3775 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:05.310081  3884 raft_consensus.cc:2749] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.311373  3651 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55528 (request call id 29) took 1132 ms. Trace:
I20260709 12:26:05.295558  3800 rpcz_store.cc:276] 0709 12:26:04.150946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.666390 (+515444us) service_pool.cc:224] Handling call
0709 12:26:04.668015 (+  1625us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.668105 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.204694 (+536589us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.250826 (+ 46132us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.251267 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.313151  3578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81d335504724d14bafd66069e9ab3f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.304450  3795 rpcz_store.cc:276] 0709 12:26:04.150357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.592542 (+442185us) service_pool.cc:224] Handling call
0709 12:26:04.594217 (+  1675us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.594299 (+    82us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.135436 (+541137us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.239336 (+103900us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.261664 (+ 22328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.315642  3857 ts_tablet_manager.cc:1434] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.178s	user 0.009s	sys 0.005s
I20260709 12:26:05.292053  3802 rpcz_store.cc:276] 0709 12:26:04.150672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.659210 (+508538us) service_pool.cc:224] Handling call
0709 12:26:04.665129 (+  5919us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.665215 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.199274 (+534059us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.225894 (+ 26620us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.226300 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.318166  3650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea70a27e95854669a0da5bb76b24e632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.318774  3647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae0cee41d4341debb2be23519d02ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.319057  3802 tablet_service.cc:1511] Processing CreateTablet for tablet 5a18a9b9a99d401eba8bd3955ea7dbb1 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:05.320325  3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a18a9b9a99d401eba8bd3955ea7dbb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.320709  3800 tablet_service.cc:1511] Processing CreateTablet for tablet fae0cee41d4341debb2be23519d02ca9 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:05.321862  3800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae0cee41d4341debb2be23519d02ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.323200  3651 rpcz_store.cc:276] 0709 12:26:04.179317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.903295 (+723978us) service_pool.cc:224] Handling call
0709 12:26:04.927455 (+ 24160us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.932709 (+  5254us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.167477 (+234768us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.310861 (+143384us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.311318 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.325742  3651 tablet_service.cc:1511] Processing CreateTablet for tablet 38d4a07cbac64bc1b4cfa2f52f4e4808 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:26:05.326725  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:05.326912  3651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d4a07cbac64bc1b4cfa2f52f4e4808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.317600  3796 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 21) took 1149 ms. Trace:
I20260709 12:26:05.306301  3645 tablet_service.cc:1511] Processing CreateTablet for tablet e7588d8d55964d0b898b81d0d67ed9ec (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:05.340485  3646 tablet_service.cc:1511] Processing CreateTablet for tablet 80f5bd7b84f64e9c9817b9f7cfbe9928 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:05.342607  3589 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:05.331686  3799 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 24) took 1082 ms. Trace:
I20260709 12:26:05.344004  3627 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:05.344888  3872 raft_consensus.cc:2804] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.345395  3872 raft_consensus.cc:697] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:05.346203  3872 consensus_queue.cc:237] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.344405  3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48164492db145fda737e65bbfc255f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.331566  3796 rpcz_store.cc:276] 0709 12:26:04.168697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.954128 (+785431us) service_pool.cc:224] Handling call
0709 12:26:04.977827 (+ 23699us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:04.977946 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.169950 (+192004us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.317122 (+147172us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.317544 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.317649  3795 tablet_service.cc:1511] Processing CreateTablet for tablet a8d333d5c60842c09b47c5f9bbf9df39 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:05.343904  3799 rpcz_store.cc:276] 0709 12:26:04.266740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.090430 (+823690us) service_pool.cc:224] Handling call
0709 12:26:05.148124 (+ 57694us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:05.148219 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.231388 (+ 83169us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.313926 (+ 82538us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.330264 (+ 16338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.351145  3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d333d5c60842c09b47c5f9bbf9df39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.352305  3799 tablet_service.cc:1511] Processing CreateTablet for tablet 03376bd538eb41c399158480df7d762a (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:05.353542  3799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03376bd538eb41c399158480df7d762a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.355469  3857 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:05.357064  3649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09f7a90ab1c4f1b903c1c9b34494a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.357681  3645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7588d8d55964d0b898b81d0d67ed9ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.362248  3646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f5bd7b84f64e9c9817b9f7cfbe9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.363909  3654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfe10809994448c8380df975eff45a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.365753  3796 tablet_service.cc:1511] Processing CreateTablet for tablet 0d268ccfd8994a26a344654a181b615d (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:05.367115  3796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d268ccfd8994a26a344654a181b615d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.367673  3653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a18a9b9a99d401eba8bd3955ea7dbb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.369256  3858 raft_consensus.cc:359] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.372156  3858 raft_consensus.cc:385] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.372525  3858 raft_consensus.cc:740] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.392926  3860 tablet_bootstrap.cc:492] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:05.393510  3860 ts_tablet_manager.cc:1403] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.328s	user 0.017s	sys 0.009s
W20260709 12:26:05.395912  3472 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 47263.1us
W20260709 12:26:05.406049  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 62147.1us
I20260709 12:26:05.409162  3856 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.409709  3856 ts_tablet_manager.cc:1403] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.136s	user 0.007s	sys 0.008s
I20260709 12:26:05.435110  3858 consensus_queue.cc:260] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.442888  3794 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 28) took 1174 ms. Trace:
I20260709 12:26:05.458566  3794 rpcz_store.cc:276] 0709 12:26:04.268068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.275969 (+1007901us) service_pool.cc:224] Handling call
0709 12:26:05.277694 (+  1725us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:05.277776 (+    82us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.336101 (+ 58325us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.442377 (+106276us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.442822 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.460167  3860 raft_consensus.cc:359] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.460877  3860 raft_consensus.cc:385] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.444312  3797 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 26) took 1176 ms. Trace:
I20260709 12:26:05.461149  3860 raft_consensus.cc:740] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.449792  3651 tablet_service.cc:1511] Processing CreateTablet for tablet b81d335504724d14bafd66069e9ab3f8 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:05.454453  3801 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 25) took 1187 ms. Trace:
I20260709 12:26:05.449792  3652 tablet_service.cc:1511] Processing CreateTablet for tablet b5581ff41a8b438693f2fd8942489f74 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:05.461355  3797 rpcz_store.cc:276] 0709 12:26:04.267452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.176709 (+909257us) service_pool.cc:224] Handling call
0709 12:26:05.178470 (+  1761us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:05.178562 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.287138 (+108576us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.443816 (+156678us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.444258 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.465888  3652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5581ff41a8b438693f2fd8942489f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.466900  3797 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb7c71c819749338585b76d644d3a94 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:05.468214  3860 consensus_queue.cc:260] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.461268  3485 catalog_manager.cc:5697] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.470722  3794 tablet_service.cc:1511] Processing CreateTablet for tablet ea70a27e95854669a0da5bb76b24e632 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:05.471894  3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb7c71c819749338585b76d644d3a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.473582  3801 rpcz_store.cc:276] 0709 12:26:04.267131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.153026 (+885895us) service_pool.cc:224] Handling call
0709 12:26:05.155112 (+  2086us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:05.155224 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.333809 (+178585us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.453990 (+120181us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.454396 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.470301  3860 ts_tablet_manager.cc:1434] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.001s
I20260709 12:26:05.480404  3857 tablet_bootstrap.cc:654] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.480866  3802 tablet_service.cc:1511] Processing CreateTablet for tablet e7588d8d55964d0b898b81d0d67ed9ec (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:05.482195  3802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7588d8d55964d0b898b81d0d67ed9ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.488265  3794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea70a27e95854669a0da5bb76b24e632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.494756  3856 raft_consensus.cc:359] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.497825  3860 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:05.495550  3856 raft_consensus.cc:385] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.499680  3856 raft_consensus.cc:740] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.501555  3801 tablet_service.cc:1511] Processing CreateTablet for tablet 38d4a07cbac64bc1b4cfa2f52f4e4808 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:05.502928  3801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d4a07cbac64bc1b4cfa2f52f4e4808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.514720  3858 ts_tablet_manager.cc:1434] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.215s	user 0.009s	sys 0.003s
I20260709 12:26:05.515885  3858 tablet_bootstrap.cc:492] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
W20260709 12:26:05.518553  3554 consensus_peers.cc:597] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.520092  3793 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 30) took 1035 ms. Trace:
I20260709 12:26:05.520474  3793 rpcz_store.cc:276] 0709 12:26:04.490968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.282771 (+791803us) service_pool.cc:224] Handling call
0709 12:26:05.284508 (+  1737us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:05.284600 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.453511 (+168911us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.519620 (+ 66109us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.520037 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.522272  3793 tablet_service.cc:1511] Processing CreateTablet for tablet f54877140907478b8976ce4a6698da2e (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:05.523310  3651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81d335504724d14bafd66069e9ab3f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.523375  3793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f54877140907478b8976ce4a6698da2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.528333  3856 consensus_queue.cc:260] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.522718  3798 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36590 (request call id 27) took 1255 ms. Trace:
I20260709 12:26:05.530016  3798 rpcz_store.cc:276] 0709 12:26:04.267759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.208899 (+941140us) service_pool.cc:224] Handling call
0709 12:26:05.260735 (+ 51836us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:05.260831 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:05.397365 (+136534us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:05.522254 (+124889us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:05.522651 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:05.530215  3795 tablet_service.cc:1511] Processing CreateTablet for tablet 80f5bd7b84f64e9c9817b9f7cfbe9928 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:05.533820  3856 ts_tablet_manager.cc:1434] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.000s
I20260709 12:26:05.534060  3795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f5bd7b84f64e9c9817b9f7cfbe9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.536739  3798 tablet_service.cc:1511] Processing CreateTablet for tablet b5581ff41a8b438693f2fd8942489f74 (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:05.537739  3797 tablet_service.cc:1511] Processing CreateTablet for tablet 0e54ed26c20349f49856c2fcbc57dfdd (DEFAULT_TABLE table=test-workload [id=ceaea9f2e1d2452582004dc18ecf48e9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:05.544749  3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5581ff41a8b438693f2fd8942489f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.545517  3856 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.549057  3860 tablet_bootstrap.cc:654] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.551878  3797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e54ed26c20349f49856c2fcbc57dfdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.553035  3858 tablet_bootstrap.cc:654] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.556367  3857 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:05.556874  3857 ts_tablet_manager.cc:1403] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.223s	user 0.013s	sys 0.001s
I20260709 12:26:05.560257  3857 raft_consensus.cc:359] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.561452  3857 raft_consensus.cc:385] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.561759  3857 raft_consensus.cc:740] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.563002  3857 consensus_queue.cc:260] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.564600  3856 tablet_bootstrap.cc:654] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.569859  3856 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.570326  3856 ts_tablet_manager.cc:1403] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 12:26:05.571588  3857 ts_tablet_manager.cc:1434] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:26:05.573298  3856 raft_consensus.cc:359] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.573979  3856 raft_consensus.cc:385] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.574244  3856 raft_consensus.cc:740] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.574945  3856 consensus_queue.cc:260] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.577250  3856 ts_tablet_manager.cc:1434] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:05.578238  3856 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.583992  3856 tablet_bootstrap.cc:654] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.587630  3857 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:05.593226  3862 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.593731  3862 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.594959  3856 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.595489  3856 ts_tablet_manager.cc:1403] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:26:05.595800  3862 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:05.598093  3858 tablet_bootstrap.cc:492] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:05.598563  3858 ts_tablet_manager.cc:1403] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.005s
I20260709 12:26:05.598340  3856 raft_consensus.cc:359] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.598984  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:05.599058  3856 raft_consensus.cc:385] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.597880  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:05.599612  3856 raft_consensus.cc:740] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
W20260709 12:26:05.600906  3554 leader_election.cc:343] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.600737  3856 consensus_queue.cc:260] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.599676  3738 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:05.602636  3555 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:05.602991  3856 ts_tablet_manager.cc:1434] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:26:05.603945  3872 raft_consensus.cc:493] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.604270  3856 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.604486  3872 raft_consensus.cc:515] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.604099  3862 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.605677  3862 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.606005  3862 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.606477  3872 leader_election.cc:290] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.608284  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:05.608526  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:05.608947  3589 raft_consensus.cc:2468] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:05.609906  3627 leader_election.cc:304] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:05.610860  3628 leader_election.cc:343] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.611747  3872 raft_consensus.cc:2804] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.612181  3872 raft_consensus.cc:493] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.612550  3856 tablet_bootstrap.cc:654] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.612566  3872 raft_consensus.cc:3060] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.601370  3858 raft_consensus.cc:359] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.614629  3858 raft_consensus.cc:385] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.615010  3858 raft_consensus.cc:740] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.615836  3858 consensus_queue.cc:260] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.620038  3872 raft_consensus.cc:515] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.620541  3862 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.622936  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:05.623430  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:05.623515  3589 raft_consensus.cc:3060] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.623909  3868 raft_consensus.cc:493] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.624082  3738 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.624398  3868 raft_consensus.cc:515] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.626367  3868 leader_election.cc:290] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:05.627867  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:05.629272  3630 leader_election.cc:343] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.630594  3738 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:05.630843  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:05.595827  3860 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
W20260709 12:26:05.632393  3628 leader_election.cc:343] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.632902  3628 leader_election.cc:304] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:05.633409  3555 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:05.634003  3868 raft_consensus.cc:2749] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.635612  3589 raft_consensus.cc:2468] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:05.636862  3627 leader_election.cc:304] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:05.637789  3868 raft_consensus.cc:2804] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.639195  3858 ts_tablet_manager.cc:1434] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:26:05.641497  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:05.642215  3857 tablet_bootstrap.cc:654] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.632436  3860 ts_tablet_manager.cc:1403] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.004s
I20260709 12:26:05.644497  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:05.645383  3860 raft_consensus.cc:359] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.646070  3860 raft_consensus.cc:385] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.646385  3860 raft_consensus.cc:740] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
W20260709 12:26:05.646487  3628 leader_election.cc:343] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.647233  3554 leader_election.cc:343] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.647852  3872 leader_election.cc:290] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.649695  3862 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:05.641470  3903 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.650915  3903 raft_consensus.cc:697] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:05.652338  3903 consensus_queue.cc:237] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.653095  3858 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:05.654568  3868 raft_consensus.cc:697] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:05.656445  3868 consensus_queue.cc:237] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.657058  3905 consensus_queue.cc:1048] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:05.658149  3857 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:05.663357  3858 tablet_bootstrap.cc:654] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.663623  3857 ts_tablet_manager.cc:1403] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.000s
I20260709 12:26:05.657902  3860 consensus_queue.cc:260] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.666622  3857 raft_consensus.cc:359] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.667333  3857 raft_consensus.cc:385] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.667621  3857 raft_consensus.cc:740] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.672631  3860 ts_tablet_manager.cc:1434] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:26:05.673822  3860 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:05.675431  3857 consensus_queue.cc:260] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.681061  3858 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:05.681643  3858 ts_tablet_manager.cc:1403] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 12:26:05.681700  3856 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.682392  3856 ts_tablet_manager.cc:1403] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.078s	user 0.031s	sys 0.039s
I20260709 12:26:05.684329  3857 ts_tablet_manager.cc:1434] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:05.685390  3856 raft_consensus.cc:359] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.686228  3856 raft_consensus.cc:385] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.685443  3857 tablet_bootstrap.cc:492] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:05.686533  3856 raft_consensus.cc:740] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.687433  3856 consensus_queue.cc:260] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.688966  3858 raft_consensus.cc:359] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.687295  3486 catalog_manager.cc:5697] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.690078  3858 raft_consensus.cc:385] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.690455  3858 raft_consensus.cc:740] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.689709  3856 ts_tablet_manager.cc:1434] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:05.691336  3858 consensus_queue.cc:260] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.692654  3856 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.692874  3875 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.693380  3875 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.694144  3858 ts_tablet_manager.cc:1434] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:05.695261  3858 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:05.695832  3857 tablet_bootstrap.cc:654] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.698493  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:05.699136  3856 tablet_bootstrap.cc:654] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.699185  3589 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:05.701041  3701 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:05.705621  3858 tablet_bootstrap.cc:654] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.712626  3875 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.713300  3875 raft_consensus.cc:2804] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.713718  3875 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.714107  3875 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.715986  3857 tablet_bootstrap.cc:492] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:05.716498  3857 ts_tablet_manager.cc:1403] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.006s
I20260709 12:26:05.717072  3858 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:05.717602  3858 ts_tablet_manager.cc:1403] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.008s
I20260709 12:26:05.719411  3857 raft_consensus.cc:359] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.720556  3858 raft_consensus.cc:359] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.721266  3858 raft_consensus.cc:385] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.721490  3858 raft_consensus.cc:740] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.722204  3858 consensus_queue.cc:260] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.722920  3856 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.723387  3856 ts_tablet_manager.cc:1403] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.016s
I20260709 12:26:05.720599  3857 raft_consensus.cc:385] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.723914  3857 raft_consensus.cc:740] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.723862  3868 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.724893  3868 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.725838  3858 ts_tablet_manager.cc:1434] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:26:05.726248  3856 raft_consensus.cc:359] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.726819  3858 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:05.726945  3856 raft_consensus.cc:385] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.727340  3856 raft_consensus.cc:740] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.728019  3856 consensus_queue.cc:260] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.728538  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:05.718986  3485 catalog_manager.cc:5697] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.729995  3856 ts_tablet_manager.cc:1434] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:05.730898  3856 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.724671  3857 consensus_queue.cc:260] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.732972  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:05.733811  3857 ts_tablet_manager.cc:1434] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:26:05.734773  3857 tablet_bootstrap.cc:492] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:05.736008  3856 tablet_bootstrap.cc:654] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.726961  3868 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:05.741181  3857 tablet_bootstrap.cc:654] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.745082  3858 tablet_bootstrap.cc:654] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.734665  3627 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:05.746443  3868 raft_consensus.cc:2749] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.759123  3875 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.760267  3857 tablet_bootstrap.cc:492] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:05.760732  3857 ts_tablet_manager.cc:1403] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 12:26:05.763132  3875 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.765496  3856 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.766001  3856 ts_tablet_manager.cc:1403] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.007s
I20260709 12:26:05.767103  3858 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:05.767588  3858 ts_tablet_manager.cc:1403] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.010s
I20260709 12:26:05.768721  3856 raft_consensus.cc:359] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.769449  3856 raft_consensus.cc:385] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.769770  3856 raft_consensus.cc:740] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.770475  3856 consensus_queue.cc:260] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:05.762226  3701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 61452.5us
I20260709 12:26:05.772553  3856 ts_tablet_manager.cc:1434] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:05.773828  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:05.774386  3589 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.772207  3857 raft_consensus.cc:359] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.775024  3857 raft_consensus.cc:385] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.775339  3857 raft_consensus.cc:740] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.776049  3857 consensus_queue.cc:260] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.778098  3857 ts_tablet_manager.cc:1434] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:26:05.779026  3857 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:05.770313  3858 raft_consensus.cc:359] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.781781  3858 raft_consensus.cc:385] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.782086  3858 raft_consensus.cc:740] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.768671  3860 tablet_bootstrap.cc:654] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.783034  3589 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:05.783643  3858 consensus_queue.cc:260] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.784371  3856 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.785912  3858 ts_tablet_manager.cc:1434] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:26:05.792107  3856 tablet_bootstrap.cc:654] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.792619  3858 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:05.794857  3701 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:05.795969  3914 raft_consensus.cc:2804] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.796859  3914 raft_consensus.cc:697] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:05.797816  3914 consensus_queue.cc:237] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.798647  3858 tablet_bootstrap.cc:654] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.800377  3903 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.800905  3903 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.804291  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:05.804967  3664 raft_consensus.cc:2468] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:05.806286  3554 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:05.807226  3862 raft_consensus.cc:2804] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.807581  3862 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.808038  3862 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.808144  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:05.810951  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:05.812011  3903 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:05.814035  3875 raft_consensus.cc:493] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.814548  3875 raft_consensus.cc:515] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.816660  3875 leader_election.cc:290] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.816430  3862 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.818418  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:05.819401  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:05.820062  3663 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:05.819934  3703 leader_election.cc:343] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.821456  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:05.824012  3702 leader_election.cc:343] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.825047  3702 leader_election.cc:343] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.826776  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:05.824116  3903 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.827447  3812 raft_consensus.cc:2468] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:05.827764  3903 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.833323  3903 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.834789  3663 raft_consensus.cc:2468] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:05.800909  3857 tablet_bootstrap.cc:654] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.839790  3554 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:05.840663  3903 raft_consensus.cc:2804] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.841518  3903 raft_consensus.cc:697] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:05.842402  3903 consensus_queue.cc:237] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:05.845302  3555 leader_election.cc:343] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.846985  3862 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:05.852939  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:05.853529  3856 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.854055  3856 ts_tablet_manager.cc:1403] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.070s	user 0.029s	sys 0.029s
I20260709 12:26:05.853996  3702 leader_election.cc:304] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:05.854888  3914 raft_consensus.cc:2804] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.855257  3914 raft_consensus.cc:493] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.855732  3914 raft_consensus.cc:3060] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.856047  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:05.857090  3856 raft_consensus.cc:359] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:05.857548  3553 leader_election.cc:343] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.856920  3484 catalog_manager.cc:5697] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.857818  3856 raft_consensus.cc:385] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.858295  3856 raft_consensus.cc:740] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.858955  3856 consensus_queue.cc:260] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.860164  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:05.860841  3738 raft_consensus.cc:2468] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:05.861361  3856 ts_tablet_manager.cc:1434] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:05.862264  3856 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.863196  3914 raft_consensus.cc:515] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.865846  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:05.859465  3485 catalog_manager.cc:5697] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:05.868929  3555 leader_election.cc:343] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.869336  3703 leader_election.cc:343] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.869815  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:05.869926  3555 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:05.870426  3812 raft_consensus.cc:3060] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.871860  3856 tablet_bootstrap.cc:654] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.872682  3914 leader_election.cc:290] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.871963  3903 raft_consensus.cc:2804] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:05.875686  3903 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.876044  3903 raft_consensus.cc:3060] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.882251  3862 raft_consensus.cc:493] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.882791  3862 raft_consensus.cc:515] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.884919  3862 leader_election.cc:290] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.887111  3812 raft_consensus.cc:2468] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:05.888238  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:05.888290  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:05.889798  3555 leader_election.cc:343] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.890048  3702 leader_election.cc:304] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:05.890885  3914 raft_consensus.cc:2804] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.891381  3914 raft_consensus.cc:697] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
W20260709 12:26:05.891598  3553 leader_election.cc:343] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:05.892935  3628 consensus_peers.cc:597] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.892241  3914 consensus_queue.cc:237] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:05.893989  3553 leader_election.cc:304] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:05.895138  3862 raft_consensus.cc:2749] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:05.893432  3903 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.898039  3857 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:05.898528  3857 ts_tablet_manager.cc:1403] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.120s	user 0.007s	sys 0.007s
I20260709 12:26:05.899616  3860 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:05.900147  3858 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:05.900166  3860 ts_tablet_manager.cc:1403] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.227s	user 0.026s	sys 0.051s
I20260709 12:26:05.900836  3858 ts_tablet_manager.cc:1403] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.010s
I20260709 12:26:05.901347  3857 raft_consensus.cc:359] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.903180  3860 raft_consensus.cc:359] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.903898  3860 raft_consensus.cc:385] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.903472  3858 raft_consensus.cc:359] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.904193  3860 raft_consensus.cc:740] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.904343  3858 raft_consensus.cc:385] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.904938  3858 raft_consensus.cc:740] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.905421  3860 consensus_queue.cc:260] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.905758  3858 consensus_queue.cc:260] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.902046  3857 raft_consensus.cc:385] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.908334  3858 ts_tablet_manager.cc:1434] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:26:05.907806  3857 raft_consensus.cc:740] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.909386  3858 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:05.909026  3903 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:05.911098  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
W20260709 12:26:05.912485  3553 leader_election.cc:343] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.913970  3860 ts_tablet_manager.cc:1434] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:26:05.907536  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:05.914920  3738 raft_consensus.cc:3060] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:05.915016  3860 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:05.921882  3860 tablet_bootstrap.cc:654] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.928290  3858 tablet_bootstrap.cc:654] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.930111  3738 raft_consensus.cc:2468] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:05.931936  3856 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.932693  3856 ts_tablet_manager.cc:1403] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.008s
I20260709 12:26:05.931938  3555 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:05.910036  3857 consensus_queue.cc:260] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.935925  3857 ts_tablet_manager.cc:1434] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:26:05.936203  3856 raft_consensus.cc:359] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.936982  3856 raft_consensus.cc:385] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.936074  3903 raft_consensus.cc:2804] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:05.937256  3856 raft_consensus.cc:740] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.937603  3903 raft_consensus.cc:697] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:05.937955  3856 consensus_queue.cc:260] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:05.938423  3903 consensus_queue.cc:237] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.939891  3856 ts_tablet_manager.cc:1434] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:05.939661  3484 catalog_manager.cc:5697] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.940892  3856 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:05.941227  3857 tablet_bootstrap.cc:492] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:05.944999  3858 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:05.945171  3860 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:05.945488  3858 ts_tablet_manager.cc:1403] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.005s
I20260709 12:26:05.945940  3860 ts_tablet_manager.cc:1403] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.011s
I20260709 12:26:05.946538  3856 tablet_bootstrap.cc:654] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.950611  3868 consensus_queue.cc:1048] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:05.950583  3860 raft_consensus.cc:359] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.952862  3860 raft_consensus.cc:385] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.953150  3860 raft_consensus.cc:740] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.953889  3860 consensus_queue.cc:260] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:05.956645  3860 ts_tablet_manager.cc:1434] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:26:05.964754  3486 catalog_manager.cc:5697] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.966418  3858 raft_consensus.cc:359] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.967056  3858 raft_consensus.cc:385] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.967265  3858 raft_consensus.cc:740] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.967871  3858 consensus_queue.cc:260] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.969729  3858 ts_tablet_manager.cc:1434] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:26:05.973140  3857 tablet_bootstrap.cc:654] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.976727  3858 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:05.982096  3856 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:05.982604  3856 ts_tablet_manager.cc:1403] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.012s
I20260709 12:26:05.983318  3860 tablet_bootstrap.cc:492] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:05.989333  3906 raft_consensus.cc:493] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.989851  3906 raft_consensus.cc:515] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.991761  3860 tablet_bootstrap.cc:654] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:05.991977  3906 leader_election.cc:290] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:05.993229  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:05.993382  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:05.994990  3627 leader_election.cc:343] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:05.997190  3856 raft_consensus.cc:359] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:05.997846  3856 raft_consensus.cc:385] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:05.998099  3856 raft_consensus.cc:740] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:05.998636  3856 consensus_queue.cc:260] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:06.000300  3628 leader_election.cc:343] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.000829  3628 leader_election.cc:304] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:06.002019  3906 raft_consensus.cc:2749] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.002959  3856 ts_tablet_manager.cc:1434] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:26:06.003360  3914 raft_consensus.cc:493] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.003881  3914 raft_consensus.cc:515] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.003880  3856 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:06.007000  3914 leader_election.cc:290] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:06.007372  3884 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.007864  3884 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.009071  3858 tablet_bootstrap.cc:654] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.009429  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:06.009871  3884 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:06.011058  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.011682  3663 raft_consensus.cc:2468] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:06.012853  3857 tablet_bootstrap.cc:492] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:06.013324  3857 ts_tablet_manager.cc:1403] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.020s
W20260709 12:26:06.014010  3702 leader_election.cc:343] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.015115  3703 leader_election.cc:304] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:06.015938  3856 tablet_bootstrap.cc:654] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.016193  3914 raft_consensus.cc:2804] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.016902  3914 raft_consensus.cc:493] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.017241  3914 raft_consensus.cc:3060] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.017531  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.017692  3857 raft_consensus.cc:359] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.018155  3589 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:06.019140  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.019368  3903 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.019758  3663 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:06.019834  3903 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.020984  3777 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:06.021872  3903 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.022080  3884 raft_consensus.cc:2804] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.022379  3857 raft_consensus.cc:385] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.022504  3884 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.022697  3857 raft_consensus.cc:740] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.023505  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.024324  3857 consensus_queue.cc:260] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:06.024739  3555 leader_election.cc:343] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.024772  3884 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.026723  3914 raft_consensus.cc:515] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.022817  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.027770  3663 raft_consensus.cc:2468] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:06.027179  3857 ts_tablet_manager.cc:1434] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:06.028829  3554 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:06.029774  3857 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:06.029946  3903 raft_consensus.cc:2804] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.030346  3903 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.030683  3903 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.033722  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:06.034240  3663 raft_consensus.cc:3060] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.038587  3903 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.035598  3857 tablet_bootstrap.cc:654] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.042140  3860 tablet_bootstrap.cc:492] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:06.042644  3860 ts_tablet_manager.cc:1403] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.010s
I20260709 12:26:06.043256  3663 raft_consensus.cc:2468] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:06.044378  3703 leader_election.cc:304] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:06.045229  3875 raft_consensus.cc:2804] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.045701  3860 raft_consensus.cc:359] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.044864  3884 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.046461  3903 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.047561  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:06.047662  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:06.048493  3664 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.048007  3914 leader_election.cc:290] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:06.046417  3860 raft_consensus.cc:385] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.050261  3860 raft_consensus.cc:740] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.050220  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:06.050981  3589 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.052096  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:06.052881  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
W20260709 12:26:06.053251  3555 leader_election.cc:343] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.053567  3662 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:06.054263  3702 leader_election.cc:343] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.057971  3589 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:06.058868  3860 consensus_queue.cc:260] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.061116  3775 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:06.063017  3884 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:06.059470  3664 raft_consensus.cc:2468] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:06.065174  3554 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:06.066308  3903 raft_consensus.cc:2804] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.066768  3903 raft_consensus.cc:697] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:06.067548  3903 consensus_queue.cc:237] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.072726  3884 raft_consensus.cc:2804] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.073227  3884 raft_consensus.cc:697] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:06.076151  3662 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:06.073990  3884 consensus_queue.cc:237] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.079618  3875 raft_consensus.cc:697] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:06.080549  3875 consensus_queue.cc:237] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.081207  3857 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:06.081732  3857 ts_tablet_manager.cc:1403] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.002s
I20260709 12:26:06.084553  3857 raft_consensus.cc:359] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.085171  3857 raft_consensus.cc:385] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.085435  3857 raft_consensus.cc:740] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.089943  3858 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:06.090474  3858 ts_tablet_manager.cc:1403] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.017s
I20260709 12:26:06.090745  3857 consensus_queue.cc:260] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.090507  3485 catalog_manager.cc:5697] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.093164  3858 raft_consensus.cc:359] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.096264  3856 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:06.096688  3856 ts_tablet_manager.cc:1403] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.015s
I20260709 12:26:06.090520  3860 ts_tablet_manager.cc:1434] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.012s
I20260709 12:26:06.098100  3860 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:06.099092  3858 raft_consensus.cc:385] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.099058  3856 raft_consensus.cc:359] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.099020  3484 catalog_manager.cc:5697] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.100623  3856 raft_consensus.cc:385] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.100939  3856 raft_consensus.cc:740] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.101547  3856 consensus_queue.cc:260] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.103467  3856 ts_tablet_manager.cc:1434] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:26:06.104290  3856 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:06.099820  3858 raft_consensus.cc:740] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.107607  3862 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.108521  3860 tablet_bootstrap.cc:654] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.108120  3862 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.100636  3857 ts_tablet_manager.cc:1434] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:26:06.109731  3857 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:06.110306  3862 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:06.108060  3858 consensus_queue.cc:260] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.110991  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:06.111608  3811 raft_consensus.cc:2468] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:06.112370  3858 ts_tablet_manager.cc:1434] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:26:06.113029  3553 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:06.113313  3858 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:06.113927  3862 raft_consensus.cc:2804] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.114334  3862 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.115370  3862 raft_consensus.cc:3060] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.116624  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.117403  3856 tablet_bootstrap.cc:654] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:06.117908  3554 leader_election.cc:343] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.118520  3858 tablet_bootstrap.cc:654] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.114966  3857 tablet_bootstrap.cc:654] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.123988  3875 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.125913  3875 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.128969  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.129599  3486 catalog_manager.cc:5697] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:06.130429  3701 leader_election.cc:343] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.131023  3875 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:06.135403  3860 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:06.135933  3860 ts_tablet_manager.cc:1403] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.005s
I20260709 12:26:06.135777  3862 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.138640  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:06.138801  3860 raft_consensus.cc:359] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.139510  3860 raft_consensus.cc:385] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.139818  3860 raft_consensus.cc:740] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.140215  3811 raft_consensus.cc:3060] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.140645  3860 consensus_queue.cc:260] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.142835  3860 ts_tablet_manager.cc:1434] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:06.143761  3860 tablet_bootstrap.cc:492] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:06.145359  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:06.145944  3812 raft_consensus.cc:2468] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:06.146998  3702 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:06.147534  3875 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.148103  3914 raft_consensus.cc:2804] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.148016  3875 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.148510  3914 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.148876  3914 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.151007  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.151651  3589 raft_consensus.cc:2468] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:06.153146  3811 raft_consensus.cc:2468] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:06.153475  3701 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:06.154457  3553 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:06.155038  3875 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:06.155539  3875 raft_consensus.cc:2804] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.155826  3664 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.162408  3944 raft_consensus.cc:493] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.162900  3944 raft_consensus.cc:515] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.164656  3860 tablet_bootstrap.cc:654] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.165325  3944 leader_election.cc:290] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:06.155993  3875 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.155905  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.156267  3903 raft_consensus.cc:2804] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.175001  3875 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.184265  3914 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.187673  3914 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:06.189402  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:06.189996  3811 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.190642  3905 consensus_queue.cc:1048] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.192408  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
W20260709 12:26:06.193763  3554 leader_election.cc:343] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.178751  3662 raft_consensus.cc:3060] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.199222  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.200055  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:06.201058  3589 raft_consensus.cc:2468] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
W20260709 12:26:06.204412  3701 leader_election.cc:343] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.205211  3775 leader_election.cc:304] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:06.206040  3884 raft_consensus.cc:2804] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.206408  3884 raft_consensus.cc:493] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.206741  3884 raft_consensus.cc:3060] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.209290  3872 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.209753  3872 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.212924  3811 raft_consensus.cc:2468] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:06.213670  3884 raft_consensus.cc:515] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.214071  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.215454  3872 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.224274  3702 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:06.225072  3914 raft_consensus.cc:2804] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.225526  3914 raft_consensus.cc:697] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:06.226303  3914 consensus_queue.cc:237] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.180617  3862 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:06.229449  3903 raft_consensus.cc:697] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:06.232291  3903 consensus_queue.cc:237] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.238842  3858 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:06.239358  3858 ts_tablet_manager.cc:1403] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.009s
I20260709 12:26:06.229930  3905 consensus_queue.cc:1048] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:26:06.253264  3856 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:06.253839  3856 ts_tablet_manager.cc:1403] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.150s	user 0.025s	sys 0.009s
I20260709 12:26:06.254909  3857 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:06.255318  3857 ts_tablet_manager.cc:1403] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.020s
I20260709 12:26:06.257125  3884 leader_election.cc:290] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:06.258579  3856 raft_consensus.cc:359] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.259343  3856 raft_consensus.cc:385] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.259598  3856 raft_consensus.cc:740] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.260296  3856 consensus_queue.cc:260] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.261663  3905 raft_consensus.cc:493] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.262110  3905 raft_consensus.cc:515] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.264747  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:06.265336  3588 raft_consensus.cc:3060] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.266773  3875 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.264259  3905 leader_election.cc:290] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:06.273344  3857 raft_consensus.cc:359] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.274006  3857 raft_consensus.cc:385] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.274261  3857 raft_consensus.cc:740] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.276397  3857 consensus_queue.cc:260] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.278954  3860 tablet_bootstrap.cc:492] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:06.279466  3860 ts_tablet_manager.cc:1403] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.136s	user 0.024s	sys 0.020s
I20260709 12:26:06.279527  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:06.280555  3589 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.282213  3860 raft_consensus.cc:359] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.282889  3860 raft_consensus.cc:385] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.283128  3860 raft_consensus.cc:740] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.284310  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:06.285758  3553 leader_election.cc:343] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.285920  3875 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:06.287096  3860 consensus_queue.cc:260] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.294106  3860 ts_tablet_manager.cc:1434] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:26:06.295485  3857 ts_tablet_manager.cc:1434] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:26:06.296648  3857 tablet_bootstrap.cc:492] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:06.296940  3858 raft_consensus.cc:359] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.297628  3858 raft_consensus.cc:385] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.297881  3858 raft_consensus.cc:740] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
W20260709 12:26:06.287823  3628 consensus_peers.cc:597] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.299405  3858 consensus_queue.cc:260] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.296357  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.289681  3872 consensus_queue.cc:1048] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:26:06.306208  3856 ts_tablet_manager.cc:1434] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.011s
W20260709 12:26:06.295132  3703 leader_election.cc:343] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.306685  3858 ts_tablet_manager.cc:1434] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.003s
I20260709 12:26:06.308972  3858 tablet_bootstrap.cc:492] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:06.307257  3856 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:06.298952  3588 raft_consensus.cc:2468] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:06.328684  3860 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:06.333662  3857 tablet_bootstrap.cc:654] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:06.335945  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:26:06.337407  3555 consensus_peers.cc:597] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.338196  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:06.346516  3555 leader_election.cc:343] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.347004  3555 leader_election.cc:304] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:06.349339  3860 tablet_bootstrap.cc:654] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.354012  3589 raft_consensus.cc:2468] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:06.357090  3630 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:06.365236  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:06.361017  3868 raft_consensus.cc:2749] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:06.366948  3703 leader_election.cc:343] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.367048  3812 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.368863  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.370113  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:06.361781  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 91922.9us
I20260709 12:26:06.371212  3961 raft_consensus.cc:2749] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:06.371675  3778 leader_election.cc:343] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:06.372617  3778 leader_election.cc:343] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.376477  3884 raft_consensus.cc:493] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.376942  3884 raft_consensus.cc:515] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.378895  3884 leader_election.cc:290] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.379951  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.380549  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.380589  3738 raft_consensus.cc:2468] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:06.381385  3664 raft_consensus.cc:2468] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:06.382076  3778 leader_election.cc:304] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:06.383062  3858 tablet_bootstrap.cc:654] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.383347  3884 raft_consensus.cc:2804] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.383749  3884 raft_consensus.cc:493] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.384086  3884 raft_consensus.cc:3060] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.385950  3856 tablet_bootstrap.cc:654] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.387651  3775 leader_election.cc:304] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:06.388720  3944 raft_consensus.cc:2804] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.389186  3944 raft_consensus.cc:697] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:06.392649  3944 consensus_queue.cc:237] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.395993  3875 consensus_queue.cc:1048] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.405156  3701 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:06.406112  3875 raft_consensus.cc:2804] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.406559  3875 raft_consensus.cc:697] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
W20260709 12:26:06.406844  3703 consensus_peers.cc:597] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.422122  3486 catalog_manager.cc:5697] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.423576  3884 raft_consensus.cc:515] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.425210  3860 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:06.425709  3860 ts_tablet_manager.cc:1403] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.008s
I20260709 12:26:06.417548  3487 catalog_manager.cc:5697] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.428611  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:06.429170  3664 raft_consensus.cc:3060] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.429986  3857 tablet_bootstrap.cc:492] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:06.430739  3857 ts_tablet_manager.cc:1403] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.006s
I20260709 12:26:06.429970  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:06.432168  3738 raft_consensus.cc:3060] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.435753  3875 consensus_queue.cc:237] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.436915  3664 raft_consensus.cc:2468] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:06.437983  3777 leader_election.cc:304] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:06.438310  3961 consensus_queue.cc:1048] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.439015  3945 raft_consensus.cc:2804] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.430487  3884 leader_election.cc:290] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.446955  3860 raft_consensus.cc:359] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.447758  3860 raft_consensus.cc:385] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.448040  3860 raft_consensus.cc:740] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.448904  3860 consensus_queue.cc:260] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.429216  3940 consensus_queue.cc:1048] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:26:06.453804  3857 raft_consensus.cc:359] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.456164  3857 raft_consensus.cc:385] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.456450  3857 raft_consensus.cc:740] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.455276  3860 ts_tablet_manager.cc:1434] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:26:06.457752  3856 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:06.458312  3856 ts_tablet_manager.cc:1403] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.011s
I20260709 12:26:06.459439  3857 consensus_queue.cc:260] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.442920  3914 consensus_queue.cc:1048] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:26:06.475909  3860 tablet_bootstrap.cc:492] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:06.477393  3945 raft_consensus.cc:697] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:06.478345  3945 consensus_queue.cc:237] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:06.483564  3553 consensus_peers.cc:597] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.488880  3961 consensus_queue.cc:1048] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.499446  3858 tablet_bootstrap.cc:492] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:06.500030  3858 ts_tablet_manager.cc:1403] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.191s	user 0.015s	sys 0.015s
I20260709 12:26:06.500077  3860 tablet_bootstrap.cc:654] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.501648  3857 ts_tablet_manager.cc:1434] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.071s	user 0.011s	sys 0.003s
I20260709 12:26:06.502732  3857 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:06.508200  3980 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.508610  3980 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.513000  3884 consensus_queue.cc:1048] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.510705  3738 raft_consensus.cc:2468] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:06.518859  3980 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.522153  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.525005  3856 raft_consensus.cc:359] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.529206  3856 raft_consensus.cc:385] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.529476  3856 raft_consensus.cc:740] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.531834  3856 consensus_queue.cc:260] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.542863  3856 ts_tablet_manager.cc:1434] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.084s	user 0.003s	sys 0.004s
I20260709 12:26:06.540948  3858 raft_consensus.cc:359] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.544348  3858 raft_consensus.cc:385] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.545895  3858 raft_consensus.cc:740] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.546576  3858 consensus_queue.cc:260] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.547925  3856 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:06.549180  3857 tablet_bootstrap.cc:654] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.552824  3858 ts_tablet_manager.cc:1434] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:26:06.547407  3884 raft_consensus.cc:493] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.554382  3858 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:06.556494  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.562423  3972 consensus_queue.cc:1048] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:26:06.555042  3555 consensus_peers.cc:597] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.567655  3775 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:06.562718  3884 raft_consensus.cc:515] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.576520  3811 raft_consensus.cc:3060] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.584987  3976 raft_consensus.cc:493] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.585563  3976 raft_consensus.cc:515] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.586692  3960 consensus_queue.cc:1048] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.587814  3976 leader_election.cc:290] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:06.591563  3484 catalog_manager.cc:5697] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.600467  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.601183  3663 raft_consensus.cc:2468] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:06.602409  3703 leader_election.cc:304] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:06.603247  3914 raft_consensus.cc:2804] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.603649  3914 raft_consensus.cc:493] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.604043  3914 raft_consensus.cc:3060] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.606802  3976 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.607295  3976 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.608147  3487 catalog_manager.cc:5697] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.611786  3914 raft_consensus.cc:515] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.615142  3906 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.615628  3906 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.617513  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:06.618139  3663 raft_consensus.cc:3060] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.618450  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:06.619315  3810 raft_consensus.cc:2393] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 1: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:06.617625  3906 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:06.620234  3961 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.620584  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.620721  3961 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.621243  3940 consensus_queue.cc:1048] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.622990  3628 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:06.623158  3961 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:06.624706  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:06.625167  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.625983  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.626772  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.626757  3661 raft_consensus.cc:2393] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:06.628909  3778 leader_election.cc:304] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:06.625491  3810 raft_consensus.cc:2393] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 1: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:06.630074  3976 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:06.630877  3553 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:06.631886  3961 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.633729  3860 tablet_bootstrap.cc:492] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:06.634210  3860 ts_tablet_manager.cc:1403] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.015s
I20260709 12:26:06.631953  3944 raft_consensus.cc:2749] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.628286  3906 raft_consensus.cc:3060] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.625089  3884 leader_election.cc:290] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.641388  3914 leader_election.cc:290] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:06.631669  3856 tablet_bootstrap.cc:654] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.643261  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.645309  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:06.646795  3588 raft_consensus.cc:2468] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:06.648394  3701 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:06.649850  3860 raft_consensus.cc:359] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.650578  3860 raft_consensus.cc:385] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.650858  3860 raft_consensus.cc:740] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
W20260709 12:26:06.655983  3702 leader_election.cc:343] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.653035  3914 raft_consensus.cc:2804] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:06.661070  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:06.661661  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:06.665856  3857 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:06.669677  3857 ts_tablet_manager.cc:1403] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.009s
I20260709 12:26:06.670109  3914 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.670539  3914 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.674460  3858 tablet_bootstrap.cc:654] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.654452  3860 consensus_queue.cc:260] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.677729  3857 raft_consensus.cc:359] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.679257  3857 raft_consensus.cc:385] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.679467  3857 raft_consensus.cc:740] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.682536  3860 ts_tablet_manager.cc:1434] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:26:06.686256  3905 consensus_queue.cc:1048] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.686932  3980 raft_consensus.cc:493] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.687453  3980 raft_consensus.cc:515] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.689559  3980 leader_election.cc:290] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:06.691085  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:06.680804  3702 leader_election.cc:343] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.691989  3857 consensus_queue.cc:260] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:06.692617  3777 leader_election.cc:343] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:06.693267  3702 leader_election.cc:343] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.694011  3857 ts_tablet_manager.cc:1434] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.000s
I20260709 12:26:06.705874  3857 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:06.709071  3860 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:06.707652  3961 raft_consensus.cc:2749] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.712538  3856 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:06.713055  3856 ts_tablet_manager.cc:1403] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.008s
I20260709 12:26:06.690970  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:06.696671  3972 raft_consensus.cc:2749] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:06.716428  3975 consensus_queue.cc:1048] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:06.708431  3663 raft_consensus.cc:2468] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:06.729324  3857 tablet_bootstrap.cc:654] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.730724  3858 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:06.731196  3858 ts_tablet_manager.cc:1403] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.178s	user 0.009s	sys 0.006s
I20260709 12:26:06.719894  3914 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:06.726119  3906 raft_consensus.cc:2749] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:06.726984  3778 leader_election.cc:343] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.737334  3778 leader_election.cc:304] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:06.737766  3976 consensus_queue.cc:1048] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.735204  3856 raft_consensus.cc:359] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.738540  3856 raft_consensus.cc:385] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.738845  3856 raft_consensus.cc:740] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.743021  3975 consensus_queue.cc:1048] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.744787  3703 leader_election.cc:304] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:06.745901  3976 raft_consensus.cc:2804] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.746367  3976 raft_consensus.cc:697] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:06.747095  3976 consensus_queue.cc:237] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.740557  3856 consensus_queue.cc:260] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.755599  3856 ts_tablet_manager.cc:1434] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.003s
I20260709 12:26:06.756446  3856 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:06.740016  3945 raft_consensus.cc:2749] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.764686  3856 tablet_bootstrap.cc:654] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:06.768436  3987 log.cc:927] Time spent T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:06.801481  3960 consensus_queue.cc:1048] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:26:06.817625  3737 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.828583  3914 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:06.829840  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:06.830189  3485 catalog_manager.cc:5697] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.831653  3588 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.835320  3860 tablet_bootstrap.cc:654] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.838745  3588 raft_consensus.cc:2468] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:06.840085  3701 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:06.846051  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:06.843914  3914 raft_consensus.cc:2804] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:06.848539  3914 raft_consensus.cc:697] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:06.850186  3914 consensus_queue.cc:237] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:06.849251  3702 leader_election.cc:343] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:06.852993  3856 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:06.853494  3856 ts_tablet_manager.cc:1403] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.018s
I20260709 12:26:06.863032  3856 raft_consensus.cc:359] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.863770  3856 raft_consensus.cc:385] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:26:06.872790  3995 log.cc:927] Time spent T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.072s	user 0.002s	sys 0.001s
I20260709 12:26:06.864040  3856 raft_consensus.cc:740] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.878460  3858 raft_consensus.cc:359] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.879410  3858 raft_consensus.cc:385] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.879698  3858 raft_consensus.cc:740] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.880541  3858 consensus_queue.cc:260] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.881897  3857 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:06.882467  3857 ts_tablet_manager.cc:1403] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.177s	user 0.027s	sys 0.050s
I20260709 12:26:06.883631  3856 consensus_queue.cc:260] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.884575  3858 ts_tablet_manager.cc:1434] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.153s	user 0.005s	sys 0.004s
I20260709 12:26:06.886524  3858 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:06.890552  3858 tablet_bootstrap.cc:654] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.890475  3857 raft_consensus.cc:359] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.891036  3857 raft_consensus.cc:385] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.892758  3856 ts_tablet_manager.cc:1434] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:26:06.894184  3975 consensus_queue.cc:1048] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:06.891319  3857 raft_consensus.cc:740] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.897660  3856 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:06.900418  3857 consensus_queue.cc:260] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.901317  3860 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:06.901834  3860 ts_tablet_manager.cc:1403] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.219s	user 0.007s	sys 0.007s
I20260709 12:26:06.902518  3857 ts_tablet_manager.cc:1434] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 12:26:06.903414  3857 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:06.907320  3856 tablet_bootstrap.cc:654] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.912007  3857 tablet_bootstrap.cc:654] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.917305  3858 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:06.917785  3858 ts_tablet_manager.cc:1403] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.011s
I20260709 12:26:06.919376  3856 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:06.919875  3856 ts_tablet_manager.cc:1403] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:26:06.924113  3486 catalog_manager.cc:5697] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.932368  3945 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.932667  3860 raft_consensus.cc:359] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.933363  3860 raft_consensus.cc:385] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.933611  3860 raft_consensus.cc:740] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.934369  3860 consensus_queue.cc:260] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.937850  3945 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:06.937942  3858 raft_consensus.cc:359] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.938807  3858 raft_consensus.cc:385] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.939445  3858 raft_consensus.cc:740] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.939960  3945 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:06.941073  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:06.942333  3808 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:06.944548  3587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:06.948328  3858 consensus_queue.cc:260] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.948874  3775 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:06.949054  3486 catalog_manager.cc:5697] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.950794  3858 ts_tablet_manager.cc:1434] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 12:26:06.951800  3858 tablet_bootstrap.cc:492] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:06.940200  3860 ts_tablet_manager.cc:1434] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:26:06.957034  3860 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:06.959906  3858 tablet_bootstrap.cc:654] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.941224  3856 raft_consensus.cc:359] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:06.962512  3856 raft_consensus.cc:385] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.962781  3856 raft_consensus.cc:740] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.963562  3856 consensus_queue.cc:260] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:06.965894  3703 consensus_peers.cc:597] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.969831  3860 tablet_bootstrap.cc:654] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.973892  3856 ts_tablet_manager.cc:1434] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.000s
I20260709 12:26:06.974170  3858 tablet_bootstrap.cc:492] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:06.974646  3858 ts_tablet_manager.cc:1403] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:26:06.974838  3856 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:06.977383  3858 raft_consensus.cc:359] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.981818  3945 raft_consensus.cc:2749] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:06.978147  3858 raft_consensus.cc:385] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:06.983984  3858 raft_consensus.cc:740] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:06.984714  3858 consensus_queue.cc:260] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:06.989380  3856 tablet_bootstrap.cc:654] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:06.991321  3858 ts_tablet_manager.cc:1434] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:26:06.992363  3858 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
W20260709 12:26:06.995365  3778 consensus_peers.cc:597] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.996490  3857 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:06.998876  3857 ts_tablet_manager.cc:1403] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.096s	user 0.027s	sys 0.017s
I20260709 12:26:07.000453  3858 tablet_bootstrap.cc:654] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.002862  3857 raft_consensus.cc:359] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.003554  3857 raft_consensus.cc:385] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.005556  3857 raft_consensus.cc:740] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.006314  3857 consensus_queue.cc:260] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.008615  3857 ts_tablet_manager.cc:1434] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:07.009500  3857 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:07.010520  3945 consensus_queue.cc:1048] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.014778  3857 tablet_bootstrap.cc:654] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.017711  3860 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.018216  3860 ts_tablet_manager.cc:1403] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260709 12:26:07.020768  3860 raft_consensus.cc:359] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.021404  3860 raft_consensus.cc:385] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.021651  3860 raft_consensus.cc:740] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.022219  3860 consensus_queue.cc:260] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.022754  3858 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:07.023304  3858 ts_tablet_manager.cc:1403] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 12:26:07.025580  3856 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:07.026018  3858 raft_consensus.cc:359] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.026039  3856 ts_tablet_manager.cc:1403] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:26:07.026687  3858 raft_consensus.cc:385] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.027211  3858 raft_consensus.cc:740] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.027894  3858 consensus_queue.cc:260] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.028306  3980 consensus_queue.cc:1048] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.029426  3856 raft_consensus.cc:359] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.029831  3858 ts_tablet_manager.cc:1434] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:07.030066  3856 raft_consensus.cc:385] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.030382  3856 raft_consensus.cc:740] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.030747  3858 tablet_bootstrap.cc:492] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:07.031119  3856 consensus_queue.cc:260] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.032822  3856 ts_tablet_manager.cc:1434] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:26:07.033671  3856 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:07.026494  3860 ts_tablet_manager.cc:1434] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:26:07.036561  3858 tablet_bootstrap.cc:654] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.036969  3860 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:07.040195  3856 tablet_bootstrap.cc:654] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.050347  3860 tablet_bootstrap.cc:654] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.051378  3906 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.051947  3906 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.054160  3906 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.055434  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.056032  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:07.056651  3588 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
W20260709 12:26:07.056905  3630 leader_election.cc:343] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.057982  3627 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:07.064020  3980 consensus_queue.cc:1048] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:07.065858  3738 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.064931  3906 raft_consensus.cc:2804] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.078907  3906 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.079282  3906 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.093117  3860 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.096696  3860 ts_tablet_manager.cc:1403] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.006s
I20260709 12:26:07.105047  3860 raft_consensus.cc:359] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.107538  3860 raft_consensus.cc:385] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.108916  3860 raft_consensus.cc:740] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.117852  3868 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.118394  3868 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.120496  3868 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.124940  3587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:07.125926  3808 raft_consensus.cc:3060] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.111028  3860 consensus_queue.cc:260] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.133882  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.135547  3630 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:07.136749  3868 raft_consensus.cc:2749] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.136471  3906 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.138978  3906 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.140065  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:07.141409  3630 leader_election.cc:343] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.142208  3587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:07.142846  3587 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.130213  3860 ts_tablet_manager.cc:1434] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:26:07.148056  3860 tablet_bootstrap.cc:492] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
W20260709 12:26:07.151693  3702 consensus_peers.cc:597] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.158490  3961 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.159030  3961 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.161118  3961 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.162298  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.162518  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:07.163893  3554 leader_election.cc:343] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:07.164518  3553 leader_election.cc:343] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.164709  3945 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.165104  3553 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.165302  3945 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.166440  3860 tablet_bootstrap.cc:654] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.167708  3945 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:07.168048  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.168669  3961 raft_consensus.cc:2749] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.168916  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:07.170672  3775 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:07.171911  3945 raft_consensus.cc:2749] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.172755  3587 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:07.179525  3627 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:07.182592  3868 raft_consensus.cc:2804] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.183089  3868 raft_consensus.cc:697] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:07.183213  4023 raft_consensus.cc:493] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.183799  4023 raft_consensus.cc:515] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.184016  3868 consensus_queue.cc:237] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.184876  3945 raft_consensus.cc:493] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.185319  3945 raft_consensus.cc:515] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.185915  4023 leader_election.cc:290] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:07.187378  3860 tablet_bootstrap.cc:492] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.187341  3945 leader_election.cc:290] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.188730  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.187585  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:07.189594  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.190312  3663 raft_consensus.cc:2468] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
W20260709 12:26:07.190649  3628 leader_election.cc:343] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.188305  3860 ts_tablet_manager.cc:1403] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.004s
W20260709 12:26:07.191223  3630 leader_election.cc:343] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.191641  3630 leader_election.cc:304] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:07.192729  4023 raft_consensus.cc:2749] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.193758  3860 raft_consensus.cc:359] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.194397  3860 raft_consensus.cc:385] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.194679  3860 raft_consensus.cc:740] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.195299  3860 consensus_queue.cc:260] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.191534  3777 leader_election.cc:304] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:07.197943  3860 ts_tablet_manager.cc:1434] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:26:07.198587  3860 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:07.203047  3945 raft_consensus.cc:2804] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.203507  3945 raft_consensus.cc:493] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.203864  3945 raft_consensus.cc:3060] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.204169  3860 tablet_bootstrap.cc:654] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.207368  3961 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.208144  3860 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.208060  3961 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.208611  3860 ts_tablet_manager.cc:1403] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:26:07.210074  3961 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.210789  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.211409  3663 raft_consensus.cc:2468] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:07.211549  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.212746  3554 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:07.213259  3555 leader_election.cc:343] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.214071  3961 raft_consensus.cc:2804] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.214550  3961 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.214948  3961 raft_consensus.cc:3060] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.215022  3860 raft_consensus.cc:359] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.215685  3860 raft_consensus.cc:385] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.215953  3860 raft_consensus.cc:740] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.216684  3860 consensus_queue.cc:260] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.217175  3945 raft_consensus.cc:515] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.218917  3860 ts_tablet_manager.cc:1434] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:07.218470  3484 catalog_manager.cc:5697] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.220120  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:07.221123  3945 leader_election.cc:290] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.221527  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:07.221731  3961 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.222126  3663 raft_consensus.cc:3060] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.224555  3856 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:07.225016  3856 ts_tablet_manager.cc:1403] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.192s	user 0.028s	sys 0.041s
I20260709 12:26:07.227741  3856 raft_consensus.cc:359] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.228540  3856 raft_consensus.cc:385] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.228865  3856 raft_consensus.cc:740] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.228945  3857 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:07.229517  3857 ts_tablet_manager.cc:1403] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.220s	user 0.034s	sys 0.037s
I20260709 12:26:07.229866  3856 consensus_queue.cc:260] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.230223  3860 tablet_bootstrap.cc:492] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:07.222002  3587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:07.230986  3587 raft_consensus.cc:2468] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
W20260709 12:26:07.228406  3775 leader_election.cc:343] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.232738  3857 raft_consensus.cc:359] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.233413  3857 raft_consensus.cc:385] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.233743  3857 raft_consensus.cc:740] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.234431  3857 consensus_queue.cc:260] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.235406  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:07.235919  3961 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.236021  3664 raft_consensus.cc:3060] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.233307  3663 raft_consensus.cc:2468] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:07.236474  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:07.237684  3777 leader_election.cc:304] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:07.238380  3555 leader_election.cc:343] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.240417  3884 raft_consensus.cc:2804] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.240775  3857 ts_tablet_manager.cc:1434] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:07.233780  3856 ts_tablet_manager.cc:1434] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:07.242259  3856 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:07.240923  3884 raft_consensus.cc:697] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:07.244517  3884 consensus_queue.cc:237] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.246466  3857 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:07.247983  3856 tablet_bootstrap.cc:654] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.252511  3857 tablet_bootstrap.cc:654] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.251503  3664 raft_consensus.cc:2468] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:07.258303  3554 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:07.259351  3858 tablet_bootstrap.cc:492] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:07.259899  3858 ts_tablet_manager.cc:1403] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.229s	user 0.029s	sys 0.076s
I20260709 12:26:07.260150  3961 raft_consensus.cc:2804] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.260725  3961 raft_consensus.cc:697] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:07.264299  3858 raft_consensus.cc:359] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.265424  3961 consensus_queue.cc:237] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.265079  3858 raft_consensus.cc:385] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.268040  3858 raft_consensus.cc:740] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.268822  3858 consensus_queue.cc:260] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.284027  3858 ts_tablet_manager.cc:1434] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:26:07.285051  3858 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:07.285784  3860 tablet_bootstrap.cc:654] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.297338  3856 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:07.297825  3856 ts_tablet_manager.cc:1403] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.022s
I20260709 12:26:07.300555  3856 raft_consensus.cc:359] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.301285  3856 raft_consensus.cc:385] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.301591  3856 raft_consensus.cc:740] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.302397  3856 consensus_queue.cc:260] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.304818  3975 consensus_queue.cc:1048] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.307585  3856 ts_tablet_manager.cc:1434] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:26:07.304069  3483 catalog_manager.cc:5697] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.308701  3856 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:07.314550  3858 tablet_bootstrap.cc:654] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.314934  3856 tablet_bootstrap.cc:654] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.321655  3860 tablet_bootstrap.cc:492] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.321657  3857 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:07.322244  3857 ts_tablet_manager.cc:1403] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.009s
I20260709 12:26:07.322244  3860 ts_tablet_manager.cc:1403] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.005s
I20260709 12:26:07.324945  3858 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:07.325425  3858 ts_tablet_manager.cc:1403] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.001s
I20260709 12:26:07.325363  3857 raft_consensus.cc:359] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.326258  3857 raft_consensus.cc:385] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.326530  3857 raft_consensus.cc:740] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.326735  3860 raft_consensus.cc:359] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.327371  3860 raft_consensus.cc:385] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.389523  3906 raft_consensus.cc:493] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.391564  3906 raft_consensus.cc:515] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.327708  3858 raft_consensus.cc:359] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.393878  3858 raft_consensus.cc:385] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.394208  3858 raft_consensus.cc:740] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.395139  3906 leader_election.cc:290] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:07.327181  3857 consensus_queue.cc:260] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.400352  3975 raft_consensus.cc:493] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.401243  3975 raft_consensus.cc:515] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.405136  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.327638  3860 raft_consensus.cc:740] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.415671  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:07.395217  3858 consensus_queue.cc:260] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.426048  3856 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:07.426429  3976 consensus_queue.cc:1048] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:07.427187  3856 ts_tablet_manager.cc:1403] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.004s
I20260709 12:26:07.428488  3738 raft_consensus.cc:3060] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.428838  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:07.429479  3975 leader_election.cc:290] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:07.435297  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:07.435599  3628 leader_election.cc:304] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:07.444108  3945 raft_consensus.cc:493] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.444970  3945 raft_consensus.cc:515] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.445727  3961 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.446514  3856 raft_consensus.cc:359] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.447459  3856 raft_consensus.cc:385] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.447815  3856 raft_consensus.cc:740] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.450883  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:07.453588  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:07.453828  3811 raft_consensus.cc:3060] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.455662  3945 leader_election.cc:290] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.446528  3961 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.459558  3961 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.448554  3860 consensus_queue.cc:260] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.460170  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.460283  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:07.461264  3812 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
W20260709 12:26:07.461793  3554 leader_election.cc:343] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.463018  3553 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.464351  3961 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.464744  3961 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.465071  3961 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.452771  3484 catalog_manager.cc:5697] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.469419  3857 ts_tablet_manager.cc:1434] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.147s	user 0.006s	sys 0.000s
I20260709 12:26:07.474236  3868 raft_consensus.cc:2749] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.476531  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.479053  3778 leader_election.cc:304] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.482425  3945 raft_consensus.cc:2749] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.489984  3857 tablet_bootstrap.cc:492] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:07.493500  3858 ts_tablet_manager.cc:1434] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.168s	user 0.003s	sys 0.004s
I20260709 12:26:07.488497  3856 consensus_queue.cc:260] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.496766  3961 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.497717  3856 ts_tablet_manager.cc:1434] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.006s
I20260709 12:26:07.499178  3858 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:07.500015  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:07.500658  3810 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.504321  3857 tablet_bootstrap.cc:654] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.507851  3975 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.526650  3975 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.508018  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:07.508363  3664 raft_consensus.cc:3060] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:07.532612  3702 consensus_peers.cc:597] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.533475  3702 leader_election.cc:304] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:07.535585  3554 leader_election.cc:343] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.540104  4038 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.540587  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.540755  4038 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.541371  3663 raft_consensus.cc:2468] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:07.542960  3703 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:07.544811  3875 raft_consensus.cc:2804] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:07.545239  3875 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.545573  3875 raft_consensus.cc:3060] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.547942  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.550091  4038 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.552309  3587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:07.553296  3587 raft_consensus.cc:2393] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:07.554833  3701 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.555779  4038 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.508527  3961 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.508888  3856 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:07.565471  4038 raft_consensus.cc:2749] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.572520  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:07.573676  3588 raft_consensus.cc:2468] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:07.518162  3858 tablet_bootstrap.cc:654] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.521715  3810 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:07.575376  3553 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.576666  3903 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.577104  3903 raft_consensus.cc:697] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:07.578104  3903 consensus_queue.cc:237] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.580086  3875 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.574199  3663 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.581600  3973 raft_consensus.cc:2749] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.584383  3961 raft_consensus.cc:493] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.600090  3961 raft_consensus.cc:515] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.540031  3975 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.603048  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:07.604692  3553 leader_election.cc:343] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.588534  3856 tablet_bootstrap.cc:654] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.467815  3860 ts_tablet_manager.cc:1434] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.143s	user 0.005s	sys 0.003s
I20260709 12:26:07.621987  3860 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:07.622530  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:07.624366  3554 leader_election.cc:343] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.624878  3554 leader_election.cc:304] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.626535  3905 raft_consensus.cc:2749] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.630616  3961 leader_election.cc:290] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.633745  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:07.634454  3588 raft_consensus.cc:3060] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.636889  3856 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:07.637473  3856 ts_tablet_manager.cc:1403] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.000s
I20260709 12:26:07.642885  3858 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:07.643479  3858 ts_tablet_manager.cc:1403] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.145s	user 0.001s	sys 0.014s
I20260709 12:26:07.648321  3860 tablet_bootstrap.cc:654] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.652222  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:07.652530  3857 tablet_bootstrap.cc:492] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:07.653072  3857 ts_tablet_manager.cc:1403] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.163s	user 0.067s	sys 0.059s
I20260709 12:26:07.652755  3858 raft_consensus.cc:359] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.653584  3858 raft_consensus.cc:385] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.653683  3945 consensus_queue.cc:1048] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.652899  3661 raft_consensus.cc:3060] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.654016  3856 raft_consensus.cc:359] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.654786  3856 raft_consensus.cc:385] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.655055  3856 raft_consensus.cc:740] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.656036  3875 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:07.655711  3857 raft_consensus.cc:359] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.656584  3857 raft_consensus.cc:385] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.655772  3856 consensus_queue.cc:260] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.656901  3857 raft_consensus.cc:740] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.657728  3857 consensus_queue.cc:260] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.658977  3856 ts_tablet_manager.cc:1434] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:26:07.660110  3856 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:07.665974  3856 tablet_bootstrap.cc:654] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.672333  4037 consensus_queue.cc:1048] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.674079  3857 ts_tablet_manager.cc:1434] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:07.677297  3858 raft_consensus.cc:740] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.682387  3588 raft_consensus.cc:2468] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:07.690238  3701 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:07.691170  3975 raft_consensus.cc:2804] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:07.691712  3975 raft_consensus.cc:697] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:07.693015  3975 consensus_queue.cc:237] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.684346  3858 consensus_queue.cc:260] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.693737  3487 catalog_manager.cc:5697] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.698518  3810 raft_consensus.cc:3060] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.695608  3858 ts_tablet_manager.cc:1434] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.052s	user 0.003s	sys 0.003s
W20260709 12:26:07.709756  3555 consensus_peers.cc:597] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.706584  3661 raft_consensus.cc:2468] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:07.718281  3858 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:07.727362  3858 tablet_bootstrap.cc:654] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.738063  3972 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.738721  3972 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.741086  3972 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.746074  3857 tablet_bootstrap.cc:492] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:07.746778  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.751376  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.751555  4037 consensus_queue.cc:1048] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:07.753540  3777 leader_election.cc:343] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.750365  3588 raft_consensus.cc:3060] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:07.756469  3856 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:07.756965  3856 ts_tablet_manager.cc:1403] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.009s
W20260709 12:26:07.763773  3778 leader_election.cc:343] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.769767  3778 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.770905  3972 raft_consensus.cc:2749] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.773571  3972 consensus_queue.cc:1048] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:07.786578  3860 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.787191  3860 ts_tablet_manager.cc:1403] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.166s	user 0.009s	sys 0.012s
W20260709 12:26:07.790987  4046 log.cc:927] Time spent T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 12:26:07.797991  3856 raft_consensus.cc:359] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.805413  3856 raft_consensus.cc:385] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.805758  3856 raft_consensus.cc:740] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.812664  3860 raft_consensus.cc:359] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.813475  3860 raft_consensus.cc:385] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.813747  3860 raft_consensus.cc:740] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.815121  3860 consensus_queue.cc:260] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.816382  3856 consensus_queue.cc:260] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.818454  3856 ts_tablet_manager.cc:1434] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 12:26:07.821732  3857 tablet_bootstrap.cc:654] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.823027  3858 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:07.823488  3858 ts_tablet_manager.cc:1403] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.009s
I20260709 12:26:07.824630  3856 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:07.828830  3858 raft_consensus.cc:359] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.828898  3903 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.829478  3858 raft_consensus.cc:385] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.830003  3903 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.831123  3856 tablet_bootstrap.cc:654] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.833180  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:07.833860  3860 ts_tablet_manager.cc:1434] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
W20260709 12:26:07.834532  3554 leader_election.cc:343] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.835268  3903 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:07.835952  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:07.829988  3858 raft_consensus.cc:740] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.836815  3860 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
W20260709 12:26:07.837273  3555 leader_election.cc:343] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.837719  3555 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:07.838305  3903 raft_consensus.cc:2749] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.837009  3858 consensus_queue.cc:260] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.853888  3858 ts_tablet_manager.cc:1434] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:26:07.854923  3858 tablet_bootstrap.cc:492] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:07.857882  3483 catalog_manager.cc:5697] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.861588  3858 tablet_bootstrap.cc:654] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.868180  3860 tablet_bootstrap.cc:654] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.873847  3857 tablet_bootstrap.cc:492] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:07.874313  3857 ts_tablet_manager.cc:1403] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.168s	user 0.012s	sys 0.007s
I20260709 12:26:07.876888  3857 raft_consensus.cc:359] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.877369  3857 raft_consensus.cc:385] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.877566  3857 raft_consensus.cc:740] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.878170  3857 consensus_queue.cc:260] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.882376  3856 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:07.882875  3856 ts_tablet_manager.cc:1403] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.008s
I20260709 12:26:07.883889  3858 tablet_bootstrap.cc:492] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:07.884299  3858 ts_tablet_manager.cc:1403] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.005s
I20260709 12:26:07.885494  3856 raft_consensus.cc:359] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.886853  3857 ts_tablet_manager.cc:1434] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:07.886149  3858 raft_consensus.cc:359] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.889459  3858 raft_consensus.cc:385] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.889751  3858 raft_consensus.cc:740] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.887985  3857 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:07.888676  3860 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.890656  3860 ts_tablet_manager.cc:1403] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.007s
I20260709 12:26:07.892984  3858 consensus_queue.cc:260] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.893854  3860 raft_consensus.cc:359] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.894405  3860 raft_consensus.cc:385] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.894596  3860 raft_consensus.cc:740] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.895206  3860 consensus_queue.cc:260] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.895558  3957 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.895524  3903 consensus_queue.cc:1048] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:07.896224  3957 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:07.897575  3860 ts_tablet_manager.cc:1434] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:07.898101  3857 tablet_bootstrap.cc:654] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.898679  3860 tablet_bootstrap.cc:492] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:07.899526  3957 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:07.900255  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:07.901705  3555 leader_election.cc:343] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.904320  3858 ts_tablet_manager.cc:1434] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:26:07.904855  3860 tablet_bootstrap.cc:654] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.905458  3858 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:07.901641  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:07.910858  3553 leader_election.cc:343] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.886188  3856 raft_consensus.cc:385] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:07.911393  3856 raft_consensus.cc:740] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:07.911391  3553 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:07.912210  3856 consensus_queue.cc:260] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:07.913663  3903 raft_consensus.cc:2749] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:07.915167  3856 ts_tablet_manager.cc:1434] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:26:07.915755  3860 tablet_bootstrap.cc:492] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:07.916333  3856 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:07.916280  3860 ts_tablet_manager.cc:1403] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:26:07.921932  3975 raft_consensus.cc:493] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.922477  3975 raft_consensus.cc:515] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:07.910818  3858 tablet_bootstrap.cc:654] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:07.930191  4037 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.930757  4037 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:07.991571  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:07.994320  3703 leader_election.cc:343] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:07.995366  3975 leader_election.cc:290] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:07.997143  4037 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:07.999464  3860 raft_consensus.cc:359] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.000126  3860 raft_consensus.cc:385] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.000412  3860 raft_consensus.cc:740] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.000310  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.001400  3860 consensus_queue.cc:260] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.002295  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.003326  3860 ts_tablet_manager.cc:1434] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.083s	user 0.011s	sys 0.005s
I20260709 12:26:08.001261  3810 raft_consensus.cc:2468] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:08.004474  3860 tablet_bootstrap.cc:492] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:08.005195  3702 leader_election.cc:304] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.006042  3975 raft_consensus.cc:2804] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.006474  3975 raft_consensus.cc:493] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.006868  3975 raft_consensus.cc:3060] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.009735  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.010471  3858 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:08.010970  3858 ts_tablet_manager.cc:1403] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.004s
I20260709 12:26:08.010484  3810 raft_consensus.cc:2393] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 1: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:08.016016  3858 raft_consensus.cc:359] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.016674  3858 raft_consensus.cc:385] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.016927  3858 raft_consensus.cc:740] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.017695  3860 tablet_bootstrap.cc:654] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.020020  3662 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.017624  3858 consensus_queue.cc:260] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.024669  3858 ts_tablet_manager.cc:1434] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:08.023243  3857 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:08.027774  3857 ts_tablet_manager.cc:1403] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.000s
I20260709 12:26:08.028220  3858 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:08.022473  3628 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:08.030638  3857 raft_consensus.cc:359] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.031308  3857 raft_consensus.cc:385] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.031611  3857 raft_consensus.cc:740] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.032428  3857 consensus_queue.cc:260] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.033233  3957 consensus_queue.cc:1048] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.033952  4037 raft_consensus.cc:2749] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.041796  3857 ts_tablet_manager.cc:1434] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:26:08.044528  3860 tablet_bootstrap.cc:492] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:08.045039  3860 ts_tablet_manager.cc:1403] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.011s
I20260709 12:26:08.045265  3858 tablet_bootstrap.cc:654] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.046901  3975 raft_consensus.cc:515] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.047673  3860 raft_consensus.cc:359] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.048367  3860 raft_consensus.cc:385] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.048627  3860 raft_consensus.cc:740] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.049273  3860 consensus_queue.cc:260] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.049562  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:08.050954  3975 leader_election.cc:290] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:08.051373  3860 ts_tablet_manager.cc:1434] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:26:08.051512  3975 raft_consensus.cc:493] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.051944  3857 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:08.051959  3975 raft_consensus.cc:515] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.056598  3860 tablet_bootstrap.cc:492] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:08.057332  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:08.057919  3810 raft_consensus.cc:3060] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.058208  4037 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.058490  3975 leader_election.cc:290] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:08.058655  4037 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.057935  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:08.061785  3703 leader_election.cc:343] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.062938  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.064041  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.064671  3808 raft_consensus.cc:2468] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:08.065711  3860 tablet_bootstrap.cc:654] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.066403  4037 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:08.067162  3630 leader_election.cc:343] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.067603  3810 raft_consensus.cc:2468] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:08.061674  3857 tablet_bootstrap.cc:654] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.065857  3702 leader_election.cc:304] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.069552  3702 leader_election.cc:304] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:08.071085  3875 raft_consensus.cc:2804] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.071458  3875 raft_consensus.cc:493] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.071779  3875 raft_consensus.cc:3060] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.074846  4038 raft_consensus.cc:2804] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.075279  3860 tablet_bootstrap.cc:492] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:08.075362  4038 raft_consensus.cc:697] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:08.075871  3860 ts_tablet_manager.cc:1403] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:26:08.076304  4038 consensus_queue.cc:237] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.078516  3860 raft_consensus.cc:359] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.079167  3860 raft_consensus.cc:385] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.079453  3860 raft_consensus.cc:740] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.068367  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.090441  3808 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:08.091747  3628 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:08.092814  3856 tablet_bootstrap.cc:654] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.093724  3860 consensus_queue.cc:260] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.096696  3860 ts_tablet_manager.cc:1434] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:08.097687  3860 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
W20260709 12:26:08.097877  3703 leader_election.cc:343] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.100404  4037 raft_consensus.cc:2804] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.100819  4037 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.101158  4037 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.103195  3857 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:08.103698  3857 ts_tablet_manager.cc:1403] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.002s
I20260709 12:26:08.104372  3860 tablet_bootstrap.cc:654] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.108008  3857 raft_consensus.cc:359] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.108677  3857 raft_consensus.cc:385] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.108937  3857 raft_consensus.cc:740] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.109557  3857 consensus_queue.cc:260] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.112054  3857 ts_tablet_manager.cc:1434] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:26:08.117730  3858 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:08.118232  3858 ts_tablet_manager.cc:1403] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.012s
I20260709 12:26:08.119771  3857 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:08.121097  3858 raft_consensus.cc:359] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.121774  3858 raft_consensus.cc:385] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.122035  3858 raft_consensus.cc:740] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.122695  3858 consensus_queue.cc:260] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.124727  3858 ts_tablet_manager.cc:1434] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:08.126784  3857 tablet_bootstrap.cc:654] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.132843  3858 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:08.124830  3484 catalog_manager.cc:5697] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.135818  3875 raft_consensus.cc:515] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.142979  3906 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.143503  3906 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.145686  3906 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.148904  3587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.149667  3587 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:08.151000  3906 raft_consensus.cc:493] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.135605  3945 raft_consensus.cc:493] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.151492  3906 raft_consensus.cc:515] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.152141  3945 raft_consensus.cc:515] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.152432  3627 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:08.153414  4023 raft_consensus.cc:2804] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.153658  3906 leader_election.cc:290] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.153761  4023 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.154475  4023 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.154340  3945 leader_election.cc:290] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.151661  4037 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.168576  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.167506  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.166715  3587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.168663  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.173482  3905 consensus_queue.cc:1048] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.175081  4037 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:08.176348  3858 tablet_bootstrap.cc:654] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.177205  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:08.178642  3630 leader_election.cc:343] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.179045  3945 raft_consensus.cc:493] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.179514  3945 raft_consensus.cc:515] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.179528  3860 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:08.181079  3860 ts_tablet_manager.cc:1403] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.009s
I20260709 12:26:08.183311  4037 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.172853  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
W20260709 12:26:08.185582  3703 leader_election.cc:343] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:08.186491  3778 leader_election.cc:343] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.186803  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
W20260709 12:26:08.187335  3628 leader_election.cc:343] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.188009  3860 raft_consensus.cc:359] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.188680  3860 raft_consensus.cc:385] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.188949  3860 raft_consensus.cc:740] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.189576  3860 consensus_queue.cc:260] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.187453  3811 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.198161  3860 ts_tablet_manager.cc:1434] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:26:08.199273  3860 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:08.199494  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:08.200141  3812 raft_consensus.cc:3060] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.204275  3811 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:08.207031  3856 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:08.207506  3856 ts_tablet_manager.cc:1403] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.291s	user 0.009s	sys 0.018s
I20260709 12:26:08.207836  3857 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:08.208134  3860 tablet_bootstrap.cc:654] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.208288  3857 ts_tablet_manager.cc:1403] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.010s
I20260709 12:26:08.210120  3856 raft_consensus.cc:359] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.210807  3856 raft_consensus.cc:385] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.210944  3857 raft_consensus.cc:359] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.211223  3812 raft_consensus.cc:2468] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:08.211589  3857 raft_consensus.cc:385] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.212050  3857 raft_consensus.cc:740] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.212728  3857 consensus_queue.cc:260] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.215302  3945 leader_election.cc:290] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.213488  3856 raft_consensus.cc:740] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.216137  3856 consensus_queue.cc:260] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.217669  3856 ts_tablet_manager.cc:1434] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:26:08.180656  3587 raft_consensus.cc:2468] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:08.218869  3875 leader_election.cc:290] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:08.183327  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.222786  3588 raft_consensus.cc:2468] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:08.227788  3856 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:08.230360  3857 ts_tablet_manager.cc:1434] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 12:26:08.230593  3905 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.231391  3857 tablet_bootstrap.cc:492] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:08.231062  3905 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.233162  3905 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:08.233935  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.234743  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:08.236222  3554 leader_election.cc:343] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.191500  4037 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.238165  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.238473  4037 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.239790  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.240025  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.240597  3737 raft_consensus.cc:2468] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
W20260709 12:26:08.242101  3628 leader_election.cc:343] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.242161  3738 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:08.243657  3628 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:08.244036  3555 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.245131  3905 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.245491  3905 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.245949  3905 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.245368  3778 leader_election.cc:304] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:08.252539  3945 raft_consensus.cc:2804] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.252908  3945 raft_consensus.cc:493] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.225339  4023 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.253218  3945 raft_consensus.cc:3060] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.256354  3775 leader_election.cc:304] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:08.249034  4037 raft_consensus.cc:2804] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.257565  3972 raft_consensus.cc:2804] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.258008  3972 raft_consensus.cc:493] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.258394  3972 raft_consensus.cc:3060] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.258656  3627 leader_election.cc:304] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:08.260099  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.262164  4023 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.266651  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:08.267290  3584 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.260035  4037 raft_consensus.cc:697] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:08.273526  3856 tablet_bootstrap.cc:654] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:08.270726  3628 leader_election.cc:343] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.271620  4023 raft_consensus.cc:2804] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.270651  3702 leader_election.cc:304] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.280607  4023 raft_consensus.cc:493] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.281001  4023 raft_consensus.cc:3060] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.281597  3973 raft_consensus.cc:2804] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.281368  4037 consensus_queue.cc:237] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.282130  3973 raft_consensus.cc:697] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:08.282976  3973 consensus_queue.cc:237] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.277647  3875 consensus_queue.cc:1048] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.286362  3584 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
W20260709 12:26:08.278195  3627 leader_election.cc:343] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:08.274513  3775 leader_election.cc:343] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.288245  3627 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:08.289016  3906 raft_consensus.cc:2749] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.290191  3627 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:08.290943  3906 raft_consensus.cc:2804] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.292115  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:08.293152  3860 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
W20260709 12:26:08.293455  3628 leader_election.cc:343] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.293681  3860 ts_tablet_manager.cc:1403] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.015s
I20260709 12:26:08.295704  3858 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:08.296383  3858 ts_tablet_manager.cc:1403] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.170s	user 0.036s	sys 0.022s
I20260709 12:26:08.296777  3860 raft_consensus.cc:359] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.297560  3860 raft_consensus.cc:385] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.297883  3860 raft_consensus.cc:740] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.298688  3860 consensus_queue.cc:260] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.300459  3858 raft_consensus.cc:359] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.301151  3858 raft_consensus.cc:385] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.301405  3858 raft_consensus.cc:740] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.302057  3858 consensus_queue.cc:260] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.303107  3906 raft_consensus.cc:697] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:08.286664  3857 tablet_bootstrap.cc:654] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.290822  3945 raft_consensus.cc:515] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.305675  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:08.306217  3738 raft_consensus.cc:3060] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.307153  4038 consensus_queue.cc:1048] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.307804  3906 consensus_queue.cc:237] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.312774  3738 raft_consensus.cc:2468] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:08.313643  3860 ts_tablet_manager.cc:1434] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:08.292798  4023 raft_consensus.cc:515] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.302584  3972 raft_consensus.cc:515] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.321236  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:08.321807  3586 raft_consensus.cc:3060] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.322754  4023 leader_election.cc:290] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.325003  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:08.325659  3589 raft_consensus.cc:3060] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.314139  3778 leader_election.cc:304] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:08.316847  3860 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:08.330338  3884 raft_consensus.cc:2804] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.332610  3857 tablet_bootstrap.cc:492] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:08.332839  3589 raft_consensus.cc:2468] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:08.333091  3857 ts_tablet_manager.cc:1403] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.006s
I20260709 12:26:08.335291  3627 leader_election.cc:304] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:08.336810  4023 raft_consensus.cc:2804] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.337312  4023 raft_consensus.cc:697] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:08.338143  4023 consensus_queue.cc:237] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.317679  3858 ts_tablet_manager.cc:1434] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:26:08.316352  3905 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.342371  3858 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:08.345176  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:08.345502  3860 tablet_bootstrap.cc:654] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.345990  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
W20260709 12:26:08.346567  3554 leader_election.cc:343] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.347434  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:08.341364  3586 raft_consensus.cc:2468] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:08.349233  3775 leader_election.cc:304] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:08.349756  3485 catalog_manager.cc:5697] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:08.352008  3628 leader_election.cc:343] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.356815  4037 raft_consensus.cc:493] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.358421  4037 raft_consensus.cc:515] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:08.361017  3778 leader_election.cc:343] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.363642  3487 catalog_manager.cc:5697] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.366611  3945 leader_election.cc:290] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.367012  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:08.404210  3738 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.404692  3860 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:08.405503  3860 ts_tablet_manager.cc:1403] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.007s
I20260709 12:26:08.367684  3905 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:08.406883  3485 catalog_manager.cc:5697] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.370409  3856 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:08.408790  3860 raft_consensus.cc:359] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.373400  4091 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.409933  4091 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.410096  3485 catalog_manager.cc:5697] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.411119  3738 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:08.412058  4091 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:08.412369  3555 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.412997  3905 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.413439  3905 raft_consensus.cc:697] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:08.414191  3905 consensus_queue.cc:237] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.415069  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:08.374001  3884 raft_consensus.cc:697] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:08.375794  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:08.379045  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.379560  4037 leader_election.cc:290] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.381002  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.418187  3589 raft_consensus.cc:2468] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:08.417994  3884 consensus_queue.cc:237] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.419669  3627 leader_election.cc:304] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:08.420753  4037 raft_consensus.cc:2804] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.421180  4037 raft_consensus.cc:493] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.388188  4094 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.422703  4094 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.389297  3858 tablet_bootstrap.cc:654] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.382411  3857 raft_consensus.cc:359] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.400020  3972 leader_election.cc:290] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.409247  3856 ts_tablet_manager.cc:1403] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.000s
I20260709 12:26:08.373027  4090 raft_consensus.cc:2804] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.426491  4090 raft_consensus.cc:697] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:08.427561  4094 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:08.427302  4090 consensus_queue.cc:237] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.429531  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:08.421375  3860 raft_consensus.cc:385] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.430387  3860 raft_consensus.cc:740] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
W20260709 12:26:08.431799  3777 leader_election.cc:343] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.432507  4037 raft_consensus.cc:3060] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.433013  3856 raft_consensus.cc:359] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.433682  3856 raft_consensus.cc:385] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.433950  3856 raft_consensus.cc:740] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.434710  3856 consensus_queue.cc:260] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:08.436174  3628 leader_election.cc:343] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.437284  3856 ts_tablet_manager.cc:1434] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:26:08.438349  3856 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:08.396162  4099 raft_consensus.cc:493] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:08.422082  3775 leader_election.cc:343] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.439934  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.440828  4099 raft_consensus.cc:515] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.441701  3810 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.443071  3860 consensus_queue.cc:260] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.445542  3860 ts_tablet_manager.cc:1434] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.040s	user 0.002s	sys 0.004s
I20260709 12:26:08.445739  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:08.446653  3860 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:08.443478  4099 leader_election.cc:290] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:08.447829  3857 raft_consensus.cc:385] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.448137  3857 raft_consensus.cc:740] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.448961  3857 consensus_queue.cc:260] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.446563  3663 raft_consensus.cc:2468] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:08.452363  3777 leader_election.cc:304] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:08.453136  3778 leader_election.cc:343] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.453627  3778 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.454407  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.455118  3738 raft_consensus.cc:2468] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:08.455646  3884 raft_consensus.cc:2804] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.456844  3884 raft_consensus.cc:493] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.457252  3884 raft_consensus.cc:3060] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.459879  4090 raft_consensus.cc:2749] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.460726  3485 catalog_manager.cc:5697] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.465013  3884 raft_consensus.cc:515] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.467751  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:08.468298  3663 raft_consensus.cc:3060] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.469952  4037 raft_consensus.cc:515] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.474865  3663 raft_consensus.cc:2468] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:08.477239  3777 leader_election.cc:304] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:08.479458  3884 leader_election.cc:290] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:08.478533  3857 ts_tablet_manager.cc:1434] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.000s
I20260709 12:26:08.480165  3884 raft_consensus.cc:2804] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.480880  3884 raft_consensus.cc:697] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:08.421486  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.481175  3857 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:08.483747  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:08.483773  3584 raft_consensus.cc:2393] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:08.484920  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:08.485498  3738 raft_consensus.cc:3060] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.488422  3856 tablet_bootstrap.cc:654] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.481807  3884 consensus_queue.cc:237] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.490442  4037 leader_election.cc:290] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.489542  3860 tablet_bootstrap.cc:654] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:08.493577  3628 leader_election.cc:343] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.498898  3738 raft_consensus.cc:2468] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:08.505154  3775 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.506456  4099 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.508828  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:08.512727  3584 raft_consensus.cc:3060] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.519536  3856 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:08.520076  3856 ts_tablet_manager.cc:1403] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.006s
I20260709 12:26:08.520750  3858 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:08.522068  3858 ts_tablet_manager.cc:1403] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.180s	user 0.020s	sys 0.005s
I20260709 12:26:08.522778  3856 raft_consensus.cc:359] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.523558  3856 raft_consensus.cc:385] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.523877  3856 raft_consensus.cc:740] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.521441  3857 tablet_bootstrap.cc:654] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:08.521597  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:08.526501  3858 raft_consensus.cc:359] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.527238  3858 raft_consensus.cc:385] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.527352  4099 raft_consensus.cc:2749] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.527607  3858 raft_consensus.cc:740] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.532567  3857 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:08.532322  3858 consensus_queue.cc:260] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.533023  3857 ts_tablet_manager.cc:1403] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.001s
I20260709 12:26:08.534405  3858 ts_tablet_manager.cc:1434] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.004s
I20260709 12:26:08.535478  3858 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:08.531481  3584 raft_consensus.cc:2468] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:08.538445  3627 leader_election.cc:304] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:08.540113  3906 raft_consensus.cc:2804] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.540622  3906 raft_consensus.cc:697] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:08.524534  3856 consensus_queue.cc:260] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.541878  3860 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:08.542348  3860 ts_tablet_manager.cc:1403] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.096s	user 0.004s	sys 0.009s
I20260709 12:26:08.543552  3856 ts_tablet_manager.cc:1434] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:26:08.544718  3856 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:08.541437  3906 consensus_queue.cc:237] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.545081  3860 raft_consensus.cc:359] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.545779  3860 raft_consensus.cc:385] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.546043  3860 raft_consensus.cc:740] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.546629  3860 consensus_queue.cc:260] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.548724  3860 ts_tablet_manager.cc:1434] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:26:08.549721  3860 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:08.551177  3856 tablet_bootstrap.cc:654] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.553102  3858 tablet_bootstrap.cc:654] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.557114  3860 tablet_bootstrap.cc:654] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.562090  3856 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:08.562525  3856 ts_tablet_manager.cc:1403] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.010s
I20260709 12:26:08.568764  3856 raft_consensus.cc:359] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.569393  3856 raft_consensus.cc:385] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.569667  3856 raft_consensus.cc:740] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.570494  3856 consensus_queue.cc:260] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.529851  3487 catalog_manager.cc:5697] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.573101  3856 ts_tablet_manager.cc:1434] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:08.574198  3856 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:08.575899  3858 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:08.577003  3858 ts_tablet_manager.cc:1403] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.003s
I20260709 12:26:08.578979  3860 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:08.579535  3860 ts_tablet_manager.cc:1403] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:26:08.581732  3858 raft_consensus.cc:359] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.582448  3858 raft_consensus.cc:385] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.582196  3860 raft_consensus.cc:359] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.582820  3858 raft_consensus.cc:740] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.582892  3860 raft_consensus.cc:385] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.583331  3860 raft_consensus.cc:740] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.583822  3858 consensus_queue.cc:260] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.589605  3858 ts_tablet_manager.cc:1434] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:08.590655  3858 tablet_bootstrap.cc:492] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:08.589674  3483 catalog_manager.cc:5697] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.584012  3860 consensus_queue.cc:260] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.585667  3856 tablet_bootstrap.cc:654] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.592031  3483 catalog_manager.cc:5697] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.586074  3484 catalog_manager.cc:5697] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.594512  3860 ts_tablet_manager.cc:1434] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:08.595515  3860 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:08.599272  3858 tablet_bootstrap.cc:654] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.578735  3857 raft_consensus.cc:359] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.604190  3857 raft_consensus.cc:385] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.604588  3857 raft_consensus.cc:740] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.606772  4037 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.607367  4037 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.605546  3857 consensus_queue.cc:260] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.609632  4037 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:08.614243  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:08.615743  3630 leader_election.cc:343] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.621874  3884 raft_consensus.cc:493] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.622419  3884 raft_consensus.cc:515] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.624703  3884 leader_election.cc:290] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:08.627630  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.628436  3589 raft_consensus.cc:2393] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:08.630662  3857 ts_tablet_manager.cc:1434] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.001s
I20260709 12:26:08.632091  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:08.634382  3857 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:08.637158  3777 leader_election.cc:304] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.638413  3884 raft_consensus.cc:3060] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.641703  3875 consensus_queue.cc:1048] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.642630  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
W20260709 12:26:08.644088  3627 leader_election.cc:343] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.644534  3627 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:08.645310  3703 consensus_peers.cc:597] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.645694  3906 raft_consensus.cc:2749] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.648918  3884 raft_consensus.cc:2749] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.667197  4038 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.667712  4038 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.668855  3857 tablet_bootstrap.cc:654] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.669903  4038 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.670540  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:08.671250  3812 raft_consensus.cc:2468] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:08.672133  3858 tablet_bootstrap.cc:492] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:08.672664  3858 ts_tablet_manager.cc:1403] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.017s
I20260709 12:26:08.673722  3702 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:08.674654  4038 raft_consensus.cc:2804] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:08.675077  4038 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.675448  4038 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.675390  3858 raft_consensus.cc:359] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.677207  3858 raft_consensus.cc:385] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.677472  3858 raft_consensus.cc:740] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.678148  3858 consensus_queue.cc:260] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.682720  3858 ts_tablet_manager.cc:1434] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:26:08.686276  3858 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:08.686168  4038 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.694537  3856 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:08.695186  3856 ts_tablet_manager.cc:1403] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.013s
I20260709 12:26:08.697459  3858 tablet_bootstrap.cc:654] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.699151  3856 raft_consensus.cc:359] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.699875  3856 raft_consensus.cc:385] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.700130  3856 raft_consensus.cc:740] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.700773  3856 consensus_queue.cc:260] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.702968  3856 ts_tablet_manager.cc:1434] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 12:26:08.705987  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:08.706568  3812 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.714107  3812 raft_consensus.cc:2468] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:08.715423  3702 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:08.716399  3875 raft_consensus.cc:2804] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:08.716886  3875 raft_consensus.cc:697] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:08.717726  3875 consensus_queue.cc:237] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.720309  3975 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.720865  3975 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:08.722965  3975 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:08.725656  3856 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:08.726454  4038 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.738986  3856 tablet_bootstrap.cc:654] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.745412  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:08.746052  3586 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.754701  3905 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.755215  3905 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.757282  3905 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:08.764361  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.775740  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:08.777186  3553 leader_election.cc:343] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.778275  3906 consensus_queue.cc:1048] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.783161  3906 consensus_queue.cc:1048] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.783867  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.791314  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:08.794598  3703 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:08.795671  4038 raft_consensus.cc:2749] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.798820  4083 consensus_queue.cc:1048] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.803519  4083 consensus_queue.cc:1048] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:08.807235  3856 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:08.807714  3856 ts_tablet_manager.cc:1403] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.005s
I20260709 12:26:08.810284  3856 raft_consensus.cc:359] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.810907  3856 raft_consensus.cc:385] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.811167  3856 raft_consensus.cc:740] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:08.815845  3856 consensus_queue.cc:260] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.818163  3856 ts_tablet_manager.cc:1434] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:08.819268  3856 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:08.819657  3906 raft_consensus.cc:493] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.820194  3906 raft_consensus.cc:515] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:08.824602  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:08.826438  3628 leader_election.cc:343] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.826752  3856 tablet_bootstrap.cc:654] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.827067  3906 leader_election.cc:290] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:08.838177  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:08.842649  3703 consensus_peers.cc:597] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.843269  4038 consensus_queue.cc:1048] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:08.851222  3630 leader_election.cc:343] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.851673  3630 leader_election.cc:304] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:08.852428  3906 raft_consensus.cc:2749] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.852466  4099 consensus_queue.cc:1048] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:08.853719  3630 consensus_peers.cc:597] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.855118  3585 raft_consensus.cc:3060] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.862560  3906 consensus_queue.cc:1048] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.863421  3860 tablet_bootstrap.cc:654] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.866405  3586 raft_consensus.cc:2468] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:08.867918  3972 raft_consensus.cc:493] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.868404  3972 raft_consensus.cc:515] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.871316  3972 leader_election.cc:290] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:08.871886  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:08.879199  3957 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.879686  3957 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.881815  3957 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:08.883373  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:08.884768  3553 leader_election.cc:343] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:08.905866  3555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 148331us
I20260709 12:26:08.907689  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.909677  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:08.912719  3738 raft_consensus.cc:3060] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:08.919917  3857 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:08.920432  3857 ts_tablet_manager.cc:1403] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.289s	user 0.030s	sys 0.064s
I20260709 12:26:08.923792  3857 raft_consensus.cc:359] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.924439  3857 raft_consensus.cc:385] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:08.924692  3857 raft_consensus.cc:740] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
W20260709 12:26:08.929677  3555 leader_election.cc:343] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:08.929868  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:08.930142  3555 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:08.930500  3857 consensus_queue.cc:260] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:08.932703  3857 ts_tablet_manager.cc:1434] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:08.933703  3857 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:08.939435  3857 tablet_bootstrap.cc:654] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:08.943358  4091 consensus_queue.cc:1048] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:08.945170  3811 raft_consensus.cc:3060] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:08.954748  3554 consensus_peers.cc:597] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.962548  3957 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:08.970521  3906 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.971195  3906 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:08.975308  3906 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:08.986491  3586 raft_consensus.cc:2393] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:08.981576  4121 raft_consensus.cc:493] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:08.983426  3555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 53783.4us
I20260709 12:26:08.995903  4121 raft_consensus.cc:515] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.001833  4121 leader_election.cc:290] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:09.125320  3555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 129060us
I20260709 12:26:09.125427  3585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:09.126144  3585 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
W20260709 12:26:09.126335  3555 leader_election.cc:343] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.127765  3555 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:09.128897  3627 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:09.129019  3775 leader_election.cc:304] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:09.131029  4121 consensus_queue.cc:1048] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.134395  4134 raft_consensus.cc:2749] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.155493  3860 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:09.155982  3860 ts_tablet_manager.cc:1403] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.561s	user 0.015s	sys 0.004s
I20260709 12:26:09.156528  4099 raft_consensus.cc:2749] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.158812  4137 consensus_queue.cc:1048] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.160223  4137 raft_consensus.cc:2804] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.160567  4137 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.160872  4137 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.164249  4138 consensus_queue.cc:1048] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.167042  3858 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:09.169064  3858 ts_tablet_manager.cc:1403] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.483s	user 0.046s	sys 0.042s
I20260709 12:26:09.169494  4137 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.171675  4137 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:09.172729  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
W20260709 12:26:09.174216  3628 leader_election.cc:343] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.175056  3858 raft_consensus.cc:359] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.175526  3858 raft_consensus.cc:385] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.175681  3858 raft_consensus.cc:740] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.176414  3858 consensus_queue.cc:260] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.178066  3858 ts_tablet_manager.cc:1434] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:26:09.179057  3858 tablet_bootstrap.cc:492] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:09.184937  3858 tablet_bootstrap.cc:654] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.185640  3860 raft_consensus.cc:359] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.186312  3860 raft_consensus.cc:385] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.186578  3860 raft_consensus.cc:740] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.187191  3860 consensus_queue.cc:260] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.188424  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:09.188727  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:09.194379  3586 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.213398  3860 ts_tablet_manager.cc:1434] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:26:09.218498  3975 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.230619  3860 tablet_bootstrap.cc:492] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:09.232158  3884 consensus_queue.cc:1048] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.219122  3975 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.242699  4135 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.243266  4135 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.245745  4135 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:09.249265  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:09.249956  3663 raft_consensus.cc:2468] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:09.254350  3554 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:09.255668  3957 raft_consensus.cc:2804] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.256073  3957 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.256397  3957 raft_consensus.cc:3060] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.256316  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:09.258116  3975 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:09.259310  3553 leader_election.cc:343] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.264458  3856 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:09.264768  3858 tablet_bootstrap.cc:492] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:09.264947  3856 ts_tablet_manager.cc:1403] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.446s	user 0.011s	sys 0.023s
I20260709 12:26:09.265226  3858 ts_tablet_manager.cc:1403] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.011s
I20260709 12:26:09.263216  3586 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:09.268261  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:09.273689  3957 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.277133  4143 consensus_queue.cc:1048] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.278025  3957 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:09.278864  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:09.279493  3662 raft_consensus.cc:3060] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.279309  3858 raft_consensus.cc:359] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.280164  3858 raft_consensus.cc:385] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.280506  3858 raft_consensus.cc:740] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.281147  3858 consensus_queue.cc:260] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.281967  3856 raft_consensus.cc:359] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.282603  3856 raft_consensus.cc:385] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.282852  3856 raft_consensus.cc:740] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.283424  3858 ts_tablet_manager.cc:1434] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:26:09.280088  3627 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:09.284497  3906 raft_consensus.cc:2804] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.284958  3906 raft_consensus.cc:697] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:09.285604  3553 leader_election.cc:304] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:09.285770  3906 consensus_queue.cc:237] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.286823  4134 raft_consensus.cc:2749] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:09.283502  3856 consensus_queue.cc:260] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.289309  3662 raft_consensus.cc:2468] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:09.290086  3856 ts_tablet_manager.cc:1434] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:26:09.290582  3554 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:09.291117  3856 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:09.291486  4134 raft_consensus.cc:2804] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.291493  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:09.292109  4134 raft_consensus.cc:697] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:09.292925  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:09.294173  3858 tablet_bootstrap.cc:492] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:09.292953  4134 consensus_queue.cc:237] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:09.301146  3553 leader_election.cc:343] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:09.302722  3628 leader_election.cc:343] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.307220  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:09.307950  3586 raft_consensus.cc:2468] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:09.313755  3860 tablet_bootstrap.cc:654] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.315239  4091 consensus_queue.cc:1048] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.318010  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:09.320593  3806 raft_consensus.cc:2468] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:09.326869  3702 leader_election.cc:304] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:09.342316  3856 tablet_bootstrap.cc:654] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.344339  3875 raft_consensus.cc:2804] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.344801  3875 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.345027  3858 tablet_bootstrap.cc:654] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.345163  3875 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.350546  3972 consensus_queue.cc:1048] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:09.355993  3778 consensus_peers.cc:597] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.358940  4144 consensus_queue.cc:1048] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.360889  3857 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:09.361357  3857 ts_tablet_manager.cc:1403] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.428s	user 0.028s	sys 0.020s
I20260709 12:26:09.362414  3875 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.378103  4135 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.378820  4135 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.381500  4135 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:09.381834  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:09.382349  3856 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:09.382879  3856 ts_tablet_manager.cc:1403] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.003s
W20260709 12:26:09.383386  3554 leader_election.cc:343] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.389070  3856 raft_consensus.cc:359] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.390306  3856 raft_consensus.cc:385] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.390566  3856 raft_consensus.cc:740] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.391196  3856 consensus_queue.cc:260] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.393116  3856 ts_tablet_manager.cc:1434] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:09.394058  3856 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:09.400756  3875 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:09.401340  3857 raft_consensus.cc:359] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.402079  3857 raft_consensus.cc:385] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.402400  3857 raft_consensus.cc:740] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.403129  3857 consensus_queue.cc:260] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.431391  3857 ts_tablet_manager.cc:1434] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:26:09.432554  3857 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:09.435114  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:09.435870  3586 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.444574  4023 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.445212  4023 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.448005  3585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:09.449668  3860 tablet_bootstrap.cc:492] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:09.450166  3860 ts_tablet_manager.cc:1403] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.221s	user 0.009s	sys 0.002s
I20260709 12:26:09.451795  3662 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.452858  3860 raft_consensus.cc:359] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.453547  3860 raft_consensus.cc:385] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.453794  3860 raft_consensus.cc:740] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.454461  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:09.456115  3484 catalog_manager.cc:5697] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.456111  3630 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:09.460786  3856 tablet_bootstrap.cc:654] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.460579  3860 consensus_queue.cc:260] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.466087  3586 raft_consensus.cc:2468] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:09.460330  4023 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:09.474717  3860 ts_tablet_manager.cc:1434] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.007s
I20260709 12:26:09.475919  3857 tablet_bootstrap.cc:654] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.488253  3858 tablet_bootstrap.cc:492] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:09.488742  3858 ts_tablet_manager.cc:1403] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.204s	user 0.038s	sys 0.039s
I20260709 12:26:09.492501  3701 leader_election.cc:304] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:09.493563  4038 raft_consensus.cc:2804] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.494887  3860 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:09.494060  4038 raft_consensus.cc:697] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
W20260709 12:26:09.475903  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 133386us
I20260709 12:26:09.501456  4038 consensus_queue.cc:237] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.502013  4091 raft_consensus.cc:493] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.502523  4091 raft_consensus.cc:515] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.509572  4091 leader_election.cc:290] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:09.510144  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:09.510782  3663 raft_consensus.cc:2468] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:09.511902  3777 leader_election.cc:304] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:09.513630  4091 raft_consensus.cc:2804] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.513991  4091 raft_consensus.cc:493] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.513954  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:09.514611  4091 raft_consensus.cc:3060] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.523192  4135 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.523842  4135 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.547160  3860 tablet_bootstrap.cc:654] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.549897  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:09.550539  3808 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.553236  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:09.553912  3664 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:09.554618  4135 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:09.555366  3856 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:09.555847  3856 ts_tablet_manager.cc:1403] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.007s
I20260709 12:26:09.557400  4091 raft_consensus.cc:515] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.559322  3554 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:09.546823  3778 leader_election.cc:343] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.560259  4134 raft_consensus.cc:2804] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.558565  3856 raft_consensus.cc:359] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.560745  4134 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.561179  4134 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.561070  3858 raft_consensus.cc:359] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.561766  3858 raft_consensus.cc:385] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.560160  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:09.562029  3858 raft_consensus.cc:740] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.562461  3664 raft_consensus.cc:3060] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.560829  3856 raft_consensus.cc:385] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.560161  3857 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:09.564570  3857 ts_tablet_manager.cc:1403] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.132s	user 0.011s	sys 0.020s
I20260709 12:26:09.565433  3661 raft_consensus.cc:3060] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.567272  3857 raft_consensus.cc:359] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.567938  3857 raft_consensus.cc:385] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.568181  3857 raft_consensus.cc:740] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.559448  4091 leader_election.cc:290] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
W20260709 12:26:09.560364  3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 43487.3us
I20260709 12:26:09.570138  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:09.569782  3858 consensus_queue.cc:260] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.571980  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:09.576191  3857 consensus_queue.cc:260] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.577441  3733 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:09.573520  3664 raft_consensus.cc:2468] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:09.568416  3808 raft_consensus.cc:2468] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:09.562963  3856 raft_consensus.cc:740] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.582131  3858 ts_tablet_manager.cc:1434] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.002s
I20260709 12:26:09.582069  3856 consensus_queue.cc:260] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.583184  3858 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:09.579888  3777 leader_election.cc:304] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:09.585305  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:09.585889  4091 raft_consensus.cc:2804] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.586234  3856 ts_tablet_manager.cc:1434] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.002s
I20260709 12:26:09.587077  4091 raft_consensus.cc:697] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:09.588021  4091 consensus_queue.cc:237] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.590011  3856 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
W20260709 12:26:09.592906  3778 leader_election.cc:343] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.598044  3858 tablet_bootstrap.cc:654] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.598889  4134 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:09.605402  3555 leader_election.cc:343] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.605891  3555 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:09.606631  4121 raft_consensus.cc:2749] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.608964  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:09.609591  3663 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.610383  4134 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:09.613008  3860 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:09.613500  3860 ts_tablet_manager.cc:1403] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.005s
I20260709 12:26:09.614720  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:09.615311  3733 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.616115  3860 raft_consensus.cc:359] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.616770  3860 raft_consensus.cc:385] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.617025  3860 raft_consensus.cc:740] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.619273  4138 raft_consensus.cc:2749] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.622372  3856 tablet_bootstrap.cc:654] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:09.623617  4160 log.cc:927] Time spent T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: Append to log took a long time: real 0.060s	user 0.005s	sys 0.000s
I20260709 12:26:09.620623  3860 consensus_queue.cc:260] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.629506  3860 ts_tablet_manager.cc:1434] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:26:09.630489  3857 ts_tablet_manager.cc:1434] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 12:26:09.637573  3733 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:09.638306  3860 tablet_bootstrap.cc:492] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:09.638707  3857 tablet_bootstrap.cc:492] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:09.639209  3555 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:09.640542  4134 raft_consensus.cc:2804] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:09.631927  3663 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:09.641018  4134 raft_consensus.cc:697] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:09.646751  4134 consensus_queue.cc:237] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.649956  3857 tablet_bootstrap.cc:654] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.659425  3860 tablet_bootstrap.cc:654] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:09.661415  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:09.688467  3858 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:09.689014  3858 ts_tablet_manager.cc:1403] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.007s
I20260709 12:26:09.711407  3856 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:09.711540  3857 tablet_bootstrap.cc:492] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:09.711237  3858 raft_consensus.cc:359] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.712009  3858 raft_consensus.cc:385] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.712337  3858 raft_consensus.cc:740] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.712998  3858 consensus_queue.cc:260] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:09.715358  3858 ts_tablet_manager.cc:1434] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:26:09.715921  3733 raft_consensus.cc:3060] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.716387  3858 tablet_bootstrap.cc:492] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:09.711948  3856 ts_tablet_manager.cc:1403] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.001s
I20260709 12:26:09.735949  3857 ts_tablet_manager.cc:1403] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.012s
I20260709 12:26:09.756512  4135 consensus_queue.cc:1048] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:09.761039  4134 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.761539  4134 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:09.773423  3628 consensus_peers.cc:597] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:09.775393  3553 consensus_peers.cc:597] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.776782  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:09.777354  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:09.778154  3553 leader_election.cc:343] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:09.779117  3555 leader_election.cc:343] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.775373  4134 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:09.779558  3555 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:09.781608  3856 raft_consensus.cc:359] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.782308  3856 raft_consensus.cc:385] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.782562  3856 raft_consensus.cc:740] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.784058  4134 raft_consensus.cc:2749] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.784659  4138 consensus_queue.cc:1048] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:09.783185  3856 consensus_queue.cc:260] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.786969  3860 tablet_bootstrap.cc:492] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:09.791313  3860 ts_tablet_manager.cc:1403] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.159s	user 0.019s	sys 0.010s
I20260709 12:26:09.798800  3856 ts_tablet_manager.cc:1434] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.004s
I20260709 12:26:09.800554  3860 raft_consensus.cc:359] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.811340  3858 tablet_bootstrap.cc:654] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.801184  3860 raft_consensus.cc:385] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.812551  3860 raft_consensus.cc:740] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.811491  3857 raft_consensus.cc:359] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.813180  3857 raft_consensus.cc:385] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.813467  3857 raft_consensus.cc:740] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.812182  3483 catalog_manager.cc:5697] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } }
I20260709 12:26:09.815536  3856 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:09.816937  3860 consensus_queue.cc:260] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.818876  3857 consensus_queue.cc:260] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.821365  4023 raft_consensus.cc:493] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.821841  4023 raft_consensus.cc:515] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.819263  4090 raft_consensus.cc:493] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.824911  4090 raft_consensus.cc:515] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.828856  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:09.832726  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:09.823505  4023 leader_election.cc:290] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:09.835134  3483 catalog_manager.cc:5697] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.836858  3860 ts_tablet_manager.cc:1434] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:26:09.837308  3628 leader_election.cc:304] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:09.838137  4023 raft_consensus.cc:2749] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.838668  3860 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:09.840555  3857 ts_tablet_manager.cc:1434] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260709 12:26:09.842895  4090 leader_election.cc:290] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:09.843679  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:09.844530  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:09.845307  3777 leader_election.cc:343] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:09.849865  3778 leader_election.cc:343] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.850488  3778 leader_election.cc:304] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:09.853610  3856 tablet_bootstrap.cc:654] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.854974  4091 raft_consensus.cc:2749] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:09.859396  3662 raft_consensus.cc:3060] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.860733  3860 tablet_bootstrap.cc:654] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.865453  3857 tablet_bootstrap.cc:492] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:09.869804  3858 tablet_bootstrap.cc:492] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:09.870321  3858 ts_tablet_manager.cc:1403] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.001s
I20260709 12:26:09.873054  3858 raft_consensus.cc:359] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.873705  3858 raft_consensus.cc:385] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.873958  3858 raft_consensus.cc:740] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.874653  3858 consensus_queue.cc:260] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.878684  3856 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:09.878739  3858 ts_tablet_manager.cc:1434] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:09.879339  3856 ts_tablet_manager.cc:1403] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.006s
I20260709 12:26:09.881973  3856 raft_consensus.cc:359] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.882580  3856 raft_consensus.cc:385] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.882838  3856 raft_consensus.cc:740] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.883414  3856 consensus_queue.cc:260] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.885527  3858 tablet_bootstrap.cc:492] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:09.886422  3856 ts_tablet_manager.cc:1434] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:26:09.887444  3856 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:09.891665  3858 tablet_bootstrap.cc:654] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.892748  3856 tablet_bootstrap.cc:654] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.902418  3860 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:09.902926  3860 ts_tablet_manager.cc:1403] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.002s
I20260709 12:26:09.919337  3857 tablet_bootstrap.cc:654] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:09.921021  3860 raft_consensus.cc:359] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.924289  3860 raft_consensus.cc:385] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:09.924572  3860 raft_consensus.cc:740] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:09.925207  3860 consensus_queue.cc:260] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:09.947276  4083 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.947837  4083 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:09.949831  4083 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:09.950511  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:09.952865  3630 leader_election.cc:343] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.897086  3482 catalog_manager.cc:5697] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.957597  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:09.958273  3808 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:09.960383  3628 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:09.961769  4138 raft_consensus.cc:2804] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:09.963032  3860 ts_tablet_manager.cc:1434] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 12:26:09.962137  4138 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.965201  3858 tablet_bootstrap.cc:492] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:09.965879  3858 ts_tablet_manager.cc:1403] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.011s
W20260709 12:26:09.966750  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 62145.5us
I20260709 12:26:09.972059  3860 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:09.965468  4138 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:09.969185  4090 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.982179  4090 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:09.984213  4090 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:09.985672  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:09.987103  3778 leader_election.cc:343] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:09.993551  4144 consensus_queue.cc:1048] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:09.997298  3759 debug-util.cc:398] Leaking SignalData structure 0x7b08002538a0 after lost signal to thread 29735
W20260709 12:26:09.998486  3759 debug-util.cc:398] Leaking SignalData structure 0x7b0800265a60 after lost signal to thread 3521
W20260709 12:26:09.999691  3759 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb680 after lost signal to thread 3613
I20260709 12:26:10.001219  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:10.007539  3586 raft_consensus.cc:2468] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:09.997409  3858 raft_consensus.cc:359] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.006685  3856 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:10.008414  3858 raft_consensus.cc:385] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.008764  3858 raft_consensus.cc:740] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.008836  3856 ts_tablet_manager.cc:1403] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.026s
I20260709 12:26:10.009413  3858 consensus_queue.cc:260] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.010747  4138 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
W20260709 12:26:09.971686  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 74688.2us
I20260709 12:26:10.011734  3858 ts_tablet_manager.cc:1434] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:26:10.011576  3856 raft_consensus.cc:359] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.014787  3856 raft_consensus.cc:385] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.015089  3856 raft_consensus.cc:740] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
W20260709 12:26:10.006795  3759 debug-util.cc:398] Leaking SignalData structure 0x7b08001c7ea0 after lost signal to thread 3688
I20260709 12:26:10.019901  3858 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:10.017119  3856 consensus_queue.cc:260] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.024492  3487 catalog_manager.cc:5697] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.026089  3856 ts_tablet_manager.cc:1434] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:26:10.024173  4083 raft_consensus.cc:493] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.034539  4083 raft_consensus.cc:515] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
W20260709 12:26:10.032368  3759 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb2c0 after lost signal to thread 3762
W20260709 12:26:10.036293  3759 debug-util.cc:398] Leaking SignalData structure 0x7b0800199d00 after lost signal to thread 3836
I20260709 12:26:10.037711  3856 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:10.038416  4083 leader_election.cc:290] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:10.024397  3554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 70790.8us
I20260709 12:26:10.018024  3775 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.042888  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:10.044361  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:10.046011  3857 tablet_bootstrap.cc:492] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:10.046504  3857 ts_tablet_manager.cc:1403] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.197s	user 0.030s	sys 0.018s
I20260709 12:26:10.047783  3860 tablet_bootstrap.cc:654] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.049301  3972 raft_consensus.cc:2804] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.049647  3972 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.049984  3972 raft_consensus.cc:3060] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.050563  3858 tablet_bootstrap.cc:654] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:10.051990  3628 leader_election.cc:343] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.056746  3972 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.058166  3856 tablet_bootstrap.cc:654] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.058811  3972 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:10.059597  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 43489us
I20260709 12:26:10.065922  4138 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:10.065204  3630 leader_election.cc:343] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.067027  3630 leader_election.cc:304] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.067479  4181 consensus_queue.cc:1048] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.070243  4138 raft_consensus.cc:2749] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.073051  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:10.077740  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:10.078365  3806 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.078953  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:10.080569  3778 leader_election.cc:343] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:10.088958  3630 leader_election.cc:343] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.103160  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:10.103940  3586 raft_consensus.cc:3060] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.110737  4151 consensus_queue.cc:1048] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.112576  3857 raft_consensus.cc:359] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.113142  3857 raft_consensus.cc:385] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.113333  3857 raft_consensus.cc:740] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.122653  3806 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:10.124959  3628 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.127713  4083 raft_consensus.cc:2804] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:10.128604  3483 catalog_manager.cc:5697] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.136204  3858 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:10.136616  3858 ts_tablet_manager.cc:1403] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.009s
I20260709 12:26:10.132963  3857 consensus_queue.cc:260] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.141974  3858 raft_consensus.cc:359] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.142606  3858 raft_consensus.cc:385] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.142860  3858 raft_consensus.cc:740] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.144819  3860 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:10.145318  3860 ts_tablet_manager.cc:1403] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.177s	user 0.008s	sys 0.013s
I20260709 12:26:10.146023  4185 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.146529  4185 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.134080  4083 raft_consensus.cc:697] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:10.149504  4083 consensus_queue.cc:237] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.149745  3858 consensus_queue.cc:260] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.152524  3858 ts_tablet_manager.cc:1434] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 12:26:10.148653  4185 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:10.160275  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:10.161717  3554 leader_election.cc:343] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.162372  3857 ts_tablet_manager.cc:1434] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.003s
I20260709 12:26:10.163305  3857 tablet_bootstrap.cc:492] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:10.158159  3586 raft_consensus.cc:2468] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:10.172163  4096 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.172685  4096 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.174722  4096 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:10.176411  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:10.178148  3630 leader_election.cc:343] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.178966  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:10.184090  3553 leader_election.cc:343] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.184549  3553 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:10.185977  4185 raft_consensus.cc:2749] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.186728  3775 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.188011  3733 raft_consensus.cc:3060] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.206337  3857 tablet_bootstrap.cc:654] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.208422  3858 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:10.212616  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:10.213501  3586 raft_consensus.cc:2468] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:10.217337  3627 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.218621  4096 raft_consensus.cc:2804] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.219004  4096 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.219321  4096 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.226293  3972 raft_consensus.cc:2804] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:10.226884  3972 raft_consensus.cc:697] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:10.227694  3972 consensus_queue.cc:237] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.233544  3860 raft_consensus.cc:359] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.234447  3860 raft_consensus.cc:385] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.234715  3860 raft_consensus.cc:740] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.235292  3860 consensus_queue.cc:260] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.236994  3957 consensus_queue.cc:1048] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.238076  3860 ts_tablet_manager.cc:1434] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 12:26:10.239110  3860 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:10.239790  4182 consensus_queue.cc:1048] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:10.252575  4185 consensus_queue.cc:1048] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.254824  4138 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.255402  4138 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.258420  4138 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:10.260193  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:10.264086  3628 leader_election.cc:343] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.267360  3858 tablet_bootstrap.cc:654] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.268879  4185 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.285787  4143 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.287533  4143 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.281458  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:10.291851  4143 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:10.296201  3856 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:10.296610  3856 ts_tablet_manager.cc:1403] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.259s	user 0.009s	sys 0.020s
I20260709 12:26:10.298532  3856 raft_consensus.cc:359] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.298975  3856 raft_consensus.cc:385] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.299176  3856 raft_consensus.cc:740] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.301153  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:10.285372  4185 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.302208  3586 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:10.299707  3856 consensus_queue.cc:260] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.305740  4185 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:10.307766  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:10.288913  4096 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.308280  3627 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:10.308429  3662 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:10.310330  3554 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:10.311260  4185 raft_consensus.cc:2804] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.311703  4185 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.312103  4185 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.313256  3860 tablet_bootstrap.cc:654] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.313410  4181 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.313948  4181 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.329015  3856 ts_tablet_manager.cc:1434] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:26:10.326498  3483 catalog_manager.cc:5697] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.323827  4138 raft_consensus.cc:2804] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.326321  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:10.326608  4181 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:10.336673  4138 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.371924  4138 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.351279  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:10.360941  3738 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.338744  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:10.365630  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:10.380388  3703 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:10.380699  3553 leader_election.cc:343] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.367940  4185 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.369001  4090 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.381742  4090 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.384056  3777 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:10.386377  4181 raft_consensus.cc:2749] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.388492  4090 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:10.388689  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:10.390084  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:10.392594  3775 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:10.395247  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
W20260709 12:26:10.396535  3553 leader_election.cc:343] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.397192  4090 raft_consensus.cc:2749] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.400553  3856 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:10.400213  3808 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.404560  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:10.405747  4185 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:10.409255  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:10.409940  3584 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.424118  4096 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:10.425997  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:10.432000  3630 leader_election.cc:343] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.443933  3856 tablet_bootstrap.cc:654] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.445271  4138 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.474741  3483 catalog_manager.cc:5697] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.476449  3662 raft_consensus.cc:2393] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:10.480365  3857 tablet_bootstrap.cc:492] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:10.480835  3857 ts_tablet_manager.cc:1403] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.318s	user 0.029s	sys 0.022s
I20260709 12:26:10.472064  4151 raft_consensus.cc:2749] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.485536  3857 raft_consensus.cc:359] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.486174  3857 raft_consensus.cc:385] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.486428  3857 raft_consensus.cc:740] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.488284  3857 consensus_queue.cc:260] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.493489  3860 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:10.494024  3860 ts_tablet_manager.cc:1403] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.255s	user 0.006s	sys 0.007s
I20260709 12:26:10.496217  3554 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:10.497764  3957 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.498342  3957 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.500258  3957 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.500988  3857 ts_tablet_manager.cc:1434] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:26:10.511118  3858 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:10.511785  3858 ts_tablet_manager.cc:1403] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.319s	user 0.012s	sys 0.005s
I20260709 12:26:10.515283  3858 raft_consensus.cc:359] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.515964  3858 raft_consensus.cc:385] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.516230  3858 raft_consensus.cc:740] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.516831  3858 consensus_queue.cc:260] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.521888  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:10.523257  3555 leader_election.cc:343] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.524782  3957 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:10.525270  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:10.527732  3584 raft_consensus.cc:2468] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
W20260709 12:26:10.528290  3554 leader_election.cc:343] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.528729  3554 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:10.529160  3627 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.531899  3957 raft_consensus.cc:2749] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.534262  4083 raft_consensus.cc:2804] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:10.540324  4083 raft_consensus.cc:697] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:10.541160  4083 consensus_queue.cc:237] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.546434  3858 ts_tablet_manager.cc:1434] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:26:10.546976  3857 tablet_bootstrap.cc:492] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:10.549644  3858 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:10.551169  3856 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:10.551638  3856 ts_tablet_manager.cc:1403] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.151s	user 0.030s	sys 0.019s
I20260709 12:26:10.553222  4138 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:10.554996  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
W20260709 12:26:10.556456  3628 leader_election.cc:343] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.558319  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:10.558854  3857 tablet_bootstrap.cc:654] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.559197  3586 raft_consensus.cc:2393] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 1: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:10.554808  3856 raft_consensus.cc:359] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.561424  3856 raft_consensus.cc:385] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.561703  3856 raft_consensus.cc:740] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.562435  3856 consensus_queue.cc:260] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.562809  3860 raft_consensus.cc:359] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.563071  3627 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:10.564510  3856 ts_tablet_manager.cc:1434] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 12:26:10.564510  4023 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.563462  3860 raft_consensus.cc:385] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.565937  3860 raft_consensus.cc:740] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.567075  4134 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.567564  4134 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.571158  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:10.575205  3858 tablet_bootstrap.cc:654] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:10.577256  3555 leader_election.cc:343] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.566730  3860 consensus_queue.cc:260] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.577960  4134 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:10.590639  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:10.589509  3860 ts_tablet_manager.cc:1434] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.002s
I20260709 12:26:10.591272  3663 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:10.593228  3554 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.595768  4135 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.596151  4135 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.596470  4135 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.598626  3857 tablet_bootstrap.cc:492] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:10.599205  3857 ts_tablet_manager.cc:1403] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.003s
I20260709 12:26:10.610597  3860 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:10.620687  4135 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.624226  3858 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:10.624745  3858 ts_tablet_manager.cc:1403] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.075s	user 0.026s	sys 0.000s
I20260709 12:26:10.627257  3858 raft_consensus.cc:359] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.627928  3858 raft_consensus.cc:385] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.628171  3858 raft_consensus.cc:740] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.628923  3858 consensus_queue.cc:260] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.630851  4135 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:10.630949  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:10.632541  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:10.631960  3663 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:10.633726  3555 leader_election.cc:343] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.634060  3858 ts_tablet_manager.cc:1434] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:10.635116  3858 tablet_bootstrap.cc:492] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:10.637378  3857 raft_consensus.cc:359] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.638098  3857 raft_consensus.cc:385] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.638418  3857 raft_consensus.cc:740] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.639190  3857 consensus_queue.cc:260] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.640568  3858 tablet_bootstrap.cc:654] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.644618  3663 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:10.646188  3857 ts_tablet_manager.cc:1434] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:26:10.646116  3554 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.646994  3738 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.649047  3857 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:10.642959  3856 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:10.650166  4134 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:10.652319  4134 raft_consensus.cc:697] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:10.653120  4134 consensus_queue.cc:237] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:10.655211  3857 tablet_bootstrap.cc:654] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.660072  4135 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.660595  4135 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.665406  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:10.666916  3555 leader_election.cc:343] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.667449  3809 raft_consensus.cc:3060] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.680744  3483 catalog_manager.cc:5697] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.703332  3856 tablet_bootstrap.cc:654] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.710985  4135 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:10.718321  4121 raft_consensus.cc:493] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.718772  4121 raft_consensus.cc:515] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.723898  4023 consensus_queue.cc:1048] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.742134  4138 consensus_queue.cc:1048] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.743021  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:10.743836  3808 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:10.752331  4121 leader_election.cc:290] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:10.760793  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:10.762745  3555 leader_election.cc:343] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.765010  3553 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.767383  4135 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.767884  4135 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.768288  4135 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.768635  3860 tablet_bootstrap.cc:700] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05: Time spent opening tablet: real 0.101s	user 0.003s	sys 0.001s
I20260709 12:26:10.769383  3860 tablet_bootstrap.cc:654] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.770906  4023 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.771425  4023 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.773566  4023 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:10.782548  4151 raft_consensus.cc:493] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.783105  4151 raft_consensus.cc:515] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.797837  3857 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:10.798386  3857 ts_tablet_manager.cc:1403] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.150s	user 0.009s	sys 0.005s
I20260709 12:26:10.785401  4151 leader_election.cc:290] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:10.807374  3778 consensus_peers.cc:597] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.812616  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:10.813280  3811 raft_consensus.cc:2468] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:10.803432  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:10.815238  3702 leader_election.cc:304] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:10.819516  4144 raft_consensus.cc:2804] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.819934  4144 raft_consensus.cc:493] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.820250  4144 raft_consensus.cc:3060] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.820523  3857 raft_consensus.cc:359] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.821192  3857 raft_consensus.cc:385] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.821427  3857 raft_consensus.cc:740] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.821993  3857 consensus_queue.cc:260] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.824371  3857 ts_tablet_manager.cc:1434] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:26:10.824182  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:10.809574  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:10.780891  3482 catalog_manager.cc:5697] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.826263  3857 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
W20260709 12:26:10.828826  3703 leader_election.cc:343] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.832993  3586 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:10.839437  3627 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:10.840236  4083 raft_consensus.cc:2804] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:10.840596  4083 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.840904  4083 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.841377  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:10.844167  4135 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:10.845939  3553 leader_election.cc:343] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.846424  3553 leader_election.cc:304] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:10.849262  4121 raft_consensus.cc:2749] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:10.850126  4182 consensus_queue.cc:1048] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:10.846654  4135 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:10.874598  3628 leader_election.cc:343] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.889542  3858 tablet_bootstrap.cc:492] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:10.902460  3857 tablet_bootstrap.cc:654] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:10.902755  3858 ts_tablet_manager.cc:1403] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.268s	user 0.049s	sys 0.075s
I20260709 12:26:10.883667  4083 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:10.932739  4144 raft_consensus.cc:515] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.934814  4144 leader_election.cc:290] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:10.925144  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:10.937712  3808 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:10.919292  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:10.949965  3856 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:10.950503  3856 ts_tablet_manager.cc:1403] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.373s	user 0.019s	sys 0.019s
I20260709 12:26:10.953047  3858 raft_consensus.cc:359] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.953678  3860 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:10.954174  3860 ts_tablet_manager.cc:1403] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.362s	user 0.043s	sys 0.050s
I20260709 12:26:10.953737  3858 raft_consensus.cc:385] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.956144  3858 raft_consensus.cc:740] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.956779  3858 consensus_queue.cc:260] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:10.960676  4083 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:10.961822  3555 leader_election.cc:343] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:10.960420  3860 raft_consensus.cc:359] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.968267  3860 raft_consensus.cc:385] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.968585  3860 raft_consensus.cc:740] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.969280  3860 consensus_queue.cc:260] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.983673  3856 raft_consensus.cc:359] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.985013  3856 raft_consensus.cc:385] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:10.985173  3860 ts_tablet_manager.cc:1434] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:26:10.985291  3856 raft_consensus.cc:740] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:10.988265  3856 consensus_queue.cc:260] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:10.993733  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:10.994460  3586 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:10.978284  3701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 53728.8us
I20260709 12:26:11.005671  3856 ts_tablet_manager.cc:1434] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
W20260709 12:26:10.976711  3630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 56509.9us
I20260709 12:26:11.012099  3858 ts_tablet_manager.cc:1434] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.109s	user 0.021s	sys 0.011s
I20260709 12:26:11.013151  3860 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:11.016095  3856 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:11.017395  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:11.017990  3807 raft_consensus.cc:3060] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.022423  3586 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:11.024087  3858 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:11.040330  3860 tablet_bootstrap.cc:654] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.042670  3627 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:11.043960  4096 raft_consensus.cc:2804] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.044448  4096 raft_consensus.cc:697] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:11.045218  4096 consensus_queue.cc:237] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.051192  3807 raft_consensus.cc:2468] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:11.052219  3702 leader_election.cc:304] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:11.053164  3808 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
W20260709 12:26:11.058131  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:11.059253  3553 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.057675  4215 raft_consensus.cc:2804] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.064833  4215 raft_consensus.cc:697] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:11.065613  4215 consensus_queue.cc:237] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.071594  4134 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.072180  4134 raft_consensus.cc:697] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:11.072995  4134 consensus_queue.cc:237] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.075743  4222 consensus_queue.cc:1048] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.077137  4222 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.077579  4222 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.081415  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:11.082507  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:11.079511  4222 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:11.083232  3628 leader_election.cc:343] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:11.084510  3628 leader_election.cc:343] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:11.105495  3555 consensus_peers.cc:597] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.140580  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:11.147804  3484 catalog_manager.cc:5697] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 0 to 1, leader changed from <none> to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 1 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.170571  3856 tablet_bootstrap.cc:654] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:11.174060  3703 leader_election.cc:343] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.161710  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.179955  3858 tablet_bootstrap.cc:654] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.181550  4134 raft_consensus.cc:493] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.182073  4134 raft_consensus.cc:515] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:11.183836  3630 consensus_peers.cc:597] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.187003  3487 catalog_manager.cc:5697] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.204862  3482 catalog_manager.cc:5697] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.210381  4215 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.210983  4215 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.213128  4215 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:11.210266  3630 leader_election.cc:343] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.216094  3630 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.216886  4023 raft_consensus.cc:2749] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:11.195302  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.220273  4134 leader_election.cc:290] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:11.229866  3555 leader_election.cc:343] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.239945  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:11.242996  3857 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
W20260709 12:26:11.243633  4227 log.cc:927] Time spent T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:26:11.244267  3857 ts_tablet_manager.cc:1403] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.418s	user 0.056s	sys 0.033s
I20260709 12:26:11.248950  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:11.250360  3553 leader_election.cc:343] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.250770  3553 leader_election.cc:304] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.253186  4185 raft_consensus.cc:2749] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:11.253098  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:11.255707  3702 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:11.266345  3856 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:11.260195  4143 raft_consensus.cc:2749] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:11.281315  3856 ts_tablet_manager.cc:1403] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.273s	user 0.015s	sys 0.004s
I20260709 12:26:11.282824  3735 raft_consensus.cc:3060] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.284134  4185 consensus_queue.cc:1048] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.284085  3856 raft_consensus.cc:359] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.286088  3856 raft_consensus.cc:385] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.288874  3856 raft_consensus.cc:740] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.291954  3857 raft_consensus.cc:359] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.292690  3857 raft_consensus.cc:385] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.292951  3857 raft_consensus.cc:740] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.295811  3857 consensus_queue.cc:260] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.297034  3856 consensus_queue.cc:260] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.303828  3857 ts_tablet_manager.cc:1434] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.003s
I20260709 12:26:11.304823  3857 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:11.306811  4121 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.307269  4121 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.309504  4121 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:11.311417  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.311849  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:11.312521  3806 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:11.313901  3858 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:11.314344  3858 ts_tablet_manager.cc:1403] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.290s	user 0.012s	sys 0.015s
W20260709 12:26:11.316989  3555 leader_election.cc:343] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.317636  3860 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:11.319303  3860 ts_tablet_manager.cc:1403] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.315s	user 0.012s	sys 0.007s
I20260709 12:26:11.319624  3553 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.320890  4185 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.321259  4185 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.321581  4185 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.322365  3860 raft_consensus.cc:359] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.323349  3860 raft_consensus.cc:385] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.326750  3857 tablet_bootstrap.cc:654] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.330824  3860 raft_consensus.cc:740] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.329798  3858 raft_consensus.cc:359] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.331540  3858 raft_consensus.cc:385] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.331880  3858 raft_consensus.cc:740] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.333119  3858 consensus_queue.cc:260] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.332816  4185 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.331501  3860 consensus_queue.cc:260] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.336405  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:11.337604  3555 leader_election.cc:343] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.343324  3860 ts_tablet_manager.cc:1434] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:26:11.343451  4185 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:11.343945  3856 ts_tablet_manager.cc:1434] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 12:26:11.344235  3858 ts_tablet_manager.cc:1434] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 12:26:11.344069  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:11.344854  3806 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.351735  3806 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:11.352218  3856 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:11.352783  3553 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.356575  3860 tablet_bootstrap.cc:492] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:11.356741  3957 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.357242  3957 raft_consensus.cc:697] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:11.358024  3957 consensus_queue.cc:237] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.358646  3858 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:11.367871  3860 tablet_bootstrap.cc:654] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.392552  3482 catalog_manager.cc:5697] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.394778  3858 tablet_bootstrap.cc:654] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.399812  3857 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:11.400370  3857 ts_tablet_manager.cc:1403] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.010s
I20260709 12:26:11.407437  3857 raft_consensus.cc:359] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.408099  3857 raft_consensus.cc:385] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.408370  3857 raft_consensus.cc:740] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.408995  3857 consensus_queue.cc:260] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.409415  3856 tablet_bootstrap.cc:654] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.411011  3857 ts_tablet_manager.cc:1434] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:26:11.412097  3858 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:11.413869  3858 ts_tablet_manager.cc:1403] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 12:26:11.416582  3858 raft_consensus.cc:359] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.417205  3858 raft_consensus.cc:385] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.417483  3858 raft_consensus.cc:740] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.418102  3858 consensus_queue.cc:260] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.419910  3858 ts_tablet_manager.cc:1434] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:11.423664  3858 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:11.416913  3856 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:11.424638  3856 ts_tablet_manager.cc:1403] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 12:26:11.427091  3856 raft_consensus.cc:359] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.427670  3856 raft_consensus.cc:385] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.427944  3856 raft_consensus.cc:740] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.428524  3856 consensus_queue.cc:260] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.429776  3858 tablet_bootstrap.cc:654] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.434042  3860 tablet_bootstrap.cc:492] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:11.434494  3860 ts_tablet_manager.cc:1403] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.078s	user 0.004s	sys 0.004s
I20260709 12:26:11.419616  3857 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:11.437043  3860 raft_consensus.cc:359] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.437613  3860 raft_consensus.cc:385] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.437955  3860 raft_consensus.cc:740] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.438617  3860 consensus_queue.cc:260] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.450379  3860 ts_tablet_manager.cc:1434] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:26:11.452631  4096 consensus_queue.cc:1048] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.456247  3858 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:11.456769  3858 ts_tablet_manager.cc:1403] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 12:26:11.445590  3857 tablet_bootstrap.cc:654] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.463963  3856 ts_tablet_manager.cc:1434] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:26:11.463794  3858 raft_consensus.cc:359] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.464385  3858 raft_consensus.cc:385] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.464674  3858 raft_consensus.cc:740] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.465040  3856 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:11.465221  3858 consensus_queue.cc:260] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.467422  3858 ts_tablet_manager.cc:1434] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:11.468444  3860 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:11.468600  3858 tablet_bootstrap.cc:492] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:11.472815  4023 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.473290  4023 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.475327  4023 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:11.477080  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:11.477681  3858 tablet_bootstrap.cc:654] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.477759  3806 raft_consensus.cc:2468] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:11.479326  3628 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:11.484031  3857 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:11.484520  3857 ts_tablet_manager.cc:1403] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.000s
W20260709 12:26:11.486397  3703 consensus_peers.cc:597] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.487167  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:11.487636  4096 raft_consensus.cc:2804] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.487815  3588 raft_consensus.cc:2468] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:11.489820  4096 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.490245  4096 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.492631  3857 raft_consensus.cc:359] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.493346  3857 raft_consensus.cc:385] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.493649  3857 raft_consensus.cc:740] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.494449  3857 consensus_queue.cc:260] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.495829  3860 tablet_bootstrap.cc:654] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.496282  3858 tablet_bootstrap.cc:492] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:11.496744  3858 ts_tablet_manager.cc:1403] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.001s
I20260709 12:26:11.499171  3856 tablet_bootstrap.cc:654] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.499312  3858 raft_consensus.cc:359] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.500280  3858 raft_consensus.cc:385] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.500574  3858 raft_consensus.cc:740] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.501281  3858 consensus_queue.cc:260] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.502010  3857 ts_tablet_manager.cc:1434] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 12:26:11.509296  3628 consensus_peers.cc:597] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.511859  3860 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:11.512392  3860 ts_tablet_manager.cc:1403] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.004s
I20260709 12:26:11.506965  3857 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:11.515483  3858 ts_tablet_manager.cc:1434] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:26:11.521030  3858 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:11.522152  3856 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:11.522615  3856 ts_tablet_manager.cc:1403] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 12:26:11.525321  3856 raft_consensus.cc:359] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.525964  3856 raft_consensus.cc:385] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.526207  3856 raft_consensus.cc:740] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.526794  3856 consensus_queue.cc:260] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.515049  3860 raft_consensus.cc:359] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.527686  3860 raft_consensus.cc:385] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.527984  3860 raft_consensus.cc:740] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.528723  3860 consensus_queue.cc:260] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.521445  3857 tablet_bootstrap.cc:654] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.535434  4151 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.535979  4151 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.538539  4151 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:11.539958  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:11.540714  3806 raft_consensus.cc:2393] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 1: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:11.540844  3858 tablet_bootstrap.cc:654] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.542661  4096 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.545671  4096 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:11.547644  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:11.548244  3806 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.553077  3860 ts_tablet_manager.cc:1434] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:26:11.555075  3858 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:11.556020  4185 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.566449  4185 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.556172  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:11.558945  3735 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.569625  3701 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:11.570956  4221 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.559059  4023 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.571982  4023 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.559504  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:11.573470  3588 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.577955  4023 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.579149  3860 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:11.579486  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:11.580972  3630 leader_election.cc:343] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.581588  3858 ts_tablet_manager.cc:1403] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.004s
I20260709 12:26:11.582713  3584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:11.583330  3584 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:11.584250  3858 raft_consensus.cc:359] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.584894  3858 raft_consensus.cc:385] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.585135  3858 raft_consensus.cc:740] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.586232  4185 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.586189  3860 tablet_bootstrap.cc:654] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.581202  4151 consensus_queue.cc:1048] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:11.591398  4221 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:11.562148  3806 raft_consensus.cc:2468] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:11.564141  4096 raft_consensus.cc:493] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.592423  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.592478  4096 raft_consensus.cc:515] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
W20260709 12:26:11.593922  3555 leader_election.cc:343] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.594710  4096 leader_election.cc:290] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:11.596782  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:11.592505  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:11.599291  3662 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:11.561139  3857 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:11.565868  3856 ts_tablet_manager.cc:1434] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 12:26:11.601929  3554 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.603072  4121 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.603441  4121 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.603823  4121 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.601895  3856 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:11.605115  3627 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.607112  4096 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.600876  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.607542  4096 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.610550  3630 leader_election.cc:304] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.610936  4096 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.612447  4023 raft_consensus.cc:2749] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:11.621255  3857 ts_tablet_manager.cc:1403] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.003s
I20260709 12:26:11.624626  3858 consensus_queue.cc:260] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.626242  3858 ts_tablet_manager.cc:1434] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:26:11.627158  3858 tablet_bootstrap.cc:492] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:11.632181  3588 raft_consensus.cc:2468] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:11.633445  3627 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:11.639097  4023 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.639711  4023 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.642294  4023 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.635478  4083 raft_consensus.cc:2804] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.643884  4083 raft_consensus.cc:697] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:11.644773  4083 consensus_queue.cc:237] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.647073  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.647477  4096 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:11.649044  3630 leader_election.cc:343] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.653448  3857 raft_consensus.cc:359] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.654160  3857 raft_consensus.cc:385] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.654578  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:11.655229  3588 raft_consensus.cc:2468] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:11.651444  3856 tablet_bootstrap.cc:654] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.654398  3857 raft_consensus.cc:740] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.658890  4185 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.659062  3857 consensus_queue.cc:260] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.664391  4096 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.665248  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:11.670178  3630 leader_election.cc:343] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.673516  3483 catalog_manager.cc:5697] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.683583  3857 ts_tablet_manager.cc:1434] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 12:26:11.684644  3857 tablet_bootstrap.cc:492] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:11.687466  3860 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:11.687984  3860 ts_tablet_manager.cc:1403] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.109s	user 0.008s	sys 0.004s
I20260709 12:26:11.690610  3860 raft_consensus.cc:359] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.691249  3860 raft_consensus.cc:385] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.693152  3627 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.694118  4096 raft_consensus.cc:2804] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.694468  4096 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.694766  4096 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.698061  3858 tablet_bootstrap.cc:654] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.691504  3860 raft_consensus.cc:740] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.701855  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:11.703279  4185 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:11.704581  4185 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.705005  4185 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.712601  3972 raft_consensus.cc:493] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.713109  3972 raft_consensus.cc:515] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.715019  3972 leader_election.cc:290] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.715830  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:11.716568  3664 raft_consensus.cc:2468] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:11.717918  3777 leader_election.cc:304] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:11.718885  4182 raft_consensus.cc:2804] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.707964  4229 raft_consensus.cc:493] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.719293  4182 raft_consensus.cc:493] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.719939  4182 raft_consensus.cc:3060] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.719700  4229 raft_consensus.cc:515] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.721783  4229 leader_election.cc:290] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:11.722474  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:11.722934  3662 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 0.
I20260709 12:26:11.723956  3554 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:11.724757  4135 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.725150  4135 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.725481  4135 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.710369  3860 consensus_queue.cc:260] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.736255  3860 ts_tablet_manager.cc:1434] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:26:11.737273  3860 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:11.719018  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:11.742345  4135 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:11.743829  4151 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.744354  3856 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:11.748970  4151 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.749563  3856 ts_tablet_manager.cc:1403] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.012s
I20260709 12:26:11.752297  3856 raft_consensus.cc:359] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.753177  3856 raft_consensus.cc:385] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.753465  3856 raft_consensus.cc:740] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.754138  3856 consensus_queue.cc:260] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.706921  4185 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:11.746627  3553 leader_election.cc:343] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.767201  3856 ts_tablet_manager.cc:1434] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:26:11.772060  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.773860  4151 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:11.776453  4096 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.776929  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:11.778903  4121 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.780131  3589 raft_consensus.cc:2393] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 1: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:11.782841  3857 tablet_bootstrap.cc:654] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.771281  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:11.786803  4182 raft_consensus.cc:515] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.790458  3627 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:11.794106  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:11.796726  4121 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.798909  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:11.801440  3662 raft_consensus.cc:2393] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:11.800783  4096 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.810487  4135 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:11.817732  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:11.823351  3856 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:11.824967  3860 tablet_bootstrap.cc:654] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.808454  3588 raft_consensus.cc:2468] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:11.812767  4121 consensus_queue.cc:1048] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:26:11.811672  4096 raft_consensus.cc:2749] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:26:11.828819  3555 leader_election.cc:343] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.831096  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:11.831737  3662 raft_consensus.cc:3060] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.832661  4182 leader_election.cc:290] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:11.837327  3858 tablet_bootstrap.cc:492] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:11.838940  3858 ts_tablet_manager.cc:1403] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.212s	user 0.028s	sys 0.019s
I20260709 12:26:11.846345  3858 raft_consensus.cc:359] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.849051  3858 raft_consensus.cc:385] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.849313  3858 raft_consensus.cc:740] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.847007  3662 raft_consensus.cc:2468] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
W20260709 12:26:11.850370  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 80413.5us
I20260709 12:26:11.851110  3777 leader_election.cc:304] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:11.852298  3778 leader_election.cc:343] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.852990  4229 raft_consensus.cc:2804] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.853127  3856 tablet_bootstrap.cc:654] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.854035  4229 raft_consensus.cc:697] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:11.854992  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:11.857647  3778 leader_election.cc:343] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.854948  4229 consensus_queue.cc:237] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.861521  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:11.863032  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:11.867340  3778 leader_election.cc:343] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:11.868978  3553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 67056.2us
I20260709 12:26:11.872397  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:11.873068  3662 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:11.868610  3630 leader_election.cc:343] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.873221  3858 consensus_queue.cc:260] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.873780  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:11.875988  3775 leader_election.cc:304] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.876701  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:11.885336  3588 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.885744  4182 raft_consensus.cc:2804] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:11.886202  4182 raft_consensus.cc:493] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.886557  4182 raft_consensus.cc:3060] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.877245  3857 tablet_bootstrap.cc:492] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:11.889408  3857 ts_tablet_manager.cc:1403] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.205s	user 0.010s	sys 0.006s
I20260709 12:26:11.878180  3703 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:11.895741  3553 leader_election.cc:343] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:11.898976  3662 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:11.897311  3487 catalog_manager.cc:5697] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.903092  4151 raft_consensus.cc:2749] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:11.912456  3857 raft_consensus.cc:359] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.913160  3857 raft_consensus.cc:385] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.913432  3857 raft_consensus.cc:740] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.914057  3857 consensus_queue.cc:260] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:11.907212  4182 raft_consensus.cc:515] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.919062  3858 ts_tablet_manager.cc:1434] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 12:26:11.933547  3860 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:11.933672  3588 raft_consensus.cc:2468] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:11.936539  3860 ts_tablet_manager.cc:1403] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.002s
I20260709 12:26:11.936856  3858 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce: Bootstrap starting.
I20260709 12:26:11.938887  3857 ts_tablet_manager.cc:1434] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.008s
I20260709 12:26:11.943631  3860 raft_consensus.cc:359] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.945740  3860 raft_consensus.cc:385] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.945999  3860 raft_consensus.cc:740] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.948086  3860 consensus_queue.cc:260] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:11.952265  3735 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.961058  3857 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:11.965495  3856 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: No bootstrap required, opened a new log
I20260709 12:26:11.965987  3856 ts_tablet_manager.cc:1403] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.020s
I20260709 12:26:11.969403  3627 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:11.974301  3858 tablet_bootstrap.cc:654] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:11.976837  3662 raft_consensus.cc:3060] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:11.980165  4023 raft_consensus.cc:2804] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:11.980930  4023 raft_consensus.cc:697] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:11.981796  4023 consensus_queue.cc:237] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.958715  3554 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:11.991441  3860 ts_tablet_manager.cc:1434] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:26:11.992565  3856 raft_consensus.cc:359] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.993225  3856 raft_consensus.cc:385] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:11.993475  3856 raft_consensus.cc:740] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:11.994050  3856 consensus_queue.cc:260] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:11.997483  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:11.999441  3856 ts_tablet_manager.cc:1434] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:26:11.988571  4261 raft_consensus.cc:2749] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.001021  3860 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
W20260709 12:26:12.004153  3778 leader_election.cc:343] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.013087  3858 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce: No bootstrap required, opened a new log
I20260709 12:26:12.013818  3858 ts_tablet_manager.cc:1403] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.008s
W20260709 12:26:12.020813  3555 consensus_peers.cc:597] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.021405  4182 leader_election.cc:290] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.021992  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:12.022591  3588 raft_consensus.cc:3060] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:11.995951  3554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 44392.9us
I20260709 12:26:12.023859  3554 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:12.024645  4261 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.025095  4261 raft_consensus.cc:697] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:12.025871  4261 consensus_queue.cc:237] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.028492  3860 tablet_bootstrap.cc:654] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.031697  3588 raft_consensus.cc:2468] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:12.034283  3858 raft_consensus.cc:359] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.035955  3775 leader_election.cc:304] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:12.039386  4182 raft_consensus.cc:2804] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.040416  4182 raft_consensus.cc:697] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:12.041317  3858 raft_consensus.cc:385] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.041821  3858 raft_consensus.cc:740] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.042510  3858 consensus_queue.cc:260] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.042999  4259 raft_consensus.cc:493] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.064361  3858 ts_tablet_manager.cc:1434] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.005s
I20260709 12:26:12.042790  4182 consensus_queue.cc:237] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.063380  4229 raft_consensus.cc:493] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.069010  4229 raft_consensus.cc:515] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.071039  4229 leader_election.cc:290] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.078245  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:12.083282  3857 tablet_bootstrap.cc:654] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.090921  3483 catalog_manager.cc:5697] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 1 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.093209  3487 catalog_manager.cc:5697] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.055512  4259 raft_consensus.cc:515] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.100423  3860 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:12.100895  3860 ts_tablet_manager.cc:1403] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.104s	user 0.021s	sys 0.002s
I20260709 12:26:12.106372  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.107019  3588 raft_consensus.cc:2468] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
W20260709 12:26:12.108446  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:12.110348  3737 raft_consensus.cc:2468] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
I20260709 12:26:12.110462  4259 leader_election.cc:290] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.112202  3778 leader_election.cc:304] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:12.112785  3972 raft_consensus.cc:2804] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:12.113131  3972 raft_consensus.cc:493] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.113437  3972 raft_consensus.cc:3060] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.114513  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:12.118438  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.119064  3588 raft_consensus.cc:2468] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 0.
I20260709 12:26:12.120229  3972 raft_consensus.cc:515] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.121366  3808 raft_consensus.cc:2393] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 1: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:12.123117  3701 leader_election.cc:304] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:12.124541  4215 raft_consensus.cc:2804] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:12.124897  4215 raft_consensus.cc:493] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.125240  4215 raft_consensus.cc:3060] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.125563  3972 leader_election.cc:290] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.126255  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:12.126856  3589 raft_consensus.cc:3060] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.134414  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:12.138801  3860 raft_consensus.cc:359] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.139318  3860 raft_consensus.cc:385] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.139509  3860 raft_consensus.cc:740] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.148267  4222 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.148773  4222 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.150771  4222 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:12.151417  3857 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:12.151926  3857 ts_tablet_manager.cc:1403] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.003s
I20260709 12:26:12.152966  4215 raft_consensus.cc:515] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.154474  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.154996  3737 raft_consensus.cc:2393] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:12.155112  3588 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:12.158008  3589 raft_consensus.cc:2468] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:12.159595  4215 leader_election.cc:290] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.160528  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:12.140081  3860 consensus_queue.cc:260] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.161906  3775 leader_election.cc:304] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:12.162271  3627 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:12.161613  3811 raft_consensus.cc:2393] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 1: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:12.162856  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:12.162988  4222 raft_consensus.cc:2804] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:12.163409  4222 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.163643  3588 raft_consensus.cc:2393] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 1: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:12.160478  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:12.163789  4222 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.164732  3857 raft_consensus.cc:359] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.166672  3857 raft_consensus.cc:385] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.166939  3857 raft_consensus.cc:740] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.164139  4229 raft_consensus.cc:2804] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.167567  3857 consensus_queue.cc:260] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.167456  3701 leader_election.cc:304] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:12.169445  3630 leader_election.cc:343] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.169894  3857 ts_tablet_manager.cc:1434] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:26:12.168506  3860 ts_tablet_manager.cc:1434] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:26:12.170847  3857 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:12.171231  3860 tablet_bootstrap.cc:492] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:12.173748  4229 raft_consensus.cc:697] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:12.176211  3483 catalog_manager.cc:5697] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.177047  3857 tablet_bootstrap.cc:654] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.187908  3972 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.188505  3972 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.190485  3972 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:12.177047  3860 tablet_bootstrap.cc:654] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.192117  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:12.193226  3659 raft_consensus.cc:2393] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:12.193585  4229 consensus_queue.cc:237] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.169618  4259 raft_consensus.cc:2749] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.219616  4096 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.220247  4096 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.222812  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.223562  3588 raft_consensus.cc:2393] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:12.224421  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:12.224604  4096 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.225054  3806 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:12.227183  3628 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:12.227941  4023 raft_consensus.cc:2804] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:12.228288  4023 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.228607  4023 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.228816  4219 consensus_queue.cc:1048] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.229254  3775 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:12.234102  3972 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.237612  3487 catalog_manager.cc:5697] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.240068  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.240684  3589 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:12.249157  4261 raft_consensus.cc:493] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.249662  4261 raft_consensus.cc:515] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.252087  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:12.252302  4023 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:12.253166  3555 leader_election.cc:343] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.253522  3972 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.253700  4096 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.254195  4096 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.255571  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:12.256011  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:12.256240  3588 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.255864  4023 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.258293  3808 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.262873  3588 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:12.255350  4222 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.264663  3627 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:12.265595  4222 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:12.267284  3808 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:12.266732  4023 raft_consensus.cc:2804] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.268329  4023 raft_consensus.cc:697] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:12.279126  4023 consensus_queue.cc:237] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.282224  4219 consensus_queue.cc:1048] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.297683  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:12.300694  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:12.301306  3553 leader_election.cc:343] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.301757  3553 leader_election.cc:304] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:12.304140  3857 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:12.305539  3860 tablet_bootstrap.cc:492] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:12.306000  3860 ts_tablet_manager.cc:1403] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.004s
W20260709 12:26:12.306118  3628 leader_election.cc:343] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.304625  3857 ts_tablet_manager.cc:1403] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.134s	user 0.020s	sys 0.003s
I20260709 12:26:12.298913  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:12.307614  3735 raft_consensus.cc:2468] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:12.296836  4261 leader_election.cc:290] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:12.308480  4134 raft_consensus.cc:2749] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.310000  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:12.319087  3630 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:12.320550  4222 raft_consensus.cc:2804] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:12.320951  4222 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.321275  4222 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.322227  3857 raft_consensus.cc:359] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.322948  3857 raft_consensus.cc:385] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.323194  3857 raft_consensus.cc:740] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.304471  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:12.324077  3588 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.326009  3860 raft_consensus.cc:359] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.326658  3860 raft_consensus.cc:385] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.326902  3860 raft_consensus.cc:740] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.304711  4096 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:12.329555  3857 consensus_queue.cc:260] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.327499  3860 consensus_queue.cc:260] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.334890  3857 ts_tablet_manager.cc:1434] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
W20260709 12:26:12.336994  3630 leader_election.cc:343] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.336925  3860 ts_tablet_manager.cc:1434] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:26:12.332860  4222 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.338250  3860 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:12.340108  3737 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.337249  3857 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:12.354311  3483 catalog_manager.cc:5697] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 2, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 2 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.357434  3857 tablet_bootstrap.cc:654] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.363019  3588 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:12.364164  3627 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:12.366678  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:12.365305  4096 raft_consensus.cc:2804] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.368713  4096 raft_consensus.cc:697] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:12.369468  4096 consensus_queue.cc:237] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:12.372234  3628 leader_election.cc:343] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.373178  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:12.373770  3735 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.382074  3860 tablet_bootstrap.cc:654] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.387616  3860 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:12.388074  3860 ts_tablet_manager.cc:1403] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:26:12.396068  3857 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:12.396764  4182 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.397217  4182 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.397667  3860 raft_consensus.cc:359] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.398337  3860 raft_consensus.cc:385] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.398576  3860 raft_consensus.cc:740] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.399287  4182 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:12.366144  4222 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:12.401031  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.401724  3735 raft_consensus.cc:2468] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:12.401289  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:12.396559  3857 ts_tablet_manager.cc:1403] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.061s	user 0.028s	sys 0.007s
I20260709 12:26:12.406842  3777 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:12.407958  4182 raft_consensus.cc:2749] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.408042  3630 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:12.408334  3857 raft_consensus.cc:359] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.404479  3860 consensus_queue.cc:260] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.408907  4222 raft_consensus.cc:2804] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.409577  4222 raft_consensus.cc:697] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:12.414036  4222 consensus_queue.cc:237] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.410635  3860 ts_tablet_manager.cc:1434] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 12:26:12.417812  3860 tablet_bootstrap.cc:492] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:12.423082  3860 tablet_bootstrap.cc:654] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.410912  3857 raft_consensus.cc:385] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.423851  3857 raft_consensus.cc:740] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.424563  3857 consensus_queue.cc:260] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.425619  3483 catalog_manager.cc:5697] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.426550  3857 ts_tablet_manager.cc:1434] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.000s
I20260709 12:26:12.426716  4182 consensus_queue.cc:1048] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.427532  3857 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:12.431293  4182 raft_consensus.cc:493] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.431792  4182 raft_consensus.cc:515] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.433462  3857 tablet_bootstrap.cc:654] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.434279  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:12.434748  4182 leader_election.cc:290] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.435674  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
W20260709 12:26:12.436017  3778 leader_election.cc:343] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.436280  3588 raft_consensus.cc:2468] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 0.
W20260709 12:26:12.436776  3778 consensus_peers.cc:597] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.437389  3775 leader_election.cc:304] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:12.438349  4182 raft_consensus.cc:2804] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:12.438699  4182 raft_consensus.cc:493] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.439079  4182 raft_consensus.cc:3060] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.442821  3806 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.445869  3857 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:12.446396  3857 ts_tablet_manager.cc:1403] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:26:12.449261  3857 raft_consensus.cc:359] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.450623  3857 raft_consensus.cc:385] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.450928  3857 raft_consensus.cc:740] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.451642  3857 consensus_queue.cc:260] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.454288  3857 ts_tablet_manager.cc:1434] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:12.457116  3857 tablet_bootstrap.cc:492] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:12.457618  3860 tablet_bootstrap.cc:492] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:12.458092  3860 ts_tablet_manager.cc:1403] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 12:26:12.460637  3860 raft_consensus.cc:359] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.461242  3860 raft_consensus.cc:385] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.461493  3860 raft_consensus.cc:740] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.462189  3860 consensus_queue.cc:260] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.462877  3857 tablet_bootstrap.cc:654] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.466213  3860 ts_tablet_manager.cc:1434] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:12.467600  3860 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05: Bootstrap starting.
I20260709 12:26:12.483086  4182 raft_consensus.cc:515] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.486340  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
W20260709 12:26:12.488133  3778 leader_election.cc:343] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:12.488445  3860 tablet_bootstrap.cc:654] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.494453  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:12.494998  3588 raft_consensus.cc:3060] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.505522  3588 raft_consensus.cc:2468] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:12.508682  3775 leader_election.cc:304] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:12.513157  3857 tablet_bootstrap.cc:492] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:12.510602  4229 raft_consensus.cc:2804] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.513736  3857 ts_tablet_manager.cc:1403] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.011s
I20260709 12:26:12.513957  4229 raft_consensus.cc:697] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:12.515070  4229 consensus_queue.cc:237] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.516417  3857 raft_consensus.cc:359] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.517058  3857 raft_consensus.cc:385] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.517307  3857 raft_consensus.cc:740] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.494493  4182 leader_election.cc:290] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:12.518754  3857 consensus_queue.cc:260] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.522037  3857 ts_tablet_manager.cc:1434] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:12.522284  4222 consensus_queue.cc:1048] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.522925  3857 tablet_bootstrap.cc:492] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:12.529559  3483 catalog_manager.cc:5697] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.533562  3860 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05: No bootstrap required, opened a new log
I20260709 12:26:12.534024  3860 ts_tablet_manager.cc:1403] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 12:26:12.541095  4261 consensus_queue.cc:1048] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.541471  3857 tablet_bootstrap.cc:654] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.542841  3860 raft_consensus.cc:359] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.543514  3860 raft_consensus.cc:385] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.543814  3860 raft_consensus.cc:740] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.544377  4215 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.544836  4215 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.547257  3585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.547986  3860 consensus_queue.cc:260] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.549985  3860 ts_tablet_manager.cc:1434] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
W20260709 12:26:12.552062  3553 consensus_peers.cc:597] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba -> Peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093): Couldn't send request to peer 3c78ef175c2d468993c1cb82527bef05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.548542  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:12.559908  4151 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.560417  4151 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:12.562469  4151 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:12.567057  4215 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:12.567355  3586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.568121  3586 raft_consensus.cc:2393] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 1: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:12.584215  3857 tablet_bootstrap.cc:492] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:12.584776  3857 ts_tablet_manager.cc:1403] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:26:12.587473  3737 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.595109  3857 raft_consensus.cc:359] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.596815  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:12.586642  3703 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:12.629494  3857 raft_consensus.cc:385] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.629787  3857 raft_consensus.cc:740] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.630368  3857 consensus_queue.cc:260] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.631047  4259 raft_consensus.cc:2749] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.602494  4182 consensus_queue.cc:1048] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.629247  3662 raft_consensus.cc:2393] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:12.632421  4222 consensus_queue.cc:1048] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.635082  3703 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:12.635974  3857 ts_tablet_manager.cc:1434] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:26:12.637006  4259 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.637843  3857 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:12.650848  3735 raft_consensus.cc:3060] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.658334  3857 tablet_bootstrap.cc:654] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.659323  3972 consensus_queue.cc:1048] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:12.666180  4259 raft_consensus.cc:2749] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.668548  4182 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.669294  4182 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.672363  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:12.673540  4182 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:12.675836  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:12.676604  3734 raft_consensus.cc:2393] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 1: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:12.678411  3778 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:12.680770  4182 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.726816  3483 catalog_manager.cc:5697] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 1 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.731352  4182 raft_consensus.cc:2749] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.736838  3857 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:12.737349  3857 ts_tablet_manager.cc:1403] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.017s
I20260709 12:26:12.739823  3857 raft_consensus.cc:359] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.740448  3857 raft_consensus.cc:385] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:12.740679  3857 raft_consensus.cc:740] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:12.742246  3857 consensus_queue.cc:260] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:12.743042  4181 consensus_queue.cc:1048] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.744469  3857 ts_tablet_manager.cc:1434] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:12.756935  4083 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.757503  4083 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.757377  3857 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a: Bootstrap starting.
I20260709 12:26:12.759766  4083 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:12.760980  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:12.761660  3737 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:12.762869  3630 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:12.763760  4083 raft_consensus.cc:2804] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:12.764372  4083 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.764710  4083 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.768950  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:12.769481  3806 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 0.
I20260709 12:26:12.775764  4215 raft_consensus.cc:493] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.776299  4215 raft_consensus.cc:515] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.779541  3808 raft_consensus.cc:1275] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:12.780246  4229 consensus_queue.cc:1048] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.781318  4215 leader_election.cc:290] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:12.781803  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:12.771397  4083 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.784126  4023 consensus_queue.cc:1048] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.784718  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:12.785288  3737 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.787119  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:12.792311  3702 leader_election.cc:304] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:12.793301  4151 raft_consensus.cc:2749] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.803135  3737 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:12.807343  4222 consensus_queue.cc:1048] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:12.807247  3630 consensus_peers.cc:597] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.818255  3630 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:12.819137  4222 raft_consensus.cc:2804] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:12.819588  4222 raft_consensus.cc:697] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:12.821197  4222 consensus_queue.cc:237] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:12.827606  4083 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 1 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:12.828547  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:12.833076  3806 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.839068  3806 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:12.831902  3857 tablet_bootstrap.cc:654] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:12.851054  3585 raft_consensus.cc:1275] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:12.852689  4219 consensus_queue.cc:1048] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.854820  4301 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.855327  4301 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:12.857997  3589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:12.859519  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:12.861650  3775 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:12.862531  4301 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:12.863247  4301 raft_consensus.cc:2749] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:12.884207  4219 consensus_queue.cc:1048] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.889726  4219 consensus_queue.cc:1048] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.910588  4301 consensus_queue.cc:1048] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.944677  3483 catalog_manager.cc:5697] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 1 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.952160  3737 raft_consensus.cc:3060] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.949844  3734 raft_consensus.cc:3060] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:12.973722  4229 consensus_queue.cc:1048] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:12.993374  3806 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.000278  3857 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a: No bootstrap required, opened a new log
I20260709 12:26:13.009891  3857 ts_tablet_manager.cc:1403] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a: Time spent bootstrapping tablet: real 0.253s	user 0.016s	sys 0.012s
I20260709 12:26:13.016122  3857 raft_consensus.cc:359] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:13.017241  3857 raft_consensus.cc:385] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.017562  3857 raft_consensus.cc:740] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.018500  3857 consensus_queue.cc:260] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:13.020987  3857 ts_tablet_manager.cc:1434] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
W20260709 12:26:13.146989  3535 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:13.180581  4259 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.181171  4259 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:13.184900  3588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:13.185766  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:13.186987  4259 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:13.187250  3703 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:13.188022  4259 raft_consensus.cc:2749] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:13.364696  3737 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.416585  4083 consensus_queue.cc:1048] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:13.435793  4023 consensus_queue.cc:1048] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:13.513326  4134 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.513760  4134 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:13.515344  4134 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:13.516155  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:13.516422  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:13.516805  3662 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:13.516983  3737 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:13.517959  3555 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:13.518658  4134 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:13.519047  4134 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.519312  4134 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.525439  4134 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:13.527000  4134 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:13.527571  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:13.527910  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:13.528198  3662 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.528451  3737 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.537124  3737 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:13.538184  3555 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:13.539124  4134 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:13.539340  3662 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:13.540234  4134 raft_consensus.cc:697] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:13.541069  4134 consensus_queue.cc:237] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:13.555426  3487 catalog_manager.cc:5697] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 0 to 2, leader changed from <none> to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 2 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.964578  3737 raft_consensus.cc:1275] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:13.965833  4134 consensus_queue.cc:1048] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.000425  3659 raft_consensus.cc:1275] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:14.003160  4325 consensus_queue.cc:1048] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.292384 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
W20260709 12:26:15.300458  3775 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 62 similar messages]
W20260709 12:26:15.424008  3627 consensus_peers.cc:597] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.452099  3775 consensus_peers.cc:597] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.457582  3627 consensus_peers.cc:597] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.479476 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:15.481832  3775 consensus_peers.cc:597] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.492523  3627 consensus_peers.cc:597] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.493429  3627 consensus_peers.cc:597] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.494606  3627 consensus_peers.cc:597] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.495466  3775 consensus_peers.cc:597] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.496702  3701 consensus_peers.cc:597] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.497334  3701 consensus_peers.cc:597] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.497519 29732 tablet_replica.cc:333] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.498485 29732 raft_consensus.cc:2243] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.498996 29732 raft_consensus.cc:2272] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.500980 29732 tablet_replica.cc:333] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.501528 29732 raft_consensus.cc:2243] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.501891 29732 raft_consensus.cc:2272] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.503468 29732 tablet_replica.cc:333] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.504036 29732 raft_consensus.cc:2243] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.504400 29732 raft_consensus.cc:2272] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.506038 29732 tablet_replica.cc:333] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.506799 29732 raft_consensus.cc:2243] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.507259 29732 raft_consensus.cc:2272] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.510135 29732 tablet_replica.cc:333] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.510669 29732 raft_consensus.cc:2243] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.511019 29732 raft_consensus.cc:2272] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.512647 29732 tablet_replica.cc:333] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.513207 29732 raft_consensus.cc:2243] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.513561 29732 raft_consensus.cc:2272] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.515125 29732 tablet_replica.cc:333] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.515789 29732 raft_consensus.cc:2243] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.516633 29732 raft_consensus.cc:2272] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.518370 29732 tablet_replica.cc:333] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.518905 29732 raft_consensus.cc:2243] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.519282 29732 raft_consensus.cc:2272] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.521888 29732 tablet_replica.cc:333] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.522668 29732 raft_consensus.cc:2243] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.523160 29732 raft_consensus.cc:2272] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.525458 29732 tablet_replica.cc:333] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
W20260709 12:26:15.526182  3627 consensus_peers.cc:597] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.526295 29732 raft_consensus.cc:2243] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.526930 29732 raft_consensus.cc:2272] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.529318 29732 tablet_replica.cc:333] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.530043 29732 raft_consensus.cc:2243] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.531266 29732 raft_consensus.cc:2272] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:15.533178  3775 consensus_peers.cc:597] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.533447 29732 tablet_replica.cc:333] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.534252 29732 raft_consensus.cc:2243] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:15.534770  3701 consensus_peers.cc:597] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.535099 29732 raft_consensus.cc:2272] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.537153 29732 tablet_replica.cc:333] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.537681 29732 raft_consensus.cc:2243] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.538375 29732 raft_consensus.cc:2272] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.539958 29732 tablet_replica.cc:333] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.540469 29732 raft_consensus.cc:2243] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.540833 29732 raft_consensus.cc:2272] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.542426 29732 tablet_replica.cc:333] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.542917 29732 raft_consensus.cc:2243] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.543576 29732 raft_consensus.cc:2272] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.545408 29732 tablet_replica.cc:333] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.545974 29732 raft_consensus.cc:2243] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.546420 29732 raft_consensus.cc:2272] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.548233 29732 tablet_replica.cc:333] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.548879 29732 raft_consensus.cc:2243] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.549733 29732 raft_consensus.cc:2272] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.551637 29732 tablet_replica.cc:333] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.552206 29732 raft_consensus.cc:2243] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.552927 29732 raft_consensus.cc:2272] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.554579 29732 tablet_replica.cc:333] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.555124 29732 raft_consensus.cc:2243] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.555474 29732 raft_consensus.cc:2272] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.557124 29732 tablet_replica.cc:333] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.557713 29732 raft_consensus.cc:2243] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.558120 29732 raft_consensus.cc:2272] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.560137 29732 tablet_replica.cc:333] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
W20260709 12:26:15.560371  3701 consensus_peers.cc:597] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.560844 29732 raft_consensus.cc:2243] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.561578 29732 raft_consensus.cc:2272] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.563171 29732 tablet_replica.cc:333] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.563685 29732 raft_consensus.cc:2243] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.564085 29732 raft_consensus.cc:2272] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.565646 29732 tablet_replica.cc:333] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.566226 29732 raft_consensus.cc:2243] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.566613 29732 raft_consensus.cc:2272] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.568598 29732 tablet_replica.cc:333] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.569260 29732 raft_consensus.cc:2243] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.569734 29732 raft_consensus.cc:2272] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.571496 29732 tablet_replica.cc:333] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.572157 29732 raft_consensus.cc:2243] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.572634 29732 raft_consensus.cc:2272] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.574931 29732 tablet_replica.cc:333] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.575783 29732 raft_consensus.cc:2243] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.576740 29732 raft_consensus.cc:2272] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.579175 29732 tablet_replica.cc:333] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.579959 29732 raft_consensus.cc:2243] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.580425 29732 raft_consensus.cc:2272] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.582708 29732 tablet_replica.cc:333] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.583386 29732 raft_consensus.cc:2243] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.583889 29732 raft_consensus.cc:2272] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:15.585350  3775 consensus_peers.cc:597] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.586222 29732 tablet_replica.cc:333] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.586944 29732 raft_consensus.cc:2243] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.587867 29732 raft_consensus.cc:2272] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.590346 29732 tablet_replica.cc:333] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
W20260709 12:26:15.590787  3701 consensus_peers.cc:597] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.591198 29732 raft_consensus.cc:2243] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.591712 29732 raft_consensus.cc:2272] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.593447 29732 tablet_replica.cc:333] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.593952 29732 raft_consensus.cc:2243] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.594300 29732 raft_consensus.cc:2272] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.595820 29732 tablet_replica.cc:333] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.596302 29732 raft_consensus.cc:2243] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.596623 29732 raft_consensus.cc:2272] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.598397 29732 tablet_replica.cc:333] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.598857 29732 raft_consensus.cc:2243] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.599567 29732 raft_consensus.cc:2272] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.601770 29732 tablet_replica.cc:333] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.602451 29732 raft_consensus.cc:2243] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.602942 29732 raft_consensus.cc:2272] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.604876 29732 tablet_replica.cc:333] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.605372 29732 raft_consensus.cc:2243] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.606020 29732 raft_consensus.cc:2272] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.607800 29732 tablet_replica.cc:333] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.608317 29732 raft_consensus.cc:2243] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.608717 29732 raft_consensus.cc:2272] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.610329 29732 tablet_replica.cc:333] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.610955 29732 raft_consensus.cc:2243] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.611397 29732 raft_consensus.cc:2272] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.613739 29732 tablet_replica.cc:333] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.614430 29732 raft_consensus.cc:2243] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.614885 29732 raft_consensus.cc:2272] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:15.616787  3627 consensus_peers.cc:597] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.617092 29732 tablet_replica.cc:333] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.617738 29732 raft_consensus.cc:2243] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.618677 29732 raft_consensus.cc:2272] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.620919 29732 tablet_replica.cc:333] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.621405 29732 raft_consensus.cc:2243] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.621757 29732 raft_consensus.cc:2272] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.623446 29732 tablet_replica.cc:333] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.623978 29732 raft_consensus.cc:2243] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.624699 29732 raft_consensus.cc:2272] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.626368 29732 tablet_replica.cc:333] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.626837 29732 raft_consensus.cc:2243] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.627475 29732 raft_consensus.cc:2272] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.629158 29732 tablet_replica.cc:333] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.629726 29732 raft_consensus.cc:2243] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.630095 29732 raft_consensus.cc:2272] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.632220 29732 tablet_replica.cc:333] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.632825 29732 raft_consensus.cc:2243] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.633241 29732 raft_consensus.cc:2272] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.635370 29732 tablet_replica.cc:333] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: stopping tablet replica
I20260709 12:26:15.635902 29732 raft_consensus.cc:2243] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:15.636783 29732 raft_consensus.cc:2272] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:15.639540  3775 consensus_peers.cc:597] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.654978  3627 consensus_peers.cc:597] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.667023  3775 consensus_peers.cc:597] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.667090  3627 consensus_peers.cc:597] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.692114  3701 consensus_peers.cc:597] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.706218 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
W20260709 12:26:15.746266  3775 consensus_peers.cc:597] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.749501  3701 consensus_peers.cc:597] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.761003  3627 consensus_peers.cc:597] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.772083  3627 consensus_peers.cc:597] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.774493  3627 consensus_peers.cc:597] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.787964 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:15.794500  4345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:15.794533  4346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:15.798250  4348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:15.800084 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:15.802400 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:15.802583 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:15.802728 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599975802717 us; error 0 us; skew 500 ppm
I20260709 12:26:15.803313 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:15.806486 29732 webserver.cc:533] Webserver started at http://127.29.9.1:36887/ using document root <none> and password file <none>
I20260709 12:26:15.807130 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:15.807401 29732 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:15.818838 29732 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.010s	sys 0.000s
W20260709 12:26:15.836144  3627 consensus_peers.cc:597] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:15.840886  3775 consensus_peers.cc:597] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.874902  4354 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:15.877508 29732 fs_manager.cc:730] Time spent opening block manager: real 0.051s	user 0.017s	sys 0.032s
I20260709 12:26:15.877871 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "b06c1f1461ec46289edf63122a5863ba"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ftzc"
I20260709 12:26:15.878356 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:15.928339 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:15.930042 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:15.931949 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:15.937244  4361 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:26:16.219847 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:26:16.220194 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.284s	user 0.006s	sys 0.000s
I20260709 12:26:16.220521 29732 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:26:16.229544  4361 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.260697  4361 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.261778  4361 tablet_bootstrap.cc:492] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.262451  4361 ts_tablet_manager.cc:1403] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.004s
I20260709 12:26:16.265007  4361 raft_consensus.cc:359] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.265686  4361 raft_consensus.cc:740] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.276008  4361 consensus_queue.cc:260] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.288817  4361 ts_tablet_manager.cc:1434] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:26:16.289641  4361 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.310207  4361 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.311065  4361 tablet_bootstrap.cc:492] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.311676  4361 ts_tablet_manager.cc:1403] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.012s
I20260709 12:26:16.314109  4361 raft_consensus.cc:359] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.314790  4361 raft_consensus.cc:740] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.315559  4361 consensus_queue.cc:260] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.317588  4361 ts_tablet_manager.cc:1434] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:16.318362  4361 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.408422  4361 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.409404  4361 tablet_bootstrap.cc:492] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.409997  4361 ts_tablet_manager.cc:1403] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.092s	user 0.022s	sys 0.021s
I20260709 12:26:16.417795  4361 raft_consensus.cc:359] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.418460  4361 raft_consensus.cc:740] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.419119  4361 consensus_queue.cc:260] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.420956  4361 ts_tablet_manager.cc:1434] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:16.421693  4361 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.435092  4361 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.436021  4361 tablet_bootstrap.cc:492] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.442025  4361 ts_tablet_manager.cc:1403] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:26:16.444716  4361 raft_consensus.cc:359] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.445415  4361 raft_consensus.cc:740] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.449012  4361 consensus_queue.cc:260] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.455428  4361 ts_tablet_manager.cc:1434] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:26:16.456274  4361 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.503180  4361 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.504238  4361 tablet_bootstrap.cc:492] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.504865  4361 ts_tablet_manager.cc:1403] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.049s	user 0.028s	sys 0.012s
I20260709 12:26:16.507184  4361 raft_consensus.cc:359] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.507831  4361 raft_consensus.cc:740] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.508549  4361 consensus_queue.cc:260] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.510528  4361 ts_tablet_manager.cc:1434] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:26:16.511253  4361 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.515350  4319 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.515959  4319 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:16.522600  3627 leader_election.cc:336] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.524663  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:16.526302  4319 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:16.526224  3630 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:16.526214 29732 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:26:16.527763 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.307s	user 0.246s	sys 0.000s
I20260709 12:26:16.527938  4319 raft_consensus.cc:2749] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.530973  4361 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.531970  4361 tablet_bootstrap.cc:492] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.532636  4361 ts_tablet_manager.cc:1403] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:26:16.536376  4361 raft_consensus.cc:359] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.537091  4361 raft_consensus.cc:740] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.537791  4361 consensus_queue.cc:260] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.539808  4361 ts_tablet_manager.cc:1434] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:16.540849  4361 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.564147  4361 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.565011  4361 tablet_bootstrap.cc:492] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.565631  4361 ts_tablet_manager.cc:1403] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:26:16.568023  4361 raft_consensus.cc:359] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.568681  4361 raft_consensus.cc:740] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.569335  4361 consensus_queue.cc:260] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.571204  4361 ts_tablet_manager.cc:1434] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:16.571959  4361 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.591238  4259 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.592568  4259 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.606302  4361 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.607313  4361 tablet_bootstrap.cc:492] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.607952  4361 ts_tablet_manager.cc:1403] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.013s
I20260709 12:26:16.594425  4338 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.608819  4338 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.610304  4361 raft_consensus.cc:359] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.611227  4361 raft_consensus.cc:740] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.612010  4361 consensus_queue.cc:260] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.614055  4361 ts_tablet_manager.cc:1434] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:26:16.614815  4361 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.616673  4338 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
W20260709 12:26:16.617297  3627 leader_election.cc:336] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.598628  4319 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.622133  4319 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.625412  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:16.628583  3630 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:16.629451  4023 raft_consensus.cc:2749] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.631999  4361 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.632910  4361 tablet_bootstrap.cc:492] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.633641  4361 ts_tablet_manager.cc:1403] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:26:16.636003  4361 raft_consensus.cc:359] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.636746  4361 raft_consensus.cc:740] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.637383  4361 consensus_queue.cc:260] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.640375  4361 ts_tablet_manager.cc:1434] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:16.641157  4361 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.652043  4259 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:16.654501  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:16.666064  4361 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.669397  4301 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.670127  4361 tablet_bootstrap.cc:492] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.672081  4361 ts_tablet_manager.cc:1403] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.000s
I20260709 12:26:16.670461  4301 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.674531  4361 raft_consensus.cc:359] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.675199  4361 raft_consensus.cc:740] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.678104  4319 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:16.679067  4337 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.679589  4337 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.681666  4337 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:16.683594  4361 consensus_queue.cc:260] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.686991  4361 ts_tablet_manager.cc:1434] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:16.690001  4361 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.697381  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:16.709465  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:16.711464  4301 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:16.712260  3627 leader_election.cc:336] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.716904  4319 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.717522  4319 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.719828  4361 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.720052  4319 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:16.720741  4361 tablet_bootstrap.cc:492] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.724994  4361 ts_tablet_manager.cc:1403] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.000s
I20260709 12:26:16.729825  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:16.727579  4361 raft_consensus.cc:359] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.731838  4361 raft_consensus.cc:740] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.733777  4361 consensus_queue.cc:260] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.734656  4338 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.735327  4338 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.737499  4361 ts_tablet_manager.cc:1434] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:16.738394  4361 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.738997  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:16.746510  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:16.747339  3738 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:16.754621  4023 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.755317  4023 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.757393  4023 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:16.758875  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:16.759709  4337 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.760378  4337 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.762423  4337 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:16.764921  3630 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:16.766356  4361 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.766512  4335 raft_consensus.cc:2749] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.769692  4361 tablet_bootstrap.cc:492] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.770372  4361 ts_tablet_manager.cc:1403] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.000s
I20260709 12:26:16.774907  3630 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:16.775916  4335 raft_consensus.cc:2804] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:16.776374  4335 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.776726  4335 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.775645  4361 raft_consensus.cc:359] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.778281  4361 raft_consensus.cc:740] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.780090  4361 consensus_queue.cc:260] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.783178  4361 ts_tablet_manager.cc:1434] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:26:16.783999  4361 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.786134  4023 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.786810  4023 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.789261  4023 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:16.789999  4337 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.790586  4337 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.792675  4337 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:16.795701  4338 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:16.798321  4337 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.798935  4337 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.801169  4337 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:16.803644  3775 leader_election.cc:336] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.814579  3775 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:16.815327  4301 raft_consensus.cc:2749] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.785028  4335 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:16.806420  3701 leader_election.cc:336] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.816226  3701 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:16.818048  4337 raft_consensus.cc:2749] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.811120  4361 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.812443  4229 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.819852  4229 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.820307  4361 tablet_bootstrap.cc:492] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:16.821206  4361 ts_tablet_manager.cc:1403] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.000s
I20260709 12:26:16.824156  4361 raft_consensus.cc:359] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.824890  4361 raft_consensus.cc:740] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.825930  4361 consensus_queue.cc:260] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.828239  4361 ts_tablet_manager.cc:1434] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:16.829056  4361 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.836583  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:16.837384  3659 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:16.846951  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:16.856088  4335 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:16.877812  3703 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:16.878372  4215 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.878790  4388 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:16.879254  4388 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.879613  4388 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.886540  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:16.887246  3736 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.860085  4229 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:16.864233  4361 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.866662  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:16.870042  3701 leader_election.cc:336] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.891489  3701 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:16.891916  4361 tablet_bootstrap.cc:492] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
W20260709 12:26:16.892417  3701 leader_election.cc:336] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.892644  4361 ts_tablet_manager.cc:1403] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.016s
I20260709 12:26:16.892941  4259 raft_consensus.cc:2749] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:16.893802  3701 leader_election.cc:336] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:16.894485  3701 leader_election.cc:336] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.894908  3701 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:16.887241  4388 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.895941  4337 raft_consensus.cc:2749] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.895179  4361 raft_consensus.cc:359] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.897172  4388 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:16.897485  4361 raft_consensus.cc:740] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:16.878911  4215 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.894555  3736 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:16.898337  4361 consensus_queue.cc:260] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.899619  4215 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:16.904752  3630 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:16.873147  3627 leader_election.cc:336] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.905894  4319 raft_consensus.cc:2804] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:26:16.906066  3627 leader_election.cc:336] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.906860  3627 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:16.907140  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:16.907799  3662 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:16.909718  3701 leader_election.cc:336] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:16.910284  3701 leader_election.cc:336] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:16.862048  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 46402.6us
I20260709 12:26:16.914387  3662 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:16.916333  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:16.916999  3806 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:16.918433  4361 ts_tablet_manager.cc:1434] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:16.919279  4361 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:16.920433  3703 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:16.921576  4319 raft_consensus.cc:697] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:16.921963  4338 raft_consensus.cc:2749] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.922420  4319 consensus_queue.cc:237] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.926928  4259 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.927466  4259 raft_consensus.cc:697] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:16.928740  4259 consensus_queue.cc:237] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.932654  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:16.931329  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:16.937980  4335 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.938588  4335 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.941306  4338 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.941897  4338 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.943858  4229 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
W20260709 12:26:16.986789  3627 leader_election.cc:336] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.987365  3627 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:16.988421  3627 leader_election.cc:336] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.987903  3487 catalog_manager.cc:5697] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 2 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.988329  4405 raft_consensus.cc:2749] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.988915  3627 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:16.989502  4215 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
W20260709 12:26:16.990108  3627 leader_election.cc:336] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:16.989969  4215 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:16.991055  4405 raft_consensus.cc:2749] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:16.992199  4215 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:16.992698  4215 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.993115  4215 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:16.993285  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 47517.1us
I20260709 12:26:16.994802  4215 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:16.995257  4334 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:16.995896  4334 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.997898  4334 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:16.998564  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:17.002601  4229 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.003954  4319 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.013162  4319 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:16.988706  4388 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.005771  4361 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:17.017341  4388 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:16.995234  4215 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.006875  4338 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:17.007906  4335 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.011816  3702 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.019464  4407 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.019881  4407 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.020308  4407 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.020444  3702 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.022167  4337 raft_consensus.cc:2749] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.014729  3806 raft_consensus.cc:2468] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:17.015213  4319 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.025034  4319 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.025398  3628 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:17.025475  4319 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.026510  4338 raft_consensus.cc:2804] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.027010  4338 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.027426  4338 raft_consensus.cc:3060] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.028133  4319 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:17.015224  4229 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.018733  4361 tablet_bootstrap.cc:492] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:17.029421  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:17.013865  3701 leader_election.cc:336] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.030042  3662 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:17.016631  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:17.030395  3701 leader_election.cc:336] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.030725  3808 raft_consensus.cc:2468] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:17.031675  3628 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:17.031826  4337 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.032202  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:17.030121  4361 ts_tablet_manager.cc:1403] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.008s
I20260709 12:26:17.033286  4023 raft_consensus.cc:2804] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.033707  4023 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.018926  4215 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.034058  4023 raft_consensus.cc:3060] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.032300  4337 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.035816  4361 raft_consensus.cc:359] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.037086  4337 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.039652  4405 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.035487  4215 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.040189  4405 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.040877  4023 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.019949  4388 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.042577  4229 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.043015  4405 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
W20260709 12:26:17.043741  3627 leader_election.cc:336] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.044231  3627 leader_election.cc:336] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.043043  4229 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:17.043021  3701 leader_election.cc:336] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.050187  4229 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:17.051091  3627 leader_election.cc:336] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.053444  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:17.054044  3662 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:17.037165  4361 raft_consensus.cc:740] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.055677  4361 consensus_queue.cc:260] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.056416  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:17.056977  3662 raft_consensus.cc:2468] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:17.057601  4361 ts_tablet_manager.cc:1434] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 12:26:17.058379  4361 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:17.042465  3777 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:17.058774  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:17.059366  3662 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
W20260709 12:26:17.059640  3701 leader_election.cc:336] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.060192  3701 leader_election.cc:336] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.060397  4334 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.060957  4334 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.061395  4334 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.062628  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:17.063210  3662 raft_consensus.cc:2468] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:17.061192  4407 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.072170  4301 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.072649  4301 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.072950  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:17.074474  4301 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.076967  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:17.077603  3733 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:17.079905  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:17.080675  3733 raft_consensus.cc:2468] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:17.085685  4407 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.086884  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:17.087563  3808 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:17.089798  4023 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.091113  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:17.091838  4301 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
W20260709 12:26:17.092336  3627 leader_election.cc:336] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.099754  4301 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.097067  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:17.109122  3808 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:17.096316  3701 leader_election.cc:336] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.099426  3806 raft_consensus.cc:3060] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.095892  4338 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.102516  3630 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.105777  3703 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.117782  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:17.118475  3662 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:17.118924  3703 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.120234  3703 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:17.122710  3775 leader_election.cc:336] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.122069  4334 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.124099  4301 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:17.124944  3627 leader_election.cc:336] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.125759  3659 raft_consensus.cc:2393] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:17.128336  4335 raft_consensus.cc:2749] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:17.129026  3627 leader_election.cc:336] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.123291  3775 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:17.123210  3630 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:17.130170  3775 leader_election.cc:336] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.131527  3703 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.098181  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:17.122116  4414 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.140388  4337 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.141007  4414 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.141510  4414 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:17.145310  3775 leader_election.cc:336] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.147624  3630 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.121840  4405 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.141337  4337 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.147435  4407 raft_consensus.cc:2804] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.169107  4259 raft_consensus.cc:2804] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.170786  3806 raft_consensus.cc:2468] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:17.175213  4259 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.175650  4259 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.170676  3808 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:17.164556  4403 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.176764  4301 raft_consensus.cc:2749] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.176090  3628 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.130378  4402 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.178320  4023 raft_consensus.cc:2804] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.140919  3777 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:17.183311  3775 leader_election.cc:336] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.166092  3733 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:17.174434  4337 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.186255  4023 raft_consensus.cc:697] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:17.173796  4407 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.187804  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:17.179039  4403 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.186977  4023 consensus_queue.cc:237] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.189199  3806 raft_consensus.cc:3060] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.196018  3806 raft_consensus.cc:2468] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:17.184063  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:17.198462  3778 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:17.198769  3628 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:17.195940  4403 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.178831  4405 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.189697  4407 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:17.188453  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 45053us
I20260709 12:26:17.207162  4259 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.198782  4338 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.210737  4409 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.181126  4402 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.211391  4259 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:17.212082  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 65989.3us
I20260709 12:26:17.218051  4404 raft_consensus.cc:2804] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.220034  4404 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.220402  4404 raft_consensus.cc:3060] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.223755  4411 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.224097  4419 raft_consensus.cc:2804] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.224568  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:17.225219  3659 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:17.227684  3775 leader_election.cc:336] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.228479  3775 leader_election.cc:336] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.224189  4411 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.240118  4411 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.241124  4402 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.207847  3736 raft_consensus.cc:2468] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
W20260709 12:26:17.242151  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 60748.4us
I20260709 12:26:17.242901  3702 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.214094  4409 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.252140  3702 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.254246  4259 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:26:17.245203  3775 leader_election.cc:336] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.249022  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:17.254709  4259 raft_consensus.cc:697] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:17.255069  3662 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:17.255518  4259 consensus_queue.cc:237] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.241894  4334 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.264401  3778 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.229907  4419 raft_consensus.cc:697] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:17.270848  3703 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:17.251942  4409 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.251742  4388 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.285418  4419 consensus_queue.cc:237] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.287070  4414 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.289531  4414 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.289656  4405 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:17.290494  4420 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:17.290285  4337 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.290967  4420 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.291361  4420 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.242271  3777 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:17.297043  3627 leader_election.cc:336] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.297984  3701 leader_election.cc:336] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.297798  4361 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:17.272775  4334 raft_consensus.cc:2804] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.307790  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:17.309669  3662 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.313491  4301 raft_consensus.cc:2749] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.283819  4388 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.314317  4388 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.314646  4337 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.316540  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:17.317200  3736 raft_consensus.cc:2468] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
W20260709 12:26:17.318423  3701 leader_election.cc:336] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.309326  4334 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.319975  4407 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.321131  4411 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.322204  4407 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.323143  4411 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.320118  4334 raft_consensus.cc:3060] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.324499  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:17.325282  3630 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:17.326324  4418 raft_consensus.cc:2804] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.326671  4418 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:17.327001  4418 raft_consensus.cc:3060] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.328075  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:17.328680  3661 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.324568  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:17.334350  3487 catalog_manager.cc:5697] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:17.336026  3701 leader_election.cc:336] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.336566  3701 leader_election.cc:336] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.339228  3661 raft_consensus.cc:2468] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:17.339752  4418 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:17.352370  3775 leader_election.cc:336] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.353744  4418 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:17.340672  4403 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.354544  3662 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
W20260709 12:26:17.342556  3701 leader_election.cc:336] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.343384  4361 tablet_bootstrap.cc:492] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:17.355830  4361 ts_tablet_manager.cc:1403] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.298s	user 0.019s	sys 0.009s
W20260709 12:26:17.344141  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 86345.1us
I20260709 12:26:17.331655  4409 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.342555  4420 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.345914  4388 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:17.347327  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 133069us
I20260709 12:26:17.348264  3484 catalog_manager.cc:5697] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 2 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.350963  3659 raft_consensus.cc:2468] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:17.342628  4334 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.282989  4404 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.361377  3703 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.361723  4361 raft_consensus.cc:359] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.371162  4403 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:17.371187  3660 raft_consensus.cc:2393] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 2: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:17.374774  4409 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.383659  4361 raft_consensus.cc:740] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.388927  4334 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.390846  4404 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:17.392165  3487 catalog_manager.cc:5697] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.392881  4388 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:17.393435  3738 raft_consensus.cc:2393] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
W20260709 12:26:17.403201  3701 leader_election.cc:336] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.397027  4420 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.398128  4361 consensus_queue.cc:260] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.405762  4361 ts_tablet_manager.cc:1434] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 12:26:17.406550  4361 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
W20260709 12:26:17.407366  3775 leader_election.cc:336] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.411572  3775 leader_election.cc:336] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.406811  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:17.415290  3809 raft_consensus.cc:2393] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 2: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
W20260709 12:26:17.423674  3701 leader_election.cc:336] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.431205  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 76740.4us
I20260709 12:26:17.431694  4425 raft_consensus.cc:2804] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.434413  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:17.435145  3738 raft_consensus.cc:2393] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 2: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:17.435875  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:17.436429  3737 raft_consensus.cc:3060] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.437137  3703 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.438189  3778 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.439004  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:17.439424  3662 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.441041  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:17.441556  3663 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.445188  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:17.445785  3733 raft_consensus.cc:3060] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.448477  3663 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:17.448982  4425 raft_consensus.cc:697] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:17.450239  4425 consensus_queue.cc:237] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.451388  4363 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.464761  4363 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.453444  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:17.465682  3734 raft_consensus.cc:3060] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.459990  4388 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.469694  4363 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:17.451952  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:17.470513  3664 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.472886  4388 raft_consensus.cc:697] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:17.473791  4388 consensus_queue.cc:237] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.460340  3703 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.465081  4409 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.477648  3703 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:17.477708  3737 raft_consensus.cc:2468] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:17.480032  3662 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
W20260709 12:26:17.462158  3701 consensus_peers.cc:597] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.467188  3487 catalog_manager.cc:5697] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 2 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.491853  3702 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.494652  4259 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.491613  4420 raft_consensus.cc:2749] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.512737  4421 raft_consensus.cc:2804] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.513341  4421 raft_consensus.cc:697] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:17.514101  4421 consensus_queue.cc:237] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:17.549431  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 62607.4us
W20260709 12:26:17.572197  3627 leader_election.cc:336] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:17.573321  3627 leader_election.cc:336] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.588121  3734 raft_consensus.cc:2468] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:17.602180  3664 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:17.612555  4361 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:17.614277  4361 tablet_bootstrap.cc:492] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:17.626502  3733 raft_consensus.cc:2468] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:17.632180  3487 catalog_manager.cc:5697] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.643750  3777 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.646458  4334 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.647236  4334 raft_consensus.cc:697] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:17.648737  4334 consensus_queue.cc:237] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.649542  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:17.615532  4361 ts_tablet_manager.cc:1403] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.209s	user 0.022s	sys 0.009s
I20260709 12:26:17.671409  3809 raft_consensus.cc:1275] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.677121  4424 consensus_queue.cc:1048] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:17.682614  3777 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.685817  4334 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.688210  3630 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.687377  4334 raft_consensus.cc:697] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:17.690855  4361 raft_consensus.cc:359] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.691771  4361 raft_consensus.cc:740] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.694890  4361 consensus_queue.cc:260] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.691674  4334 consensus_queue.cc:237] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.706410  3806 raft_consensus.cc:1275] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.727036  4425 consensus_queue.cc:1048] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:17.710345  3627 leader_election.cc:336] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.712996  3484 catalog_manager.cc:5697] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.719415  3664 raft_consensus.cc:1275] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.723423  4424 raft_consensus.cc:2804] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.724020  3811 raft_consensus.cc:1275] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.700049  4361 ts_tablet_manager.cc:1434] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:26:17.721350  3487 catalog_manager.cc:5697] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.733101  4361 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:17.733968  3487 catalog_manager.cc:5697] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.751216  3627 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.755143  4424 raft_consensus.cc:697] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:17.762560  4418 consensus_queue.cc:1048] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:26:17.766132  3630 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
W20260709 12:26:17.769249  3701 consensus_peers.cc:597] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.773542  4404 raft_consensus.cc:2749] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:26:17.773835  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 63570.2us
W20260709 12:26:17.774889  3627 leader_election.cc:336] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:17.776259  4363 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.776985  4363 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.782665  4424 consensus_queue.cc:237] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.783442  4363 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.784060  4363 raft_consensus.cc:493] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.784922  3778 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.786041  4411 raft_consensus.cc:2804] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.784814  4363 raft_consensus.cc:515] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.788826  4411 raft_consensus.cc:697] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:17.789986  4411 consensus_queue.cc:237] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.790284  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:17.791266  4363 leader_election.cc:290] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.791668  4405 raft_consensus.cc:2804] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.792877  4405 raft_consensus.cc:697] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:17.793988  3737 raft_consensus.cc:1275] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.810077  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:17.811813  3627 consensus_peers.cc:597] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:17.794096  4405 consensus_queue.cc:237] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:17.812935  3627 consensus_peers.cc:597] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.814432  3703 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:17.847519  4421 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:17.848169  4421 raft_consensus.cc:697] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:17.849403  4421 consensus_queue.cc:237] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:17.861362  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 47278.3us
I20260709 12:26:17.863987  4425 consensus_queue.cc:1048] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:17.871678  3775 consensus_peers.cc:597] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:17.882673  3627 consensus_peers.cc:597] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.883510  4443 log.cc:927] Time spent T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:26:17.885726  3701 consensus_peers.cc:597] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:17.889787  3484 catalog_manager.cc:5697] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 2 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:17.895013  3775 consensus_peers.cc:597] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:17.903539  3627 consensus_peers.cc:597] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.904047  3627 consensus_peers.cc:597] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:17.904532  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:17.904548  3627 consensus_peers.cc:597] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:17.916702  4358 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:17.918190  4447 raft_consensus.cc:2749] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.915313  4424 consensus_queue.cc:1048] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:26:17.920023  3701 consensus_peers.cc:597] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.924880  3487 catalog_manager.cc:5697] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 2 to 3, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.929519  4447 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.930179  4447 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:17.933239  4447 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:17.933950  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:17.937521  3627 consensus_peers.cc:597] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:17.969949  4361 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:17.971014  4361 tablet_bootstrap.cc:492] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:17.973097  4447 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.973753  4447 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:17.974997  3487 catalog_manager.cc:5697] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 2 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.971683  4361 ts_tablet_manager.cc:1403] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.239s	user 0.023s	sys 0.007s
I20260709 12:26:17.979020  4361 raft_consensus.cc:359] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.979800  4361 raft_consensus.cc:740] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:17.986616  4447 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
W20260709 12:26:17.989336  3627 consensus_peers.cc:597] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:17.988667  4361 consensus_queue.cc:260] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:17.996470  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:18.017958  4361 ts_tablet_manager.cc:1434] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:26:18.019140  4361 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
W20260709 12:26:18.023133  3775 consensus_peers.cc:597] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.025007  3482 catalog_manager.cc:5697] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:18.034297  3775 consensus_peers.cc:597] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.043103  4447 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.027097  3482 catalog_manager.cc:5697] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 2, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.043901  4447 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.046607  4447 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:18.043159  3627 consensus_peers.cc:597] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.049459  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:18.051688  3659 raft_consensus.cc:1275] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:18.062597  3627 consensus_peers.cc:597] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.072894  4361 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.073939  4361 tablet_bootstrap.cc:492] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.074683  4361 ts_tablet_manager.cc:1403] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.013s
I20260709 12:26:18.077797  4361 raft_consensus.cc:359] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.078595  4361 raft_consensus.cc:740] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.079449  4447 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.079494  4361 consensus_queue.cc:260] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.080334  4447 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.084249  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:18.086026  4447 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:18.095630  4447 raft_consensus.cc:493] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:18.097047  3701 consensus_peers.cc:597] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.097734  3775 consensus_peers.cc:597] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.096276  4447 raft_consensus.cc:515] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.101883  4447 leader_election.cc:290] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:18.103281  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:18.107455  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:18.108961  4358 leader_election.cc:304] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:18.110347  4447 raft_consensus.cc:2749] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:18.113508  3701 consensus_peers.cc:597] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:18.115934  3775 consensus_peers.cc:597] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.116365  4361 ts_tablet_manager.cc:1434] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.002s
I20260709 12:26:18.120149  4361 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
W20260709 12:26:18.121994  3701 consensus_peers.cc:597] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.123620  4421 consensus_queue.cc:1048] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:18.126856  3701 consensus_peers.cc:597] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.137547  4447 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.138283  4447 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.141337  4447 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:18.141911  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:18.148136  3664 raft_consensus.cc:1275] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:18.150245  4334 consensus_queue.cc:1048] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:18.154058  3775 consensus_peers.cc:597] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.166191  4447 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.166929  4447 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:18.167901  3775 consensus_peers.cc:597] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.169696  4447 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:18.170696  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:18.181269  3627 consensus_peers.cc:597] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.181826  3627 consensus_peers.cc:597] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.182699  3663 raft_consensus.cc:1275] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:18.184780  3775 consensus_peers.cc:597] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.184796  4447 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:18.186717  3627 consensus_peers.cc:597] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.185984  4447 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.188271  3663 raft_consensus.cc:1275] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:18.189472  3734 raft_consensus.cc:1275] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:18.189965  4447 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:18.190918  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:18.191268  4334 consensus_queue.cc:1048] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:18.209619  3775 consensus_peers.cc:597] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.217995  4447 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.218708  4447 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.236354  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:18.237169  4447 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:18.237030  4421 consensus_queue.cc:1048] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:18.237219  3735 raft_consensus.cc:2393] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 2: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
W20260709 12:26:18.243875  3701 consensus_peers.cc:597] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.253937  4447 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.254606  4447 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.254007  4414 consensus_queue.cc:1048] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:26:18.260488  3627 consensus_peers.cc:597] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.261873  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:18.264004  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:18.267596  4358 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:18.268462  4363 raft_consensus.cc:2749] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:18.269724  3701 consensus_peers.cc:597] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.259387  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.262485  4447 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:18.271984  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.272248  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.276527  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.277848  3659 raft_consensus.cc:1275] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:18.279063  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.279510  4334 consensus_queue.cc:1048] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.282271  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:18.289186  3627 consensus_peers.cc:597] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.281416  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.300168  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.304361  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.307168  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.308199  3659 raft_consensus.cc:2393] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 2: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
W20260709 12:26:18.316699  3775 consensus_peers.cc:597] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:18.322481  3627 consensus_peers.cc:597] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.343173  3701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 46355.9us
W20260709 12:26:18.352449  3701 consensus_peers.cc:597] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.356184  3701 consensus_peers.cc:597] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.357256  4447 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.357872  4447 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.360663  4447 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:18.362200  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:18.373198  4361 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.374265  4361 tablet_bootstrap.cc:492] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.374894  4361 ts_tablet_manager.cc:1403] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.255s	user 0.047s	sys 0.031s
I20260709 12:26:18.376931  3734 raft_consensus.cc:1275] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:18.380039  4357 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.381587  4447 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:18.382733  4357 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.383936  4447 raft_consensus.cc:2749] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.385061  4357 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.386152  4447 raft_consensus.cc:2749] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.386576  4361 raft_consensus.cc:359] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.387306  4361 raft_consensus.cc:740] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.387944  4357 leader_election.cc:304] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.387977  4361 consensus_queue.cc:260] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.389073  4363 raft_consensus.cc:2749] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.391220  4361 ts_tablet_manager.cc:1434] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 12:26:18.392192  4361 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.392004  4357 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.392867  4363 raft_consensus.cc:2749] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.397589  4357 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.398391  4363 raft_consensus.cc:2749] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.399924  4357 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.400671  4363 raft_consensus.cc:2749] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.401940  4357 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.402685  4363 raft_consensus.cc:2749] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.403133  3734 raft_consensus.cc:1275] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:18.415436  3627 consensus_peers.cc:597] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.419242  3627 consensus_peers.cc:597] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.404071  4357 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.421780  4357 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.422842  4447 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.422068  4363 raft_consensus.cc:2749] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.428433  3664 raft_consensus.cc:1275] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:18.438187  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:18.443387  4357 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:18.443662  4418 consensus_queue.cc:1048] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.444110  4414 consensus_queue.cc:1048] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.444442  4363 raft_consensus.cc:2749] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.445367  4418 consensus_queue.cc:1048] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.471055  4361 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.468346  4447 raft_consensus.cc:2749] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.472085  4361 tablet_bootstrap.cc:492] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.473954  4361 ts_tablet_manager.cc:1403] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.027s
I20260709 12:26:18.482223  4361 raft_consensus.cc:359] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.482890  4361 raft_consensus.cc:740] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.483645  4361 consensus_queue.cc:260] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.485913  4361 ts_tablet_manager.cc:1434] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:18.486760  4361 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
W20260709 12:26:18.515857  3701 consensus_peers.cc:597] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.521461  4361 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.522528  4361 tablet_bootstrap.cc:492] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.523181  4361 ts_tablet_manager.cc:1403] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 12:26:18.526822  4361 raft_consensus.cc:359] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.527493  4361 raft_consensus.cc:740] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.528294  4361 consensus_queue.cc:260] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.530541  4361 ts_tablet_manager.cc:1434] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:26:18.531337  4361 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.553768  4361 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.554687  4361 tablet_bootstrap.cc:492] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.555282  4361 ts_tablet_manager.cc:1403] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 12:26:18.557888  4361 raft_consensus.cc:359] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.558578  4361 raft_consensus.cc:740] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.560019  4361 consensus_queue.cc:260] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:18.561491  3775 consensus_peers.cc:597] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.562256  4361 ts_tablet_manager.cc:1434] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:26:18.563177  4361 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.587023  4361 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.587927  4361 tablet_bootstrap.cc:492] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.588536  4361 ts_tablet_manager.cc:1403] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 12:26:18.591450  4361 raft_consensus.cc:359] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.592140  4361 raft_consensus.cc:740] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.592818  4361 consensus_queue.cc:260] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.594771  4361 ts_tablet_manager.cc:1434] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:18.595919  4361 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.621587  4361 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.622520  4361 tablet_bootstrap.cc:492] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.623165  4361 ts_tablet_manager.cc:1403] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 12:26:18.624390 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:37069
I20260709 12:26:18.624485  4509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:37069 every 8 connection(s)
I20260709 12:26:18.625967  4361 raft_consensus.cc:359] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.626732  4361 raft_consensus.cc:740] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.627431  4361 consensus_queue.cc:260] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.630481  4361 ts_tablet_manager.cc:1434] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:26:18.631393  4361 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.723662  4466 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.729773  4361 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.730826  4361 tablet_bootstrap.cc:492] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.732506  4361 ts_tablet_manager.cc:1403] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.101s	user 0.020s	sys 0.019s
I20260709 12:26:18.735145  4510 heartbeater.cc:344] Connected to a master server at 127.29.9.62:34565
I20260709 12:26:18.736034  4510 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:18.736938  4510 heartbeater.cc:507] Master 127.29.9.62:34565 requested a full tablet report, sending...
I20260709 12:26:18.746742  4361 raft_consensus.cc:359] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.747467  4361 raft_consensus.cc:740] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.748101  4361 consensus_queue.cc:260] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:18.750142  4361 ts_tablet_manager.cc:1434] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.004s
I20260709 12:26:18.751008  4361 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.757442  4463 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.810899  4361 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.811821  4361 tablet_bootstrap.cc:492] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.814450  4361 ts_tablet_manager.cc:1403] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.005s
I20260709 12:26:18.814999  3482 ts_manager.cc:194] Re-registered known tserver with Master: b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:18.820330  4361 raft_consensus.cc:359] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.821053  4361 raft_consensus.cc:740] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.821717  4361 consensus_queue.cc:260] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.824254  4361 ts_tablet_manager.cc:1434] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:26:18.825021  4361 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.852900  4361 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.853808  4361 tablet_bootstrap.cc:492] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.854419  4361 ts_tablet_manager.cc:1403] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.012s
I20260709 12:26:18.856992  4361 raft_consensus.cc:359] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.857638  4361 raft_consensus.cc:740] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.858422  4361 consensus_queue.cc:260] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.860652  4361 ts_tablet_manager.cc:1434] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:18.861441  4361 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.861658  3482 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38034
I20260709 12:26:18.866524  4510 heartbeater.cc:499] Master 127.29.9.62:34565 was elected leader, sending a full tablet report...
I20260709 12:26:18.881386  4361 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.882304  4361 tablet_bootstrap.cc:492] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.882961  4361 ts_tablet_manager.cc:1403] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 12:26:18.885483  4361 raft_consensus.cc:359] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.886164  4361 raft_consensus.cc:740] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.886900  4361 consensus_queue.cc:260] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.888998  4361 ts_tablet_manager.cc:1434] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:18.889791  4361 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.922219  4463 raft_consensus.cc:3060] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.956920  4361 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.957862  4361 tablet_bootstrap.cc:492] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.958606  4361 ts_tablet_manager.cc:1403] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.028s
I20260709 12:26:18.962965  4361 raft_consensus.cc:359] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.963752  4361 raft_consensus.cc:740] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.964735  4361 consensus_queue.cc:260] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:18.966750  4361 ts_tablet_manager.cc:1434] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:26:18.967530  4361 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:18.989362  4361 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.990237  4361 tablet_bootstrap.cc:492] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:18.991936  4361 ts_tablet_manager.cc:1403] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 12:26:18.994343  4361 raft_consensus.cc:359] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.994978  4361 raft_consensus.cc:740] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:18.995594  4361 consensus_queue.cc:260] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:18.997067  4361 ts_tablet_manager.cc:1434] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:18.997795  4361 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.017230  4361 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.018095  4361 tablet_bootstrap.cc:492] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.018740  4361 ts_tablet_manager.cc:1403] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 12:26:19.021246  4361 raft_consensus.cc:359] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.021874  4361 raft_consensus.cc:740] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.022517  4361 consensus_queue.cc:260] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.024600  4361 ts_tablet_manager.cc:1434] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:19.025399  4361 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.067776  4361 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.068678  4361 tablet_bootstrap.cc:492] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.069614  4361 ts_tablet_manager.cc:1403] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.004s
I20260709 12:26:19.071982  4361 raft_consensus.cc:359] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.072618  4361 raft_consensus.cc:740] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.073246  4361 consensus_queue.cc:260] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.077172  4361 ts_tablet_manager.cc:1434] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:19.077967  4361 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.093356  4463 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.097095  4361 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.098042  4361 tablet_bootstrap.cc:492] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.098678  4361 ts_tablet_manager.cc:1403] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:26:19.101344  4361 raft_consensus.cc:359] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.101962  4361 raft_consensus.cc:740] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.102593  4361 consensus_queue.cc:260] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.107524  4361 ts_tablet_manager.cc:1434] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:26:19.109934  4361 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.109941  4466 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.292032  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 58208.2us
I20260709 12:26:19.287230  4452 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.295414  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 53595.9us
W20260709 12:26:19.294983  3701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 71951.1us
W20260709 12:26:19.332630  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 75666.7us
I20260709 12:26:19.338820  4437 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.415773  4361 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.416707  4361 tablet_bootstrap.cc:492] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.417596  4361 ts_tablet_manager.cc:1403] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.308s	user 0.044s	sys 0.052s
I20260709 12:26:19.420080  4361 raft_consensus.cc:359] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:19.422186  4361 raft_consensus.cc:740] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.422950  4361 consensus_queue.cc:260] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:19.428431  4361 ts_tablet_manager.cc:1434] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:26:19.429176  4361 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.447815  4551 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.448398  4551 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.450445  4551 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:19.493955  3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 247587us
I20260709 12:26:19.499233  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:19.499995  3733 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:19.503440  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
W20260709 12:26:19.521938  3775 leader_election.cc:343] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:19.546649  4361 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.547642  4361 tablet_bootstrap.cc:492] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.548288  4361 ts_tablet_manager.cc:1403] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.119s	user 0.041s	sys 0.017s
I20260709 12:26:19.550997  4361 raft_consensus.cc:359] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.551669  4361 raft_consensus.cc:740] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.552565  4361 consensus_queue.cc:260] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.563313  4463 raft_consensus.cc:3060] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.568168  4361 ts_tablet_manager.cc:1434] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:19.575690  3778 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:19.578307  4229 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:19.578662  4229 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.578967  4229 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.587092  4361 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.590977  4229 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.592726  4537 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.593266  4537 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:19.595988  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:19.596607  4466 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:19.597780  3701 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:19.598553  4541 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:19.598910  4541 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.599222  4541 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.603130  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:19.605082  3659 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:19.607640  4537 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:19.630511  4229 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:19.633736  4541 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:19.638540  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:19.639209  4437 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.642764  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:19.643404  3735 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.643689  4541 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:19.649367  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:19.651054  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:19.651584  3662 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:19.657552  3775 leader_election.cc:343] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:19.658056  3662 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:19.660069  3703 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:19.666922  4420 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:19.667637  4420 raft_consensus.cc:697] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:19.668617  4420 consensus_queue.cc:237] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:19.672907  3735 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 3.
I20260709 12:26:19.680862  3778 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:19.682667  4229 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:19.687701  4229 raft_consensus.cc:697] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:19.688499  4229 consensus_queue.cc:237] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.699273  4437 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:19.704996  4361 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.705988  4361 tablet_bootstrap.cc:492] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.706621  4361 ts_tablet_manager.cc:1403] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.054s
I20260709 12:26:19.709201  4361 raft_consensus.cc:359] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.709678  4361 raft_consensus.cc:740] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.710438  4361 consensus_queue.cc:260] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.716426  4361 ts_tablet_manager.cc:1434] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:26:19.717276  4361 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.726016  3484 catalog_manager.cc:5697] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 3, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.731575  3482 catalog_manager.cc:5697] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 3, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 3 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.767181  4361 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.768328  4361 tablet_bootstrap.cc:492] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.769110  4361 ts_tablet_manager.cc:1403] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.009s
I20260709 12:26:19.774583  4361 raft_consensus.cc:359] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.775317  4361 raft_consensus.cc:740] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.776110  4361 consensus_queue.cc:260] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:19.778283  4361 ts_tablet_manager.cc:1434] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:26:19.779458  4361 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.789985  4463 raft_consensus.cc:3060] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.802304  4437 raft_consensus.cc:3060] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.888952  4361 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.889828  4361 tablet_bootstrap.cc:492] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.890486  4361 ts_tablet_manager.cc:1403] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.012s
I20260709 12:26:19.900661  4361 raft_consensus.cc:359] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:19.901357  4361 raft_consensus.cc:740] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.901981  4361 consensus_queue.cc:260] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:19.908921  4361 ts_tablet_manager.cc:1434] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:19.909713  4361 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:19.941629  4463 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.944320  4361 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.946295  4361 tablet_bootstrap.cc:492] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:19.946888  4361 ts_tablet_manager.cc:1403] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.005s
I20260709 12:26:19.949352  4361 raft_consensus.cc:359] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.949977  4361 raft_consensus.cc:740] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:19.950505  4361 consensus_queue.cc:260] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:19.954671  4361 ts_tablet_manager.cc:1434] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:26:19.957625  4361 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:20.004873  4361 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.005774  4361 tablet_bootstrap.cc:492] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:20.006405  4361 ts_tablet_manager.cc:1403] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.015s
I20260709 12:26:20.009202  4361 raft_consensus.cc:359] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:20.009833  4361 raft_consensus.cc:740] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:20.010424  4361 consensus_queue.cc:260] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:20.013525  4361 ts_tablet_manager.cc:1434] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:20.014288  4361 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:20.059995  4361 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.060899  4361 tablet_bootstrap.cc:492] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:20.061523  4361 ts_tablet_manager.cc:1403] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.009s
I20260709 12:26:20.063907  4361 raft_consensus.cc:359] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:20.064543  4361 raft_consensus.cc:740] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:20.065158  4361 consensus_queue.cc:260] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:20.067178  4361 ts_tablet_manager.cc:1434] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:26:20.068439  4361 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:20.092233  4361 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.093120  4361 tablet_bootstrap.cc:492] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:20.093758  4361 ts_tablet_manager.cc:1403] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 12:26:20.096331  4361 raft_consensus.cc:359] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:20.097016  4361 raft_consensus.cc:740] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:20.097662  4361 consensus_queue.cc:260] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:20.099752  4361 ts_tablet_manager.cc:1434] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:20.103571  4437 raft_consensus.cc:1275] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:20.105708  4420 consensus_queue.cc:1048] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.107986  4361 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:20.126075  4466 raft_consensus.cc:3060] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.160116  4463 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.173259  4463 raft_consensus.cc:1275] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:20.177004  3659 raft_consensus.cc:1275] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:20.180078  4229 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.181514  4361 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:20.182421  4361 tablet_bootstrap.cc:492] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:20.183014  4361 ts_tablet_manager.cc:1403] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 0.075s	user 0.042s	sys 0.020s
I20260709 12:26:20.185374  4361 raft_consensus.cc:359] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:20.185995  4361 raft_consensus.cc:740] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:20.186610  4361 consensus_queue.cc:260] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:20.188660  4361 ts_tablet_manager.cc:1434] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:26:20.189388  4361 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Bootstrap starting.
I20260709 12:26:20.202878  4550 consensus_queue.cc:1048] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:20.250617  3701 consensus_peers.cc:597] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:20.329339  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 81788.8us
W20260709 12:26:21.531307 29737 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4080 after lost signal to thread 3775
W20260709 12:26:21.531908 29737 kernel_stack_watchdog.cc:198] Thread 3775 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 186ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 12:26:22.462622  3685 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1160 after lost signal to thread 29735
W20260709 12:26:22.532563 29737 debug-util.cc:398] Leaking SignalData structure 0x7b0800229720 after lost signal to thread 3775
W20260709 12:26:22.533094 29737 kernel_stack_watchdog.cc:198] Thread 3775 stuck at /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:249 for 186ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 12:26:22.804214  3777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.007s	sys 0.003s
W20260709 12:26:22.804780  3777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.007s	sys 0.003s
I20260709 12:26:23.254437  4361 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:26:23.259814  3775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.913s	user 0.010s	sys 0.038s
W20260709 12:26:23.260263  3775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.914s	user 0.010s	sys 0.038s
W20260709 12:26:23.260598  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 2.91628e+06us
I20260709 12:26:23.255621  4361 tablet_bootstrap.cc:492] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Bootstrap complete.
I20260709 12:26:23.361979  4361 ts_tablet_manager.cc:1403] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Time spent bootstrapping tablet: real 3.173s	user 0.037s	sys 0.023s
I20260709 12:26:23.433319  4361 raft_consensus.cc:359] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.441148  4361 raft_consensus.cc:740] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Initialized, Role: FOLLOWER
I20260709 12:26:23.449239  4361 consensus_queue.cc:260] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.500267  4405 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.500923  4405 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.503412  4405 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.549929  4616 raft_consensus.cc:493] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.439116  4437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57016 (request call id 42) took 3090 ms. Trace:
I20260709 12:26:23.517693  4229 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.527258  4540 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.529381  4550 raft_consensus.cc:493] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
W20260709 12:26:23.540318  3776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.201s	user 0.015s	sys 0.027s
W20260709 12:26:23.542845  3659 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.323s	user 0.011s	sys 0.048s
I20260709 12:26:23.544020  4539 raft_consensus.cc:493] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.550143  4620 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.551249  4590 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.552155  4627 raft_consensus.cc:493] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.553437  4622 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.553753  4593 raft_consensus.cc:493] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.554926  4614 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.555251  4584 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.556152  4611 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.556281  4607 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
W20260709 12:26:23.556752  3685 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1720 after lost signal to thread 3521
I20260709 12:26:23.557273  4608 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.557859  4612 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.558907  4623 raft_consensus.cc:493] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.560983  4601 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.581169  4229 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.593665  4539 raft_consensus.cc:515] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.593832  4550 raft_consensus.cc:515] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.580904  4437 rpcz_store.cc:276] 0709 12:26:20.348628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.348747 (+   119us) service_pool.cc:224] Handling call
0709 12:26:23.438270 (+3089523us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b580076fb98. stack: 00007f032d50e343 00007f032d50e240 00007f032ce9d1d4 00007f0336bdb304 00007f0336bdb299 00007f032d3c8db1 00007f032d508b71 00007f032d508eee 000000000036eb39 00007f033557c1e0 00007f03356450c4 00007f0335645131 00007f0335606fc0 00007f03355f1929 00007f03355f13d2 00007f032eb68bd4
0709 12:26:23.438443 (+   173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.438730 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.438759 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.438806 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:23.438841 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.438904 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.439034 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3998848}
I20260709 12:26:23.583917  4616 raft_consensus.cc:515] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.599869  4603 raft_consensus.cc:493] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.556444  4621 raft_consensus.cc:493] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.592422  4540 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.617025  4610 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.598963  4405 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
W20260709 12:26:23.632223  3776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.293s	user 0.016s	sys 0.027s
I20260709 12:26:23.633769  4361 ts_tablet_manager.cc:1434] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba: Time spent starting tablet: real 0.271s	user 0.001s	sys 0.008s
I20260709 12:26:23.612524  4593 raft_consensus.cc:515] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
W20260709 12:26:23.678745  3659 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.459s	user 0.011s	sys 0.048s
I20260709 12:26:23.679112  4229 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.612109  4622 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:23.657512  3685 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5980 after lost signal to thread 3688
I20260709 12:26:23.613135  4590 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.610452  4627 raft_consensus.cc:515] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.610072  4620 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.612289  4614 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.613853  4584 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.617769  4611 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.712636  3484 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37362 (request call id 122) took 3480 ms. Trace:
I20260709 12:26:23.620275  4607 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.621843  4601 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.620466  4608 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.737613  4539 leader_election.cc:290] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.739462  4550 leader_election.cc:290] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:23.740903  4593 leader_election.cc:290] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.676173  4405 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.741386  4593 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
W20260709 12:26:23.741881  3685 debug-util.cc:398] Leaking SignalData structure 0x7b08002488e0 after lost signal to thread 3762
W20260709 12:26:23.742241  3685 debug-util.cc:398] Leaking SignalData structure 0x7b08001962a0 after lost signal to thread 3763
W20260709 12:26:23.743340  3685 debug-util.cc:398] Leaking SignalData structure 0x7b080034cd00 after lost signal to thread 3836
I20260709 12:26:23.630600  4623 raft_consensus.cc:515] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.745800  4623 leader_election.cc:290] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:23.713052  3484 rpcz_store.cc:276] 0709 12:26:20.209673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.209798 (+   125us) service_pool.cc:224] Handling call
0709 12:26:23.690404 (+3480606us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13599,"reported_tablets":1}
I20260709 12:26:23.622354  4612 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.740679  4591 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.746281  4623 raft_consensus.cc:493] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.651439  4603 raft_consensus.cc:515] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.651049  4621 raft_consensus.cc:515] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
W20260709 12:26:23.764937  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 71919.4us
I20260709 12:26:23.683421  4610 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.741888  4593 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.781622  4613 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.782146  4613 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.782657  4621 leader_election.cc:290] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.782812  4604 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.784212  4609 raft_consensus.cc:493] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.784678  4609 raft_consensus.cc:515] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.786007  4405 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:23.778400  3685 debug-util.cc:398] Leaking SignalData structure 0x7b08002c64a0 after lost signal to thread 4509
I20260709 12:26:23.786580  4609 leader_election.cc:290] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:23.787010  4624 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.787482  4624 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.789435  4618 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.789951  4618 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.778929  4539 raft_consensus.cc:493] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.792111  4586 raft_consensus.cc:493] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.792618  4586 raft_consensus.cc:515] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.765620  4601 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.772390  4596 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.783324  4604 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.784065  4625 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.764062  4623 raft_consensus.cc:515] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.784106  4619 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.784055  4592 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.792229  4539 raft_consensus.cc:515] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.843554  4618 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.856668  4631 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.857257  4631 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.858609  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.859306  3656 raft_consensus.cc:2468] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:23.838229  4625 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.860217  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.860580  4607 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.801837  4628 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.861222  4640 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.861653  4622 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.760592  4591 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.862453  4635 raft_consensus.cc:493] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.862852  4642 raft_consensus.cc:493] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.863381  4608 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.863575  4541 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.864214  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.865061  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.866261  4540 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.866475  4405 raft_consensus.cc:493] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.867374  4584 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.867693  4610 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.868358  4651 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.814792  4616 leader_election.cc:290] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.860953  4636 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.936502  3659 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55542 (request call id 274) took 3723 ms. Trace:
I20260709 12:26:23.862316  4641 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.882391  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.868671  4620 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.799630  4626 raft_consensus.cc:493] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.861382  4537 raft_consensus.cc:493] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.862514  4614 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.859246  4631 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.942178  3777 leader_election.cc:304] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:23.815809  4609 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.891528  4618 raft_consensus.cc:493] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.894323  4622 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.801662  4630 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.818114  4596 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.948946  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.938243  4590 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.938565  3659 rpcz_store.cc:276] 0709 12:26:20.205861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.205957 (+    96us) service_pool.cc:224] Handling call
0709 12:26:20.206210 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:20.206490 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.206516 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:20.206918 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 12:26:20.219916 (+ 12998us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:23.680643 (+3460727us) log.cc:844] Serialized 14 byte log entry
0709 12:26:23.926021 (+245378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.926116 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:23.926172 (+    56us) raft_consensus.cc:1685] finished
0709 12:26:23.926184 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.929232 (+  3048us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162418,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":637,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":692,"thread_start_us":3718053,"threads_started":3,"wal-append.queue_time_us":9203,"wal-append.run_cpu_time_us":1673,"wal-append.run_wall_time_us":1038304}
I20260709 12:26:23.921773  4541 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.850526  4619 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.958065  4602 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.910192  4642 raft_consensus.cc:515] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.939154  3655 raft_consensus.cc:2468] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:23.933036  4405 raft_consensus.cc:515] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.958809  4644 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.959131  4614 raft_consensus.cc:2804] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.959242  4599 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.852267  4592 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.959764  4621 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.960073  4634 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.959646  4601 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.981909  4613 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.982158  4601 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.982563  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.982856  4645 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.893895  4640 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.941284  4636 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.984445  4601 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.885006  4628 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.985162  4640 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:23.985555  4636 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.958376  4587 raft_consensus.cc:493] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.986433  4628 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.986209  4587 raft_consensus.cc:515] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.986979  4628 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.987283  4591 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.987437  4628 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.963467  4630 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.988317  4587 leader_election.cc:290] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.989148  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.989461  4628 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.989688  4608 raft_consensus.cc:493] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.970007  4627 leader_election.cc:290] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.990401  4612 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.946103  4641 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.975971  4611 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.981163  4605 raft_consensus.cc:493] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.991389  4605 raft_consensus.cc:515] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.918958  4635 raft_consensus.cc:515] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.992081  4586 leader_election.cc:290] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.985181  4596 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.959029  4625 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.993096  4625 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.993459  4605 leader_election.cc:290] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.954053  4620 raft_consensus.cc:493] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.981281  4650 raft_consensus.cc:493] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.994127  4620 raft_consensus.cc:515] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.955766  4631 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.994580  4635 leader_election.cc:290] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.995236  4631 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.996014  4541 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:23.996212  4628 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.996692  4628 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.958065  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.993023  4539 leader_election.cc:290] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.970855  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.945341  4626 raft_consensus.cc:515] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:23.998452  4659 raft_consensus.cc:493] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.998658  4628 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.998992  4659 raft_consensus.cc:515] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.976203  4614 raft_consensus.cc:493] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.999298  4604 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.948714  4651 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.000061  4641 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.990192  4608 raft_consensus.cc:515] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:23.957023  4622 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.999213  4628 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.981920  4634 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.001068  4659 leader_election.cc:290] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.001466  4651 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.002089  4622 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.999437  4653 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.986465  4619 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.996757  4656 raft_consensus.cc:493] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.002669  4653 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.003196  4656 raft_consensus.cc:515] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:23.952822  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.959635  4637 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.004437  4637 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.004729  4599 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.002308  4634 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.005780  4634 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:23.982389  4633 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.006557  4637 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.005805  4644 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.006836  4656 leader_election.cc:290] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:23.947165  4537 raft_consensus.cc:515] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.997829  3658 raft_consensus.cc:2468] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:23.981138  4621 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.008467  4644 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.008929  4537 leader_election.cc:290] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.009495  4621 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.009618  4633 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.006225  4634 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.002599  4622 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:23.954559  4609 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.005040  4653 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.002653  3657 raft_consensus.cc:2468] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:23.954731  4618 raft_consensus.cc:515] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.011883  4634 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.011519  4622 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:23.993600  4625 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.012743  4628 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.013454  4405 leader_election.cc:290] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.991303  4611 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.005323  4608 leader_election.cc:290] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.011490  4620 leader_election.cc:290] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.013942  4622 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:23.964504  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:23.983363  4645 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.017781  3777 leader_election.cc:304] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:23.994143  4592 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.025136  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.026095  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.007337  4643 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.014377  4614 raft_consensus.cc:3060] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.006979  4638 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.002360  4623 leader_election.cc:290] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.006249  4603 leader_election.cc:290] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:23.997390  4631 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.014294  4625 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.043500  4643 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.023042  4640 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.047935  4640 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.049957  4640 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.014760  4611 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.027647  4621 raft_consensus.cc:2804] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.057924  4621 raft_consensus.cc:493] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.058331  4621 raft_consensus.cc:3060] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.034329  3777 leader_election.cc:304] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.020776  4550 raft_consensus.cc:493] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:23.974881  4602 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.069082  4550 raft_consensus.cc:515] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.070713  4637 raft_consensus.cc:2804] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.071142  4637 raft_consensus.cc:493] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.071491  4637 raft_consensus.cc:3060] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.989701  4630 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.038837  4599 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.031599  4635 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.040527  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.003832  4642 leader_election.cc:290] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.041301  4618 leader_election.cc:290] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:23.994750  4650 raft_consensus.cc:515] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.039959  4626 leader_election.cc:290] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.036832  4638 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.014694  4628 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.093529  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:24.094820  3701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 155841us
I20260709 12:26:24.089233  4609 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.090792  4611 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.091774  4635 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.100554  4550 leader_election.cc:290] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.105137  4643 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.095039  4653 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.096745  4645 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.112341  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.115049  4635 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.112787  4628 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.113260  4611 raft_consensus.cc:493] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.116063  4611 raft_consensus.cc:515] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.118131  4611 leader_election.cc:290] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.101532  4537 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.113379  4630 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.105022  3656 raft_consensus.cc:2468] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.119537  4550 raft_consensus.cc:493] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.135408  4671 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.135689  4550 raft_consensus.cc:515] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.135974  4671 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.136795  4630 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.137797  4671 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.119928  4645 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.119509  4628 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.121651  4638 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.108217  4643 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.104274  4618 raft_consensus.cc:493] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.138479  4645 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.119661  4652 raft_consensus.cc:493] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.139360  4652 raft_consensus.cc:515] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.139861  4628 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.140442  4645 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.141491  4652 leader_election.cc:290] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.141687  4650 leader_election.cc:290] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.143028  4550 leader_election.cc:290] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.145041  4614 raft_consensus.cc:515] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.124147  4653 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.149065  4621 raft_consensus.cc:515] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.151288  4637 raft_consensus.cc:515] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.153456  4637 leader_election.cc:290] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.154381  3809 raft_consensus.cc:1240] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.154485  4633 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.138895  4630 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.147598  4653 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.156920  4606 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.134814  4537 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.157590  4606 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.158277  4621 leader_election.cc:290] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.171957  4639 raft_consensus.cc:493] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.172266  4630 raft_consensus.cc:493] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.172778  4630 raft_consensus.cc:515] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.174144  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.174768  4630 leader_election.cc:290] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.175936  4670 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.175860  4673 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.176523  4670 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.176654  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.177632  3657 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.178066  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.178535  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.178666  4670 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.177660  4593 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.178699  3809 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.178820  4630 raft_consensus.cc:493] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.180446  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.180843  4630 raft_consensus.cc:515] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.182075  4624 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.182746  4630 leader_election.cc:290] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.177012  4673 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.184273  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.184852  3806 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:24.185665  4673 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.187108  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.187275  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.188594  4602 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.190384  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.190750  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.190968  3811 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.191341  3806 raft_consensus.cc:2468] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.160050  4643 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.191960  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.192525  3808 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.172001  4635 raft_consensus.cc:493] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.161993  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.159633  4606 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.193043  4635 raft_consensus.cc:515] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.193415  3660 raft_consensus.cc:2468] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.194286  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.195072  4635 leader_election.cc:290] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.195425  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.196296  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.196563  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.183439  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.197171  3660 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:24.197914  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.198021  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.198571  3658 raft_consensus.cc:2468] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.199083  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.164666  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.199695  3809 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.198627  3660 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:24.201841  4643 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.202643  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.206168  3777 leader_election.cc:304] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.207108  3777 leader_election.cc:304] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.207850  4593 raft_consensus.cc:2804] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.208185  3777 leader_election.cc:304] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.209050  4637 raft_consensus.cc:2804] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.209434  4637 raft_consensus.cc:493] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.209764  4637 raft_consensus.cc:3060] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.210142  4624 raft_consensus.cc:2804] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.210580  4624 raft_consensus.cc:493] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.210944  4624 raft_consensus.cc:3060] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.165059  4537 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.200551  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.208213  4593 raft_consensus.cc:493] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.175364  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.200044  3662 raft_consensus.cc:3060] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.215795  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.179710  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.202476  4639 raft_consensus.cc:515] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.216787  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.216813  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.217283  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.191347  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.218703  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.219513  3664 raft_consensus.cc:3060] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.167057  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.169243  4614 leader_election.cc:290] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.217536  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.223382  4593 raft_consensus.cc:3060] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.199553  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.138954  4618 raft_consensus.cc:515] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.229835  4670 raft_consensus.cc:493] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.227797  4630 raft_consensus.cc:493] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.228893  3807 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:24.224705  4673 raft_consensus.cc:493] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.230162  3810 raft_consensus.cc:1240] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.231325  4670 raft_consensus.cc:515] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.234138  4670 leader_election.cc:290] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.234831  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.232091  4673 raft_consensus.cc:515] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.236058  4639 leader_election.cc:290] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.236442  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.237278  4673 leader_election.cc:290] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.223517  4643 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.237871  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.238027  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.238570  3661 raft_consensus.cc:3060] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.241664  4670 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.242235  4670 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.226886  3657 raft_consensus.cc:2468] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:24.243875  4673 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.244230  4670 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.244385  4673 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.244742  4670 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.243413  3663 raft_consensus.cc:2468] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:24.242448  4618 leader_election.cc:290] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.231392  4630 raft_consensus.cc:515] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.246423  4673 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.247126  3662 raft_consensus.cc:2468] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:24.247489  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.247738  4630 leader_election.cc:290] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.245260  4670 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.253944  4643 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.255957  4643 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.257295  4670 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.261227  4537 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.227032  3809 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:24.261829  3664 raft_consensus.cc:2468] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:24.262830  3658 raft_consensus.cc:1240] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.263214  4662 raft_consensus.cc:493] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.263767  4662 raft_consensus.cc:515] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.261747  4537 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.266036  3734 raft_consensus.cc:1275] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:24.262899  4668 raft_consensus.cc:493] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.263125  4653 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.266345  3661 raft_consensus.cc:2468] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:24.260195  4669 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.270331  4669 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.271662  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.260442  3656 raft_consensus.cc:1240] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.260921  3777 leader_election.cc:304] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.273046  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.273250  3777 leader_election.cc:304] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.273607  4662 leader_election.cc:290] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.262698  4635 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.274467  3777 leader_election.cc:304] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.243163  4593 raft_consensus.cc:515] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.266906  4668 raft_consensus.cc:515] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.268975  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.275882  4629 raft_consensus.cc:2804] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.276393  4629 raft_consensus.cc:697] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:24.276966  4668 leader_election.cc:290] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.277441  4621 raft_consensus.cc:2804] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.274331  4635 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.268059  4653 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:24.270576  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.272446  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.277248  4629 consensus_queue.cc:237] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.279428  4653 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.273897  4614 raft_consensus.cc:2804] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.280184  4614 raft_consensus.cc:697] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:24.280211  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.281175  4635 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.266945  4537 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.281055  4614 consensus_queue.cc:237] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.281517  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.272600  4669 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.277951  4621 raft_consensus.cc:697] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:24.284819  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.285102  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.285328  4621 consensus_queue.cc:237] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.286480  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.287240  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.290423  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.259757  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.287434  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.259882  4624 raft_consensus.cc:515] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.287911  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.289677  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.289944  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.303000  4593 leader_election.cc:290] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.304023  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.304113  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.304483  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.305239  3803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.303205  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.296087  3806 raft_consensus.cc:1240] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.306314  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.284377  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.307017  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.301119  3735 raft_consensus.cc:2468] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.307487  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.307701  3661 raft_consensus.cc:3060] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.303093  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.298237  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.298441  3658 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:24.313292  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.315167  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.315697  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.316510  4437 raft_consensus.cc:2468] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:24.319242  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.299472  4637 raft_consensus.cc:515] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.321094  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.321440  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.324662  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.325476  3738 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.327462  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.328068  3661 raft_consensus.cc:2468] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:24.329157  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.331243  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.340884  3733 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.329246  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.343015  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.332578  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.343704  3663 raft_consensus.cc:3060] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.348398  3777 leader_election.cc:304] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.352031  4629 raft_consensus.cc:2804] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.352531  4629 raft_consensus.cc:697] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:24.353399  4629 consensus_queue.cc:237] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.356208  4356 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:24.357070  4670 raft_consensus.cc:2804] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.357434  4670 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.333592  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.362479  3656 raft_consensus.cc:3060] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.357805  4670 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.367882  3663 raft_consensus.cc:2468] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:24.367758  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.368357  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.369320  3777 leader_election.cc:304] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.372462  4585 raft_consensus.cc:2804] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.372757  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.372980  4585 raft_consensus.cc:697] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:24.374011  4585 consensus_queue.cc:237] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.334513  4637 leader_election.cc:290] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.337311  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.340360  4624 leader_election.cc:290] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.381537  4675 consensus_queue.cc:1059] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:24.385079  4675 raft_consensus.cc:3055] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.385408  4675 raft_consensus.cc:740] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:24.386139  4675 consensus_queue.cc:260] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.387281  4675 raft_consensus.cc:3060] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.379977  3702 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:24.389307  3702 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:24.390671  3656 raft_consensus.cc:2468] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:24.390911  4537 raft_consensus.cc:2804] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.391026  4653 consensus_queue.cc:1059] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.391410  4537 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.391810  4537 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.392499  4653 raft_consensus.cc:3055] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.389829  4669 raft_consensus.cc:2804] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.392866  4653 raft_consensus.cc:740] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:24.393098  4669 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.393563  4669 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.393734  4653 consensus_queue.cc:260] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.394886  4653 raft_consensus.cc:3060] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.400570  3777 leader_election.cc:304] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.401446  4599 raft_consensus.cc:2804] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.401927  4599 raft_consensus.cc:697] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:24.402724  4599 consensus_queue.cc:237] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.403527  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.404270  4466 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:24.405532  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.406143  4466 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:24.412531  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.413833  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.414925  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.415040  3812 raft_consensus.cc:1240] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.424557  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.426559  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.427217  4452 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:24.428112  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.428285  4463 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.429207  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.429273  4537 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.429829  4452 raft_consensus.cc:2468] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:24.430727  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.431260  4452 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:24.431583  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.432086  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.432327  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.432780  4459 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:24.432965  4452 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:24.433164  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.433840  4441 raft_consensus.cc:2468] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:24.434388  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.435034  4427 raft_consensus.cc:2468] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:24.437284  4537 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.437956  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.438158  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.438776  4356 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:24.441007  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.432265  4466 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:24.444038  3803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.377760  4670 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.453505  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.454432  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.456207  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.457161  3732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:24.458760  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:24.459554  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:24.459672  4653 consensus_queue.cc:1059] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.460772  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:24.462391  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.463981  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:24.466502  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:24.468317  3658 raft_consensus.cc:1240] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.433725  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.472661  3662 raft_consensus.cc:1240] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.473254  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:24.474507  3702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.485442  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:24.513267  3702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.491888  4630 raft_consensus.cc:2804] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.487358  4422 raft_consensus.cc:2468] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
W20260709 12:26:24.488688  4356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 50002.4us
I20260709 12:26:24.520731  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.487799  4669 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.499701  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.527251  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.527758  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.528934  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.524065  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.530027  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.530493  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.521368  3735 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:24.523108  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.516386  4630 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.531873  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.531973  4652 consensus_queue.cc:1059] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.532939  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.533495  4652 raft_consensus.cc:3055] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.533694  3656 raft_consensus.cc:1240] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.533932  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.523123  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.535647  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.523957  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.523962  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.537076  4652 raft_consensus.cc:740] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:24.524995  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.525332  4670 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.525835  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.535658  3627 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.526244  3803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.526397  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.536806  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.531080  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.531136  3731 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:24.540947  3737 raft_consensus.cc:2468] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.546322  3738 raft_consensus.cc:2393] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:24.539245  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.536937  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.528620  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:24.538812  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.538936  4630 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.549192  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.551404  3809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.551677  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.552696  3730 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.556192  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.557647  3627 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:24.557922  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.562000  3627 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:24.564064  3627 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:24.565650  3627 leader_election.cc:304] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:24.565840  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.555330  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.566578  3735 raft_consensus.cc:2468] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.566900  4647 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.567327  4647 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.567692  4647 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.567637  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.567327  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.569389  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.569988  3735 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:24.571796  4600 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.572227  4600 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.572589  4600 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.575245  3732 raft_consensus.cc:2468] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:24.579619  4638 raft_consensus.cc:2749] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:24.544100  4356 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:24.581197  3627 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.566627  4597 raft_consensus.cc:2804] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.579922  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.568356  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.588549  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.584133  4597 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.589797  4597 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.590070  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.585559  4606 raft_consensus.cc:2804] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.590922  4606 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.591270  4606 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.588605  4670 raft_consensus.cc:2804] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.592331  4670 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.592679  4670 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.596330  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.578672  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.549362  4652 consensus_queue.cc:260] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.610374  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.610509  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.614998  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.615473  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.616653  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.590444  3736 raft_consensus.cc:2468] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
W20260709 12:26:24.598399  4356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 58074.8us
I20260709 12:26:24.625923  4674 raft_consensus.cc:2804] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.611634  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.614305  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfc6756ea0e486d869252fd8f102411" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:24.633587  4679 log.cc:927] Time spent T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:26:24.611750  4357 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:24.641183  4652 raft_consensus.cc:3060] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.635545  4674 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
W20260709 12:26:24.643276  4678 log.cc:927] Time spent T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:26:24.642952  4669 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:24.648296  4674 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.639210  4356 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:24.649165  4643 raft_consensus.cc:2804] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.649883  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
W20260709 12:26:24.652489  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 49236.2us
I20260709 12:26:24.672333  4669 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.673002  4669 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.657120  4643 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:24.676908  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.677516  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.678754  4643 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.686141  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01be9c8eac8b49f581ef991385b23996" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.674055  4676 raft_consensus.cc:2804] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.680858  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.679668  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.679674  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.686981  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac829ea617614c26806da188940d398d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.687008  4537 raft_consensus.cc:3055] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.697906  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.698336  3664 raft_consensus.cc:1240] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.700047  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a16122c42b40248f485b77753956bc" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.704623  3735 raft_consensus.cc:2393] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 2: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:24.688413  4676 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.681463  4356 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:24.700178  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.687503  4357 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.711251  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f6c49b7c4db4f3fa1f03c887186ee66" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.701035  4537 raft_consensus.cc:740] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:24.700258  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52a9fcd5d784adaa61ed8592e34820a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
W20260709 12:26:24.710112  4682 log.cc:927] Time spent T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:26:24.692005  4647 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.714922  4673 raft_consensus.cc:2804] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.707564  4676 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.718358  4618 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.718878  4618 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.719077  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.719664  4618 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.717234  4673 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.721410  4673 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.718421  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.725442  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.725437  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:24.726711  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.729326  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.730338  4606 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.715101  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.736166  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.742693  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.717257  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.750425  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3317f960c9084fd08c81267ec5ea37d6" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.719380  4356 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.748354  4459 raft_consensus.cc:2468] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.750443  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.755964  3733 raft_consensus.cc:2393] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 2: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:24.757002  4643 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.760488  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.722728  4537 consensus_queue.cc:260] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.769454  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.792464  4537 raft_consensus.cc:3060] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.797900  3658 raft_consensus.cc:1275] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.769982  3730 raft_consensus.cc:1240] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.801919  3778 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.770069  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13f07f4920e4b38816a3a22b807b9c2" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.806231  4614 raft_consensus.cc:2804] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.770654  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:24.770654  3811 raft_consensus.cc:1240] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.806624  4614 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.807085  4614 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.771090  3808 raft_consensus.cc:1240] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.773244  4643 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.777094  3734 raft_consensus.cc:2468] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:24.808702  4639 consensus_queue.cc:1059] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.777886  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.809401  4639 consensus_queue.cc:1243] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer 3c78ef175c2d468993c1cb82527bef05 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:26:24.789752  4599 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.790864  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a18a9b9a99d401eba8bd3955ea7dbb1" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.803862  4585 consensus_queue.cc:1048] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:24.812140  4652 raft_consensus.cc:3055] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.812551  4652 raft_consensus.cc:740] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:24.813308  4652 consensus_queue.cc:260] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.769606  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.814407  4652 raft_consensus.cc:3060] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.731693  4630 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.765811  4466 raft_consensus.cc:2468] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.810464  4643 raft_consensus.cc:2749] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:24.817155  4630 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.822170  3778 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.750172  4357 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.825134  4621 raft_consensus.cc:2804] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.827536  4621 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.827939  4621 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.828027  3658 raft_consensus.cc:1275] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.829064  4673 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.777172  3484 catalog_manager.cc:5697] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 2, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.831027  4673 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.830601  3484 catalog_manager.cc:5697] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 2, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.832600  4606 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.833917  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.835423  3484 catalog_manager.cc:5697] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 2, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.839370  3778 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.841163  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.841416  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07c0d79152646f8aea06f98ab72cc07" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.842492  4599 consensus_queue.cc:1048] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:24.843863  4356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 124562us
I20260709 12:26:24.844125  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.844898  4597 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.845314  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:24.845117  4600 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.847002  4597 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.848356  4614 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.849936  4618 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.850296  4614 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.850906  4637 raft_consensus.cc:2804] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.839929  4673 raft_consensus.cc:2804] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.851559  4673 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.851960  4673 raft_consensus.cc:3060] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.847054  4600 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.852506  4356 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:24.845712  3735 raft_consensus.cc:1240] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.855274  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.855921  4466 raft_consensus.cc:2468] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.857612  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44d49c090caa4686add867d8afd82314" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.858201  4685 raft_consensus.cc:2804] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.851332  4637 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:24.859023  4637 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.859411  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.859890  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.860062  4459 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.860508  4466 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 1.
I20260709 12:26:24.844141  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:24.864617  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546aeeaf20fb480bb5956ba5dc611e07" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.874457  3659 raft_consensus.cc:1275] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.768631  4669 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.877774  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.882877  3778 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.826082  4674 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.887709  3703 leader_election.cc:304] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.889461  3630 leader_election.cc:304] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
W20260709 12:26:24.941540  3630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 52149us
I20260709 12:26:24.942672  3630 leader_election.cc:304] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:24.886160  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.877316  4685 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
W20260709 12:26:24.835225  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 91290.2us
I20260709 12:26:24.894377  4647 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:24.885520  4629 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.944548  4600 raft_consensus.cc:2749] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:24.944567  4685 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.946888  4652 raft_consensus.cc:2749] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:24.890204  4618 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.890326  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:24.895694  4673 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:24.947757  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 60094.2us
I20260709 12:26:24.948103  4357 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.948354  4462 raft_consensus.cc:1240] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.949396  4673 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.949965  4673 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.950289  4673 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.950646  4673 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.951121  4357 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.951428  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.897130  4637 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.909904  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.897691  3737 raft_consensus.cc:2468] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:24.952956  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.953594  4637 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.913928  4674 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.951977  4643 raft_consensus.cc:2804] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.917094  3659 raft_consensus.cc:1240] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 3c78ef175c2d468993c1cb82527bef05 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.901549  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.901856  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.954555  4643 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.953032  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d2f3e3f0a4ae7ba1f73aec0f49a2d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.902413  4437 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.954975  4643 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.956166  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.957007  4673 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:24.957324  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e54ed26c20349f49856c2fcbc57dfdd" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.958442  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.958981  4673 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.959450  4466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.898340  4621 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:24.902583  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ddc19e80d1e47bf9adba05e63b9c08f" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
W20260709 12:26:24.924494  3701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.961251  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.955428  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03376bd538eb41c399158480df7d762a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.903528  4445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.925345  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:24.925544  3663 raft_consensus.cc:1240] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:24.905717  3657 raft_consensus.cc:1275] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.906927  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.906831  4670 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.966470  4670 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.907490  4463 raft_consensus.cc:1240] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:24.905524  3811 raft_consensus.cc:1240] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.927523  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:24.928036  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:24.928721  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:24.970162  4597 raft_consensus.cc:2749] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:24.970880  4637 consensus_queue.cc:1048] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.905762  4676 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:24.934021  3662 raft_consensus.cc:1275] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.955368  4357 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:24.973771  4357 leader_election.cc:304] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.974015  4676 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:24.974366  4670 raft_consensus.cc:2804] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.974798  4670 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:24.975143  4670 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.978083  4621 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:24.980700  4637 consensus_queue.cc:1048] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.954061  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4576aeb4fdf46b0ab7c91d7b4389291" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.985194  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:24.986368  4676 raft_consensus.cc:2749] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:24.987861  3703 leader_election.cc:304] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.989168  3703 leader_election.cc:304] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.990154  3703 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.883494  4614 consensus_queue.cc:1048] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:26:24.944042  3630 leader_election.cc:304] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
W20260709 12:26:25.000838  3630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 56873.4us
I20260709 12:26:24.961331  4629 raft_consensus.cc:2749] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.001878  4597 raft_consensus.cc:2749] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.001922  3630 leader_election.cc:304] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:24.902889  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:24.968921  4605 consensus_queue.cc:1059] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.003803  3630 leader_election.cc:304] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.015069  3703 leader_election.cc:304] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.017072  3703 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.018359  3703 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:24.967562  4685 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:25.022413  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 81463.2us
I20260709 12:26:25.022558  3630 leader_election.cc:304] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.024617  3811 raft_consensus.cc:1240] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.025194  3630 leader_election.cc:304] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:25.024573  3775 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.005141  4653 raft_consensus.cc:2749] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.030232  3630 leader_election.cc:304] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.030815  3775 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.011974  4537 raft_consensus.cc:2749] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:24.987489  4652 consensus_queue.cc:1059] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:26:25.007068  4669 raft_consensus.cc:2749] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.037250  3703 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.022776  4662 raft_consensus.cc:2749] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.046168  3775 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.020777  4668 raft_consensus.cc:2749] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.019263  4597 raft_consensus.cc:2749] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.029397  4615 raft_consensus.cc:2749] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:25.020145  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 46464.1us
I20260709 12:26:25.026921  4550 raft_consensus.cc:2749] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.025751  4647 raft_consensus.cc:2749] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.029294  3807 raft_consensus.cc:1240] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.051180  3808 raft_consensus.cc:1240] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.053320  4643 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.031790  4638 raft_consensus.cc:2764] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:25.044523  4605 raft_consensus.cc:2749] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.042519  4606 consensus_queue.cc:1059] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:26:25.065063  4685 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:25.058444  4537 raft_consensus.cc:2749] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.055912  4607 raft_consensus.cc:2804] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.079898  4607 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.080333  4607 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.083997  4466 raft_consensus.cc:1240] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.094669  4633 raft_consensus.cc:2749] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:25.096459  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 50347us
I20260709 12:26:25.097600  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:25.061228  4629 raft_consensus.cc:2749] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.104430  3775 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.105541  4637 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.107004  3775 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.108248  3775 leader_election.cc:304] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.109159  4624 raft_consensus.cc:2749] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.109495  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:25.112121  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:25.112792  3811 raft_consensus.cc:1240] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.113466  4643 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.114008  4621 raft_consensus.cc:3055] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.114444  4621 raft_consensus.cc:740] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:25.114897  4695 raft_consensus.cc:2749] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.114727  4670 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.114749  3775 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.121068  3775 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.111979  4638 raft_consensus.cc:3055] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:26:25.160645  3701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 114007us
I20260709 12:26:25.121973  4605 raft_consensus.cc:2749] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:25.160017  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 43966.5us
I20260709 12:26:25.185074  4357 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.186548  4357 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:25.187901  4643 raft_consensus.cc:2749] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.189980  4670 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.162145  4638 raft_consensus.cc:740] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.191013  4638 consensus_queue.cc:260] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:25.192165  4638 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.188006  4685 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.194262  4685 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.194636  4685 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.195073  3663 raft_consensus.cc:1240] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Rejecting Update request from peer 3c78ef175c2d468993c1cb82527bef05 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.197436  4358 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.199142  4358 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.187440  4357 leader_election.cc:304] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.203933  4643 raft_consensus.cc:2804] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.204308  4643 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:25.204668  4643 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:25.205677  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 84694.6us
I20260709 12:26:25.206427  3775 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.206647  4614 raft_consensus.cc:2749] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.115330  4621 consensus_queue.cc:260] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:25.211798  4673 raft_consensus.cc:2749] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.214715  4629 consensus_queue.cc:1059] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.220007  3775 leader_election.cc:304] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.218827  4597 consensus_queue.cc:1059] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:25.220379  4668 raft_consensus.cc:3055] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.222311  4668 raft_consensus.cc:740] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.223222  4621 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.223063  4668 consensus_queue.cc:260] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:25.224071  4668 raft_consensus.cc:3060] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.224390  4615 raft_consensus.cc:3055] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.224820  4615 raft_consensus.cc:740] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.225646  4615 consensus_queue.cc:260] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:25.229503  4614 raft_consensus.cc:2749] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.209352  4670 raft_consensus.cc:2749] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.235209  3775 leader_election.cc:304] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:25.243986  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 206778us
I20260709 12:26:25.247519  4633 consensus_queue.cc:1059] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.248648  4632 raft_consensus.cc:3055] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.248994  4632 raft_consensus.cc:740] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.249146  3775 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.249720  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:25.250337  3775 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.250515  4629 raft_consensus.cc:2749] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.214862  4600 consensus_queue.cc:1059] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:26:25.251056  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:25.244442  4605 raft_consensus.cc:2804] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.251279  4593 raft_consensus.cc:2804] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.252768  4605 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.253042  4593 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.253485  4593 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.255467  3630 leader_election.cc:304] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:25.256929  3658 raft_consensus.cc:1240] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Rejecting Update request from peer 3c78ef175c2d468993c1cb82527bef05 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:25.233197  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 45830.3us
I20260709 12:26:25.238878  4624 raft_consensus.cc:3055] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.259920  3775 leader_election.cc:304] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.262228  3663 raft_consensus.cc:1240] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.262256  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.249781  4632 consensus_queue.cc:260] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:25.265210  4632 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.266993  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aa1145b1384ae3a8fa929b5bbcfc19" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:25.253168  4605 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.268011  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.269773  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:25.269980  3732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:25.258951  4606 raft_consensus.cc:2764] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:25.273602  3658 raft_consensus.cc:1240] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.272394  4637 raft_consensus.cc:2804] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.261355  4624 raft_consensus.cc:740] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:25.274868  4692 consensus_queue.cc:1059] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.277418  3775 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.279340  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.274632  4637 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.282510  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.279316  4629 raft_consensus.cc:2749] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.283102  3734 raft_consensus.cc:1275] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.274996  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:25.245658  4607 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.284245  4358 leader_election.cc:304] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.284976  4692 raft_consensus.cc:3055] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.294577  4692 raft_consensus.cc:740] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:25.295128  4358 leader_election.cc:304] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.288385  4637 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.295367  4692 consensus_queue.cc:260] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:25.295940  4673 raft_consensus.cc:2749] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.296308  4358 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.296536  4673 raft_consensus.cc:2749] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.296653  4692 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.274587  4643 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.285718  4615 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.298417  3778 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.285221  3732 raft_consensus.cc:1275] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.292538  3738 raft_consensus.cc:1275] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.300562  4670 raft_consensus.cc:2804] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.300930  4670 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:25.301251  4629 raft_consensus.cc:2749] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.292611  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.301688  4624 consensus_queue.cc:260] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:25.302906  4624 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.301265  4670 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.293474  4650 raft_consensus.cc:3055] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.304900  4650 raft_consensus.cc:740] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.305756  4650 consensus_queue.cc:260] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:25.296491  3730 raft_consensus.cc:2393] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:25.284945  3733 raft_consensus.cc:1275] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.312067  4358 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.312405  3731 raft_consensus.cc:1275] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:25.271255  4633 consensus_queue.cc:1175] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98dcd37d8895403d96ceb94f8c67412a" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:25.316725  4673 raft_consensus.cc:2749] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.317428  4537 consensus_queue.cc:1059] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.317718  4357 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.318353  4652 raft_consensus.cc:3055] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.318462  4673 raft_consensus.cc:2749] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.318751  4652 raft_consensus.cc:740] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.319738  4652 consensus_queue.cc:260] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.279661  4698 consensus_queue.cc:1059] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:26:25.322072  4537 raft_consensus.cc:3055] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.322415  4537 raft_consensus.cc:740] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.323168  4537 consensus_queue.cc:260] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.324324  4537 raft_consensus.cc:3060] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:25.336272  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 58858.6us
I20260709 12:26:25.337884  3775 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.340961  4629 raft_consensus.cc:2804] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.343292  4629 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.343698  4629 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.349059  3736 raft_consensus.cc:1275] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.342761  4621 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.351014  4621 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.351212  4643 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.351401  4621 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.352643  4685 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.354012  4357 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.354660  4685 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.355399  4357 leader_election.cc:304] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.356252  4673 raft_consensus.cc:2749] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.356671  4357 leader_election.cc:304] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.357419  4673 raft_consensus.cc:2749] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.338562  4650 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.338922  4652 raft_consensus.cc:3060] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.457868  4696 consensus_queue.cc:1048] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.336290  4607 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:25.336063  4593 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.460203  4593 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:25.460959  3778 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.455072  4695 consensus_queue.cc:1048] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.355240  4685 raft_consensus.cc:2749] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.456943  4599 consensus_queue.cc:1048] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.457156  4670 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.469646  4637 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.466063  3627 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.469992  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.474208  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.504988  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.475147  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.476054  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.478825  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.479480  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.480127  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.480386  4629 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:25.480792  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.481544  4605 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.482079  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.483366  4696 raft_consensus.cc:2749] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.483887  3778 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.515196  4692 raft_consensus.cc:2749] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.515645  4695 consensus_queue.cc:1048] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.518003  4696 consensus_queue.cc:1048] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.519754  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.522845  4637 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:25.523132  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.506484  4633 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.524495  4633 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.524848  4633 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.484272  4358 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.484364  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.342128  3775 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.496896  4621 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:25.527794  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 158831us
I20260709 12:26:25.510334  4629 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.494207  4670 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.529671  4358 leader_election.cc:304] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.529814  4670 raft_consensus.cc:2749] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.481668  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.503470  3627 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.530500  4621 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:25.531440  3627 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.532523  3627 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.533196  4606 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.533557  4606 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.533965  3627 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
W20260709 12:26:25.533831  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 191797us
I20260709 12:26:25.533900  4606 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.540191  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.534116  4642 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.553922  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.534188  4674 raft_consensus.cc:2804] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.541065  4629 raft_consensus.cc:2749] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.549543  4643 raft_consensus.cc:2749] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.552567  4638 raft_consensus.cc:2804] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.542083  4624 consensus_queue.cc:1048] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:26:25.554762  4642 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.561483  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.561338  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.561205  4674 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.569700  4638 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.580704  4638 raft_consensus.cc:3060] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.582454  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:25.584965  4463 raft_consensus.cc:1240] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.585968  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:25.586674  4463 raft_consensus.cc:2393] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 3: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:25.587374  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:25.588312  4459 raft_consensus.cc:1240] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.572500  4358 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.588946  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:25.589679  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:25.590567  4441 raft_consensus.cc:1240] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.591116  4357 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.592568  4427 raft_consensus.cc:1240] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.574415  4437 raft_consensus.cc:1240] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.579758  4674 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:25.606369  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 61100.6us
I20260709 12:26:25.574047  4642 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.610265  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
W20260709 12:26:25.611034  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 43575.7us
I20260709 12:26:25.611990  4605 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:25.623211  3703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.624671  4358 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:25.609565  4643 raft_consensus.cc:2804] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.629961  3482 catalog_manager.cc:5697] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 2, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } }
I20260709 12:26:25.648108  3627 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.648669  4358 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.650040  4615 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.650373  4358 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:25.651676  3701 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.9.1:37069 timed out after 1.546s (SENT) [suppressed 260 similar messages]
I20260709 12:26:25.652267  4676 raft_consensus.cc:2804] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.652638  4676 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:25.653173  4615 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:25.653575  4615 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.652987  4676 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.659144  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.651878  4673 raft_consensus.cc:2749] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.632550  3732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.649919  3627 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.631438  4685 raft_consensus.cc:2749] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.636551  4643 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:25.641288  4670 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.672013  3482 catalog_manager.cc:5697] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 2, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } }
W20260709 12:26:25.639006  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 52772.4us
I20260709 12:26:25.678705  4357 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:25.684082  3628 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 83268.9us
I20260709 12:26:25.689106  3808 raft_consensus.cc:1240] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.684340  3811 raft_consensus.cc:1240] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.672363  4650 raft_consensus.cc:2749] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.680377  4643 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.684913  4685 raft_consensus.cc:2749] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.680593  4670 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:25.709367  3807 raft_consensus.cc:1240] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.684604  4358 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.700711  4537 consensus_queue.cc:1059] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:26:25.711136  4670 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.710206  4704 consensus_queue.cc:1059] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:26:25.720199  3804 raft_consensus.cc:1240] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.712563  4674 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:25.727809  4710 log.cc:927] Time spent T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:26:25.722680  3656 raft_consensus.cc:1275] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:25.716907  4357 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.728484  4685 raft_consensus.cc:2804] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.731026  4698 raft_consensus.cc:3055] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.747426  4698 raft_consensus.cc:740] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.748927  4633 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.762694  3660 raft_consensus.cc:1240] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.736304  4537 consensus_queue.cc:1059] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:26:25.808605  3803 raft_consensus.cc:1240] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.809877  4703 consensus_queue.cc:1059] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:25.738328  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 61036us
I20260709 12:26:25.746070  4685 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
W20260709 12:26:25.820214  3628 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 135475us
I20260709 12:26:25.791917  4673 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.809928  3805 raft_consensus.cc:1240] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.829392  4685 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.823184  4633 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.823634  3662 raft_consensus.cc:1240] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.824813  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.831228  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.832952  4674 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.824762  4537 raft_consensus.cc:3055] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.833510  4537 raft_consensus.cc:740] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.825752  4358 leader_election.cc:304] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.826871  4676 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.834416  4537 consensus_queue.cc:260] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.851423  4704 consensus_queue.cc:1059] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.836463  4676 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.854206  4676 raft_consensus.cc:2749] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.841862  4685 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.845013  4652 raft_consensus.cc:3055] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.819096  4606 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.847137  4668 consensus_queue.cc:1059] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.852386  4537 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.827510  4642 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.853240  4615 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:25.816708  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 105950us
I20260709 12:26:25.854928  4652 raft_consensus.cc:740] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.856297  4685 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.855348  3664 raft_consensus.cc:1240] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:25.854454  4704 consensus_queue.cc:1059] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:25.867262  4652 consensus_queue.cc:260] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.864037  3657 raft_consensus.cc:1240] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.864517  4357 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:25.876947  4724 log.cc:927] Time spent T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:26:25.877249  4685 raft_consensus.cc:2749] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.877707  4357 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.878736  4685 raft_consensus.cc:2749] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.879993  4606 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.860816  4642 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.872629  4652 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.884773  4643 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.878916  4357 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.885861  4685 raft_consensus.cc:2749] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.886766  4357 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.887565  4685 raft_consensus.cc:2749] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.889289  4698 consensus_queue.cc:260] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.864849  4615 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.865139  4638 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.860246  4670 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:25.899269  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 75437.7us
I20260709 12:26:25.896154  4698 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:25.901646  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 57247.8us
I20260709 12:26:25.886749  4643 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.904800  4729 raft_consensus.cc:3055] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.899034  4727 raft_consensus.cc:3055] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:26:25.897966  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 72300.5us
I20260709 12:26:25.914500  3627 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.910331  3655 raft_consensus.cc:1240] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.915328  4606 consensus_queue.cc:1059] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.929320  4638 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:25.929646  4606 raft_consensus.cc:3055] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.930049  4606 raft_consensus.cc:740] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.930142  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.930380  4732 consensus_queue.cc:1059] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.930912  4606 consensus_queue.cc:260] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:25.930173  4358 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.932226  4643 raft_consensus.cc:2749] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.933313  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:25.933506  4358 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.916143  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.934299  4643 raft_consensus.cc:2749] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.912802  4629 consensus_queue.cc:1048] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:26:25.905460  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:25.923870  4703 raft_consensus.cc:3055] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.925029  4662 raft_consensus.cc:3055] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.936070  4662 raft_consensus.cc:740] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.936712  4358 leader_election.cc:304] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.936928  4662 consensus_queue.cc:260] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.937469  4643 raft_consensus.cc:2749] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.938094  4662 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.938861  4358 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.939615  4643 raft_consensus.cc:2749] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.940225  4703 raft_consensus.cc:740] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.940716  4358 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.907454  4727 raft_consensus.cc:740] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.941423  4643 raft_consensus.cc:2749] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.941931  4727 consensus_queue.cc:260] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.942898  4358 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.943121  4727 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.943702  4643 raft_consensus.cc:2749] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.945971  4606 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.933656  4668 consensus_queue.cc:1059] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:26:25.948529  4704 raft_consensus.cc:3055] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:25.948920  4704 raft_consensus.cc:740] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.949057  4615 raft_consensus.cc:2749] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.949311  4358 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.950057  4643 raft_consensus.cc:2749] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.949843  4704 consensus_queue.cc:260] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.905542  4729 raft_consensus.cc:740] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.951330  4729 consensus_queue.cc:260] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:25.951695  4358 leader_election.cc:304] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.952483  4643 raft_consensus.cc:2749] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.943042  4537 raft_consensus.cc:3055] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.948638  4670 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:25.952503  4729 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.948553  4703 consensus_queue.cc:260] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:25.957332  4703 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.953246  4537 raft_consensus.cc:740] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.962024  3487 catalog_manager.cc:5697] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 2 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } }
I20260709 12:26:25.956187  4358 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:25.963192  4537 consensus_queue.cc:260] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:25.964672  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.969126  4670 raft_consensus.cc:2749] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.965312  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
W20260709 12:26:25.970148  3704 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.955652  3627 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.971588  3701 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:25.972126  4437 raft_consensus.cc:1240] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.968650  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:25.984897  4427 raft_consensus.cc:1240] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.973263  3627 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.973773  4437 raft_consensus.cc:1240] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.986210  4632 raft_consensus.cc:2749] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.972673  3701 leader_election.cc:304] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.986881  3627 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.987048  4632 consensus_queue.cc:1059] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.987579  3701 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.987890  4633 raft_consensus.cc:2749] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.980281  4638 consensus_queue.cc:1059] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:26:25.988442  4730 raft_consensus.cc:2749] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.989063  4632 raft_consensus.cc:3055] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.989409  4632 raft_consensus.cc:740] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.974035  4674 consensus_queue.cc:1059] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:25.990121  4632 consensus_queue.cc:260] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:25.991075  4674 raft_consensus.cc:3055] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.991398  4730 raft_consensus.cc:2749] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.991971  4633 raft_consensus.cc:3055] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.992349  4633 raft_consensus.cc:740] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.992755  3701 leader_election.cc:304] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:25.991436  4632 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.993072  4633 consensus_queue.cc:260] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:25.985114  4727 raft_consensus.cc:2749] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.994354  4633 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.994874  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:25.991446  4674 raft_consensus.cc:740] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.973827  4735 raft_consensus.cc:2749] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:25.979209  4662 consensus_queue.cc:1059] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:25.996754  4730 raft_consensus.cc:2749] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:25.973860  4615 consensus_queue.cc:1059] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:26:25.996855  4674 consensus_queue.cc:260] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:25.997790  4615 raft_consensus.cc:3055] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.998241  4615 raft_consensus.cc:740] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:25.999434  4615 consensus_queue.cc:260] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.000721  4615 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.001543  4729 raft_consensus.cc:3055] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.002753  4729 raft_consensus.cc:740] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:25.999709  4674 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.004662  3701 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.005832  3701 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.007107  3701 leader_election.cc:304] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.006373  4652 raft_consensus.cc:2749] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.013814  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
W20260709 12:26:26.014258  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 113269us
I20260709 12:26:26.015133  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.015758  4537 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.007215  4730 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:26.008711  4452 raft_consensus.cc:1240] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:26.009081  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.009765  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.020866  4734 raft_consensus.cc:2749] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.022702  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.003597  4729 consensus_queue.cc:260] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.015904  4422 raft_consensus.cc:2393] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 4: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:26.026582  4729 raft_consensus.cc:3060] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:26.028179  3703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 118251us
I20260709 12:26:26.031185  4704 raft_consensus.cc:3060] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.033215  3701 leader_election.cc:304] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.031080  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.036391  4730 consensus_queue.cc:1059] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.037338  4730 raft_consensus.cc:3055] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:26.037621  4730 raft_consensus.cc:740] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:26.038302  4730 consensus_queue.cc:260] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.039367  4730 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.039150  4633 consensus_queue.cc:1059] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.044730  3701 leader_election.cc:304] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.046365  3701 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.047539  4732 consensus_queue.cc:1059] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.054577  3664 raft_consensus.cc:1240] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:26.050376  4734 raft_consensus.cc:2749] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.056725  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.057268  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f7ac680c52440fbb826622012945b7" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.057624  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfe10809994448c8380df975eff45a9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.059101  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c7c476412c475ea0783cadfd0ce30c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.044698  4668 raft_consensus.cc:2749] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.064603  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.065205  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.074918  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.075706  4459 raft_consensus.cc:1240] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Rejecting Update request from peer 3c78ef175c2d468993c1cb82527bef05 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:26.076217  4638 consensus_queue.cc:1059] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.067050  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.079669  3734 raft_consensus.cc:2468] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:26.081317  4726 raft_consensus.cc:3055] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.081698  4726 raft_consensus.cc:740] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.082432  4726 consensus_queue.cc:260] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.083900  4714 consensus_queue.cc:1059] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.086247  4714 raft_consensus.cc:3055] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.086562  4714 raft_consensus.cc:740] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.088913  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.087275  4714 consensus_queue.cc:260] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.089717  4459 raft_consensus.cc:2393] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:26.083575  4726 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.092296  3738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.093396  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.094993  3732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.095629  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.095842  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17a4df1bf1a4a6192febd99cd97d5bb" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.096139  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.052084  4652 raft_consensus.cc:2749] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.097640  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.100756  3736 raft_consensus.cc:2468] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 4.
I20260709 12:26:26.101416  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.105500  4437 raft_consensus.cc:1240] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:26.105912  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96dca18b7eac43e78683c65edac5c3bc" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
W20260709 12:26:26.107504  3701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.091284  3627 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.110483  3627 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.113008  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.090204  4714 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.115579  3627 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.118688  4597 consensus_queue.cc:1059] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.119648  4642 raft_consensus.cc:3055] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.120042  4642 raft_consensus.cc:740] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.121047  4463 raft_consensus.cc:2393] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:26.120814  4642 consensus_queue.cc:260] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.111976  4633 raft_consensus.cc:2749] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.119261  4452 raft_consensus.cc:1240] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Rejecting Update request from peer 98dcd37d8895403d96ceb94f8c67412a for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:26.140049  4638 raft_consensus.cc:2749] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:26.152277  3730 raft_consensus.cc:2468] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:26.113665  4632 raft_consensus.cc:2749] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.192394  3734 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:26.166110  4704 raft_consensus.cc:3055] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:26.193138  4704 raft_consensus.cc:740] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
W20260709 12:26:26.184413  3703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.188151  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.189139  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f54877140907478b8976ce4a6698da2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.190760  3775 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.195247  4605 raft_consensus.cc:2749] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.195683  3775 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.191486  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.196447  4605 raft_consensus.cc:2749] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.197275  3775 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.197568  4358 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.197953  4605 raft_consensus.cc:2749] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.198376  3775 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.198516  4670 raft_consensus.cc:2749] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.199049  4605 raft_consensus.cc:2749] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.200086  4358 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.200933  4670 raft_consensus.cc:2804] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.201381  4670 raft_consensus.cc:697] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:26.202152  4670 consensus_queue.cc:237] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.203116  4463 raft_consensus.cc:2393] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:26.147740  4674 raft_consensus.cc:3055] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.204118  4674 raft_consensus.cc:740] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.205117  4358 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.205020  4674 consensus_queue.cc:260] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.206182  4715 consensus_queue.cc:1059] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.206897  4643 raft_consensus.cc:2749] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.207643  4605 raft_consensus.cc:3055] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:26:26.208055  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 92544.6us
I20260709 12:26:26.208026  4605 raft_consensus.cc:740] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:26.206525  4674 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.208385  4358 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:26.209327  3775 leader_election.cc:304] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.209072  4605 consensus_queue.cc:260] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:26.210139  3627 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.210240  4605 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.211231  3627 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.211896  4713 raft_consensus.cc:2749] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:26.212461  4713 raft_consensus.cc:2749] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.214390  3701 leader_election.cc:304] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.215179  4537 raft_consensus.cc:2749] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.193015  3733 raft_consensus.cc:2468] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:26.218307  4643 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:26.219441  4358 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.221972  4643 raft_consensus.cc:2749] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.223199  4358 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.224895  3701 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.228812  3627 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.230347  3775 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.230297  4358 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.230700  4537 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.204013  4642 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.232517  4629 raft_consensus.cc:2749] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.230669  4643 raft_consensus.cc:2749] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.237684  4358 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.238565  4731 raft_consensus.cc:2749] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.232846  4719 raft_consensus.cc:2749] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.241869  4358 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.234910  4713 raft_consensus.cc:2749] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.242079  4685 raft_consensus.cc:2804] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:26.236819  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cdf8ac45ef43ee978cae31e085a9c3" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.244702  4673 raft_consensus.cc:2804] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.245797  4463 raft_consensus.cc:1240] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:26.246119  4441 raft_consensus.cc:1240] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:26.244522  4358 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.250500  4673 raft_consensus.cc:697] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:26.194119  4704 consensus_queue.cc:260] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.254338  4643 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.254806  4643 raft_consensus.cc:697] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:26.251595  4685 raft_consensus.cc:697] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 4 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:26.255553  4643 consensus_queue.cc:237] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.255751  4685 consensus_queue.cc:237] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.259395  4673 consensus_queue.cc:237] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.267561  4704 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.259366  4537 raft_consensus.cc:2749] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.271736  4713 consensus_queue.cc:1059] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.276780  4358 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.278617  4713 raft_consensus.cc:3055] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.279028  4713 raft_consensus.cc:740] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.279254  4731 raft_consensus.cc:2804] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:26.279820  4731 raft_consensus.cc:697] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 2 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:26.280648  4731 consensus_queue.cc:237] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.278954  3701 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.283464  3701 leader_election.cc:304] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:26.284044  4537 raft_consensus.cc:2749] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.284590  3701 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.285319  4652 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.284792  4537 raft_consensus.cc:2749] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.279978  4713 consensus_queue.cc:260] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.287242  3701 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:26.292100  4729 raft_consensus.cc:2749] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.306435  3487 catalog_manager.cc:5697] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 2 to 3, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.308187  4652 raft_consensus.cc:2749] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.309557  4713 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.343353  3487 catalog_manager.cc:5697] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 2 to 3, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.345178  3487 catalog_manager.cc:5697] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 1 to 2, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 2 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.346877  3487 catalog_manager.cc:5697] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 3 to 4, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 4 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.348316  3487 catalog_manager.cc:5697] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 2 to 3, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.400054  4718 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.400584  4718 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.401738  4713 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.402264  4713 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.404832  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:26.407539  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:26.408140  3807 raft_consensus.cc:2468] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:26.408291  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.409025  4427 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:26.410229  3775 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:26.411409  3628 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:26.412367  4642 raft_consensus.cc:2804] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:26.412707  4642 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.413008  4642 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.418324  4585 raft_consensus.cc:2804] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:26.418730  4585 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.419049  4585 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.435253  4713 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.435446  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:26.456010  3655 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:26.441836  4718 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:26.440032  4642 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.458220  4642 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.459463  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.461601  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:26.462836  3807 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.467667  4585 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.469774  3807 raft_consensus.cc:2468] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:26.470445  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.472185  4427 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.471074  3628 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:26.476251  4642 raft_consensus.cc:2804] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.476711  4642 raft_consensus.cc:697] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.477494  4642 consensus_queue.cc:237] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.478349  4726 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.478807  4726 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.481812  4726 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.482832  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:26.483460  3733 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:26.485357  3630 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.487653  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:26.488304  3807 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:26.487655  4713 raft_consensus.cc:2804] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:26.489147  4713 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.489640  4713 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.505808  4427 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 3.
I20260709 12:26:26.509536  4459 raft_consensus.cc:1240] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Rejecting Update request from peer ea17b2b4fe5a4a33b586dd908fd673ce for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:26.512195  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:26.523805  3655 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.525921  4726 consensus_queue.cc:1059] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.529382  4674 raft_consensus.cc:3055] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.529793  4674 raft_consensus.cc:740] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.530550  4674 consensus_queue.cc:260] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:26.531810  3655 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 3.
I20260709 12:26:26.531589  4674 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.540688  3777 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.541522  4715 raft_consensus.cc:2804] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.542215  4715 raft_consensus.cc:697] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:26.543071  4715 consensus_queue.cc:237] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.521143  4585 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:26.560026  4713 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.563455  3487 catalog_manager.cc:5697] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.566795  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.567377  3733 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.568039  4713 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.568864  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:26.569475  3807 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.569741  4718 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.570214  4718 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.573055  4718 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:26.573982  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:26.574461  3733 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:26.575664  3484 catalog_manager.cc:5697] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.576857  3655 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 3.
I20260709 12:26:26.578114  3777 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.575901  3807 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:26.580801  3628 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.581423  4713 raft_consensus.cc:2804] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.582105  4713 raft_consensus.cc:697] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.583390  4642 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.584028  4642 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.585978  4642 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.582970  4719 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:26.586601  4719 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.586926  4719 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.587242  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:26.589998  3807 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:26.587985  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:26.592244  3733 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:26.594679  3628 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.574373  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.596452  4642 raft_consensus.cc:2804] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:26.596676  4427 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:26.596823  4642 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.601306  4642 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.582942  4713 consensus_queue.cc:237] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.611899  4642 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.607620  4719 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.614852  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.615358  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.616025  4427 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.616179  4642 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.618818  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:26.622442  3807 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.625458  4719 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:26.626397  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:26.627018  3655 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.630753  4427 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 4.
I20260709 12:26:26.632203  3775 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:26.633284  4719 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:26.634709  4719 raft_consensus.cc:697] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:26.636861  3655 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 4.
I20260709 12:26:26.637292  4719 consensus_queue.cc:237] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.615427  3733 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.648820  3733 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:26.652508  3807 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:26.654660  3630 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.655886  3733 raft_consensus.cc:1275] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:26.657358  4685 consensus_queue.cc:1048] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:26:26.660037  3487 catalog_manager.cc:5697] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.656811  4642 raft_consensus.cc:2804] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.674188  4642 raft_consensus.cc:697] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:26.675086  4642 consensus_queue.cc:237] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.694897  3655 raft_consensus.cc:1275] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:26.697808  4685 consensus_queue.cc:1048] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.699671  4740 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:26.700565  4740 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:26.703047  4704 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.703531  4704 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.705451  4704 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.705643  4740 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.705783  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:26.706532  3734 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:26.707804  4358 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:26.708539  4740 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:26.708877  4740 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:26.709249  4740 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.710868  3484 catalog_manager.cc:5697] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.711472  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:26.712244  3657 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:26.707846  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:26.714016  3804 raft_consensus.cc:2393] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 3: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:26.717001  3657 raft_consensus.cc:1275] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.718765  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:26.719381  3807 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:26.718014  3703 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.722201  3734 raft_consensus.cc:1275] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.723853  4704 raft_consensus.cc:2804] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:26.724308  4704 raft_consensus.cc:493] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.724644  4704 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.727099  3487 catalog_manager.cc:5697] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.729005  4731 consensus_queue.cc:1048] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.731933  4740 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:26.733630  3660 raft_consensus.cc:1275] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.736562  4731 consensus_queue.cc:1048] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.739166  4731 consensus_queue.cc:1048] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.739319  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:26.742563  4740 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.742717  3660 raft_consensus.cc:1275] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.746981  3734 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:26.747255  4740 consensus_queue.cc:1048] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.749543  4358 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:26.750180  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:26.750733  4740 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.751037  3805 raft_consensus.cc:2393] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 3: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:26.751251  4740 raft_consensus.cc:697] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:26.752151  4740 consensus_queue.cc:237] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:26.760643  3733 raft_consensus.cc:1275] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.762733  4685 consensus_queue.cc:1048] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.767099  4652 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:26.767588  4652 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.769645  4652 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.779642  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:26.780498  3805 raft_consensus.cc:2368] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3.
I20260709 12:26:26.781661  4715 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.782181  4715 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.785449  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:26.786028  3662 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 3.
I20260709 12:26:26.787169  3777 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.789798  4719 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:26.790324  4719 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.790745  4719 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.797468  3702 leader_election.cc:400] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3.
I20260709 12:26:26.797416  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:26.798341  4427 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:26.799264  3702 leader_election.cc:403] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.800519  4652 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.787956  4715 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:26.804455  3734 raft_consensus.cc:1275] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.810765  4652 raft_consensus.cc:2749] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a for earlier term 2. Current term is 3.
I20260709 12:26:26.829674  4731 consensus_queue.cc:1048] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:26.836388  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:26.844851  4704 raft_consensus.cc:515] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.849618  3664 raft_consensus.cc:1275] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.854583  3487 catalog_manager.cc:5697] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 2 to 3, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.858603  4740 consensus_queue.cc:1048] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:26.862708  3734 raft_consensus.cc:1275] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.865413  4740 consensus_queue.cc:1048] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.866070  4704 leader_election.cc:290] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:26.867031  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:26.867620  3805 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.871439  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e2aa65e5fc4e0c9ba2625fea02a731" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:26.872048  3660 raft_consensus.cc:3060] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.868757  4719 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.884675  3660 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:26.887230  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:26.887791  4427 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.895136  3703 leader_election.cc:304] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:26.905145  4704 raft_consensus.cc:2804] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.905629  4704 raft_consensus.cc:697] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:26.906423  4704 consensus_queue.cc:237] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:26.921581  4719 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:26.920238  3805 raft_consensus.cc:2468] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:26.936489  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:26.937566  3655 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.941249  3657 raft_consensus.cc:1275] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.943622  4715 consensus_queue.cc:1048] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.928099  4427 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 4.
I20260709 12:26:26.947006  3775 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:26.948323  4629 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:26.948808  4629 raft_consensus.cc:697] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:26.949654  4629 consensus_queue.cc:237] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:26.952585  3655 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 4.
I20260709 12:26:26.966876  4441 raft_consensus.cc:1275] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.969550  4715 consensus_queue.cc:1048] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.973639  3731 raft_consensus.cc:1275] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.975425  4713 consensus_queue.cc:1048] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.000661  3482 catalog_manager.cc:5697] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.006778  4652 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.007352  4652 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.009392  4652 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.011219  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.011703  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.012368  3805 raft_consensus.cc:2468] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:27.014429  3702 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.015781  4652 raft_consensus.cc:2804] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.016155  4652 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.016499  4652 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.024245  4652 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.026983  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:27.028641  3805 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.041464  4652 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.047837  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.051136  3807 raft_consensus.cc:1275] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.052630  4714 consensus_queue.cc:1048] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.072829  4463 raft_consensus.cc:1275] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:27.074244  4718 consensus_queue.cc:1048] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:27.084295  3482 catalog_manager.cc:5697] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 3, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.100492  3804 raft_consensus.cc:1275] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.108923  3805 raft_consensus.cc:2468] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:27.110252  3702 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.110955  4714 consensus_queue.cc:1048] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.111891  4704 raft_consensus.cc:2804] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.112421  4704 raft_consensus.cc:697] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:27.113224  4704 consensus_queue.cc:237] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.138720  3730 raft_consensus.cc:1275] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.143312  4642 consensus_queue.cc:1048] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.159925  3483 catalog_manager.cc:5697] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.166005  4714 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.166589  4714 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.168594  4714 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.170244  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.170748  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.171417  4463 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:27.174088  3657 raft_consensus.cc:1275] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:27.175715  4719 consensus_queue.cc:1048] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:27.178673  4704 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.179215  4704 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.181243  4704 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.182200  3627 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:27.184345  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.184700  4714 raft_consensus.cc:2804] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:27.184983  3804 raft_consensus.cc:2468] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:27.187561  3702 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:27.188413  4704 raft_consensus.cc:2804] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.188761  4704 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.189076  4704 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.185087  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.194222  4714 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.194713  4714 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.201711  3730 raft_consensus.cc:1275] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:27.203657  4740 consensus_queue.cc:1048] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:27.214715  4643 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.215242  4643 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.218044  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.218796  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.219521  3655 raft_consensus.cc:2468] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:27.220770  4357 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:27.221958  4740 raft_consensus.cc:2804] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.222321  4740 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.222669  4740 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.228081  4643 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.231468  4704 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.233340  4652 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.230870  4740 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.234817  4652 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.236961  4652 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.238041  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:27.240300  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.240839  3804 raft_consensus.cc:2468] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:27.241745  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.242257  3702 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:27.243640  4652 raft_consensus.cc:2804] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.244092  4652 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.244477  4652 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.252411  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:27.252698  3804 raft_consensus.cc:1275] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:27.253057  3655 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.258412  4643 consensus_queue.cc:1048] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:27.263126  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:27.263758  3804 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.274987  4652 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.277762  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:27.278316  3807 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.279795  4652 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.281172  4714 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.281381  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.283051  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.283533  4704 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.234813  3730 raft_consensus.cc:1275] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.335388  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:27.293033  4740 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.297277  3655 raft_consensus.cc:2468] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:27.302695  4761 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.336410  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.337018  4463 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.336930  4761 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.339138  4761 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.307307  3803 raft_consensus.cc:1275] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.342042  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.343268  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.343861  3808 raft_consensus.cc:2468] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:27.344952  3702 leader_election.cc:304] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:27.307212  3807 raft_consensus.cc:2468] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:27.352339  4629 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.348889  4761 raft_consensus.cc:2804] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.352854  4629 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.353381  4761 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.353557  4719 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.354049  4719 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.308390  3804 raft_consensus.cc:2468] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:27.348892  4674 consensus_queue.cc:1048] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.349150  4463 raft_consensus.cc:2468] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 4.
I20260709 12:26:27.355250  4357 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:27.357836  4719 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.358412  4740 raft_consensus.cc:2804] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.359392  4629 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.359854  3657 raft_consensus.cc:1275] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:27.360194  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.360574  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.360831  3655 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:27.361258  3702 leader_election.cc:304] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.361995  4719 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.349551  4714 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.362455  4719 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.362933  4642 consensus_queue.cc:1048] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.363158  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.363976  4427 raft_consensus.cc:2393] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:27.365202  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.365515  4719 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.365974  4441 raft_consensus.cc:2393] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:27.367421  3660 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:27.367597  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.368065  4642 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.368381  4441 raft_consensus.cc:2393] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:27.368541  4642 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.370065  4719 consensus_queue.cc:1048] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:27.370910  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.371546  3660 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:27.370169  3777 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.370600  4642 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.373358  3627 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:27.371781  4761 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.374415  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.374758  3777 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.375095  4463 raft_consensus.cc:2468] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:27.377250  4629 raft_consensus.cc:2804] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:27.377658  4629 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.378000  4629 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.382404  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.385506  3627 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:27.386286  3777 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.359881  4740 raft_consensus.cc:697] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:27.389261  4674 raft_consensus.cc:2804] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.389700  4674 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.390065  4740 consensus_queue.cc:237] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.390054  4674 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.388953  4605 raft_consensus.cc:2804] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:27.394723  4605 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.395074  4605 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.401417  4713 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.402010  4713 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.403663  4674 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.405081  4715 raft_consensus.cc:2804] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:27.405539  4715 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.405933  4715 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.384405  4704 raft_consensus.cc:2804] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.408944  3702 leader_election.cc:304] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.382033  4761 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.415469  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:27.415825  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.416595  4463 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:27.404187  4713 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.396963  4642 raft_consensus.cc:2804] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:27.420107  3627 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:27.405614  4674 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.416163  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.433259  3731 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:27.434720  3655 raft_consensus.cc:1275] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.437162  4788 consensus_queue.cc:1048] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.424549  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.438439  4441 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.445390  4761 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.447305  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.451069  4731 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.451640  4731 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.453866  4731 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.456820  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.457599  3657 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 4.
I20260709 12:26:27.459991  4357 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:27.470691  4792 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.427562  4652 raft_consensus.cc:2804] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.459022  4585 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.429154  4704 raft_consensus.cc:697] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:27.430047  4642 raft_consensus.cc:697] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:27.468158  4784 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.492950  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 84097.6us
I20260709 12:26:27.473892  4731 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:27.496652  4463 raft_consensus.cc:1275] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:27.471504  4792 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.497432  4761 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:27.502045  4785 log.cc:927] Time spent T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:26:27.501879  4761 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.503986  4761 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.504653  4642 consensus_queue.cc:237] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.505780  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.506445  3657 raft_consensus.cc:2468] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:27.482511  4652 raft_consensus.cc:697] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:27.507684  3703 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:27.488162  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.509545  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.474479  4790 raft_consensus.cc:2804] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:27.498940  4714 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.496326  4731 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.486806  4585 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.526046  4793 consensus_queue.cc:1048] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:27.514521  4790 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.528000  4790 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.513834  4761 raft_consensus.cc:2804] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.533160  4585 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.538538  4796 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.539063  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:27.539670  3804 raft_consensus.cc:1275] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.494755  4784 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.544320  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.545199  4463 raft_consensus.cc:2368] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 for earlier term 3. Current term is 4.
I20260709 12:26:27.522992  4731 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:27.517971  3736 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 4.
I20260709 12:26:27.513690  4605 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.550767  3775 leader_election.cc:400] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069) with higher term. Message: Invalid argument: T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 for earlier term 3. Current term is 4.
I20260709 12:26:27.555249  3775 leader_election.cc:403] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:27.542235  4761 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.522404  4714 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.550091  3807 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.557349  4761 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.555267  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d4a07cbac64bc1b4cfa2f52f4e4808" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.577881  3483 catalog_manager.cc:5697] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 1 to 3, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.576653  4774 raft_consensus.cc:3060] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.533802  4704 consensus_queue.cc:237] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.579619  4795 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.558017  4652 consensus_queue.cc:237] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.548290  4796 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.602957  4782 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:27.616654  4643 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:27.597235  4789 consensus_queue.cc:1048] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:27.626909  4441 raft_consensus.cc:2468] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:27.625240  4802 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.661274  4784 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.662717  4784 raft_consensus.cc:493] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:27.631335  4740 raft_consensus.cc:493] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:27.663188  4784 raft_consensus.cc:515] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:27.690570  4798 log.cc:927] Time spent T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:26:27.693924  4790 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.611778  4795 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:27.710538  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 81107.8us
W20260709 12:26:27.707381  3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 78343us
I20260709 12:26:27.694638  4715 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.646642  4643 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.670032  4792 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.720664  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.688549  4685 raft_consensus.cc:493] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:27.720460  4441 raft_consensus.cc:3060] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.725852  4463 raft_consensus.cc:2393] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:27.727254  4814 raft_consensus.cc:493] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:27.669827  4802 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.727857  4814 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.629076  4782 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
W20260709 12:26:27.730055  4797 log.cc:927] Time spent T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:26:27.700882  4740 raft_consensus.cc:515] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.742892  4784 leader_election.cc:290] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:27.743832  4796 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.744879  4795 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:27.745710  4761 raft_consensus.cc:515] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.736236  4808 raft_consensus.cc:493] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
I20260709 12:26:27.750458  4790 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.751362  4782 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:27.750470  4808 raft_consensus.cc:515] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.752197  4802 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.752388  4761 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.753415  4808 leader_election.cc:290] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:27.754487  4814 leader_election.cc:290] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.794545  4652 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:27.795697  4605 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.796175  4652 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.807617  4704 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.808784  4704 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:27.732614  4685 raft_consensus.cc:515] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.745060  4715 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.818449  3807 raft_consensus.cc:2468] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:27.735250  4714 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.734206  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.826692  4740 leader_election.cc:290] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:27.830183  4643 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.833104  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.834447  4782 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.834594  4437 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.839629  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.840667  4459 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:27.841202  4629 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.831880  4789 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:27.844667  4789 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.847209  4789 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.848526  4427 raft_consensus.cc:2393] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:27.849762  4820 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.850587  4820 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.852658  4437 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 4.
I20260709 12:26:27.853104  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.857466  3702 leader_election.cc:304] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:27.812064  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.859031  3804 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:27.860456  3811 raft_consensus.cc:1275] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.853361  4820 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.854265  3657 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:27.867245  4788 raft_consensus.cc:2804] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.868391  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.874666  4714 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.835384  4782 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:27.875351  4714 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.877116  4782 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.877910  4714 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.879252  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.882843  3731 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 3.
I20260709 12:26:27.880079  4788 raft_consensus.cc:697] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:27.885313  4788 consensus_queue.cc:237] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:27.882515  4761 consensus_queue.cc:1048] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:27.869591  4685 leader_election.cc:290] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:27.894269  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.895355  4422 raft_consensus.cc:2393] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:27.896183  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.897531  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.898403  4422 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 4.
I20260709 12:26:27.899554  4629 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:27.907982  4802 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.908751  4802 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.911216  4802 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.914685  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.916468  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.917364  4437 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:27.917776  4704 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:27.918622  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.919588  3655 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:27.921638  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:27.873948  4731 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:27.924749  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:27.925201  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae0cee41d4341debb2be23519d02ca9" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.926399  3662 raft_consensus.cc:2368] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 for earlier term 2. Current term is 3.
I20260709 12:26:27.927408  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:27.928381  3811 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:27.930533  3662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:27.932102  3657 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.922829  3660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.916136  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.937541  3731 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:27.942018  3702 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:27.942719  3664 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:27.944272  3733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.937844  3660 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:27.948520  4704 raft_consensus.cc:2804] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.948863  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.950174  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.951612  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:27.954758  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5afddbeb03a24c0c80391699d45e6520" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.956735  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.981480  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.958108  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.958837  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:27.932168  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:27.965289  4731 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 5 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:27.963132  3482 catalog_manager.cc:5697] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.946089  4782 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.972225  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:27.982918  3659 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:27.972342  4685 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.978183  4422 raft_consensus.cc:2393] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:27.978503  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6420cbab7b6a413bb6a9a3bdc07aa918" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:27.980064  4459 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 1.
I20260709 12:26:27.981837  3661 raft_consensus.cc:2393] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 3: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:27.961797  4357 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:27.982345  3730 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:27.987464  3733 raft_consensus.cc:2368] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:27.974192  4704 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.976303  3662 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
I20260709 12:26:27.991209  3736 raft_consensus.cc:3060] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.998275  4463 raft_consensus.cc:3060] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.998611  4820 raft_consensus.cc:2804] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.999258  3734 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 2.
I20260709 12:26:28.001644  4685 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:28.001586  4357 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.004282  4704 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.010442  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.005782  4820 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.009099  4643 raft_consensus.cc:2804] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.017405  4643 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.017868  4643 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.018437  4788 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.015007  4820 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.019076  4788 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.022909  4788 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.028471  4652 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:28.029364  4685 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.009272  3482 catalog_manager.cc:5697] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.030519  3487 catalog_manager.cc:5697] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.039306  3659 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:28.038305  4463 raft_consensus.cc:2468] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:28.039059  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:28.038908  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:28.041911  3701 leader_election.cc:304] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:28.042111  4422 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:28.042776  4761 raft_consensus.cc:2804] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.043016  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:28.043470  4761 raft_consensus.cc:697] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:28.044080  4459 raft_consensus.cc:2393] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 4: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:28.044518  3775 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:28.044548  4761 consensus_queue.cc:237] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.045199  3701 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:28.042754  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:28.046715  3734 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:28.047744  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:28.048537  3661 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:28.015202  4782 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.049793  4357 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.051438  4782 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:28.058249  4652 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.058842  4652 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.059201  4652 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.058432  4718 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:28.063931  4718 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.064415  4718 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:28.065320  3703 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:28.071560  4788 raft_consensus.cc:2804] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:28.071846  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:28.072659  3661 raft_consensus.cc:2468] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:28.075361  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.076545  4718 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:28.078989  4718 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:28.081459  3627 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:28.083510  4815 raft_consensus.cc:2804] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.084098  4815 raft_consensus.cc:697] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:28.085194  4815 consensus_queue.cc:237] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.051363  4820 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:28.087303  4652 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.090638  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:28.091312  4459 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.093072  4652 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:28.099977  4774 consensus_meta.cc:287] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05: Time spent flushing consensus metadata: real 0.503s	user 0.002s	sys 0.016s
I20260709 12:26:28.100653  4774 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069) with higher term. Message: Invalid argument: T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 for earlier term 3. Current term is 4.
I20260709 12:26:28.056594  4437 raft_consensus.cc:2393] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:28.101790  4824 raft_consensus.cc:2804] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.104976  4824 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.105386  4824 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.108639  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.109339  3663 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.109570  3737 raft_consensus.cc:2468] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 1.
I20260709 12:26:28.118157  3663 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:28.072032  4788 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:28.120223  4788 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.126725  4824 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:28.127585  4820 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.128134  4459 raft_consensus.cc:2468] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 4.
I20260709 12:26:28.130045  4357 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.119194  3659 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 5.
I20260709 12:26:28.129566  3627 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.151765  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f9d51f74f24d96a2aa074b6ed09f7a" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.152226  3808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.152680  3804 raft_consensus.cc:2368] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.153097  3808 raft_consensus.cc:2368] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
W20260709 12:26:28.153329  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 69681.5us
I20260709 12:26:28.154975  4714 raft_consensus.cc:2804] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.156773  4714 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.157187  4714 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.159076  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.154677  3809 raft_consensus.cc:3060] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.160562  3803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6816ad0fe10401d80c7d91e289708d6" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.153762  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.161429  3807 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:28.161860  4357 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.162559  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.162746  4357 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.163344  3804 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:28.154753  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.166173  3806 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 2.
I20260709 12:26:28.167234  3811 raft_consensus.cc:2393] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 2: Already voted for candidate 3c78ef175c2d468993c1cb82527bef05 in this term.
I20260709 12:26:28.154256  3627 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.163460  4685 raft_consensus.cc:2804] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.136780  3657 raft_consensus.cc:2468] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:28.169340  3701 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:28.170720  4782 raft_consensus.cc:2804] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.171509  3659 raft_consensus.cc:1275] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.172132  4731 raft_consensus.cc:2804] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:28.172386  4685 raft_consensus.cc:697] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:28.177712  3627 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.154215  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.176954  4674 raft_consensus.cc:2804] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.175869  4782 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.179492  4761 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.178959  4731 raft_consensus.cc:697] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 5 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:28.192536  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97832336db4b4e6099c905fe241f299c" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:28.196249  3806 raft_consensus.cc:3060] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.198750  4808 consensus_queue.cc:1048] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:26:28.200183  4356 leader_election.cc:400] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.200585  4356 leader_election.cc:403] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.201503  4740 raft_consensus.cc:3060] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.201525  4356 leader_election.cc:400] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.204001  4356 leader_election.cc:403] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.204638  4799 raft_consensus.cc:2804] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.185052  4714 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.204885  4356 leader_election.cc:304] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:28.206902  4714 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:28.207129  3811 raft_consensus.cc:1275] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:28.207875  4820 raft_consensus.cc:3060] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.209463  4685 consensus_queue.cc:237] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:28.213909  4811 consensus_queue.cc:1048] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:28.186815  4422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:28.193073  4782 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.177392  4643 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:28.227223  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:28.228485  3735 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:28.197372  4674 raft_consensus.cc:697] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:28.216137  4799 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.226647  4422 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:28.245803  4824 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.246707  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:28.238368  4799 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.250041  3812 raft_consensus.cc:2368] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.250684  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e70956e754284b1d94ac89b470281cca" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:28.251797  4441 raft_consensus.cc:1275] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.253043  4643 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.253670  3734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28797f7f5b4c4196b96911477adabf4d" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:28.254315  3734 raft_consensus.cc:3060] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:28.257694  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:28.258038  4788 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.258755  4731 consensus_queue.cc:237] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.260829  4466 raft_consensus.cc:1275] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:28.262871  4674 consensus_queue.cc:237] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.247524  4356 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:28.264139  4814 raft_consensus.cc:2749] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.265590  4814 raft_consensus.cc:2804] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.265656  3731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:28.266000  4814 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.266359  4814 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.259657  4358 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:28.232916  4761 raft_consensus.cc:697] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:28.266952  3734 raft_consensus.cc:2468] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 5.
I20260709 12:26:28.280009  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:28.280333  4463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:28.281524  4463 raft_consensus.cc:2393] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 4: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:28.300426  3812 raft_consensus.cc:1275] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.302074  3805 raft_consensus.cc:2368] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a for earlier term 4. Current term is 5.
I20260709 12:26:28.274857  3731 raft_consensus.cc:2468] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 1.
I20260709 12:26:28.304512  3735 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 5.
I20260709 12:26:28.308390  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f1c4fb6ccb4909b6ed39a42499e6c4" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:28.308380  3736 raft_consensus.cc:2468] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 4.
I20260709 12:26:28.313385  4788 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.314095  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:28.315575  3735 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.316416  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:28.317162  4462 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.332916  4358 leader_election.cc:400] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Vote denied by peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167) with higher term. Message: Invalid argument: T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.333375  4358 leader_election.cc:403] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.270112  3655 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 2.
W20260709 12:26:28.369267  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 82684.3us
I20260709 12:26:28.372430  4462 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
W20260709 12:26:28.374651  4356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 108603us
I20260709 12:26:28.296497  4802 consensus_queue.cc:1048] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:26:28.291976  4824 raft_consensus.cc:2804] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:28.348667  4422 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 5.
I20260709 12:26:28.434825  3806 raft_consensus.cc:2468] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
W20260709 12:26:28.446141  3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 107026us
W20260709 12:26:28.449062  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 66656.8us
I20260709 12:26:28.449880  3777 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:28.453384  4715 raft_consensus.cc:2764] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:28.399698  3809 raft_consensus.cc:1275] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.363375  4820 raft_consensus.cc:2749] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.438707  4824 raft_consensus.cc:493] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 98dcd37d8895403d96ceb94f8c67412a)
W20260709 12:26:28.437065  4356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 61483.4us
I20260709 12:26:28.444536  4808 raft_consensus.cc:2749] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167) with higher term. Message: Invalid argument: T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.470546  4824 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.323325  3735 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:28.460717  4358 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:28.384289  4761 consensus_queue.cc:237] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.478080  4740 raft_consensus.cc:2749] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
W20260709 12:26:28.507082  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 46437.7us
I20260709 12:26:28.477809  4704 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:28.512655  4685 raft_consensus.cc:2749] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:28.503443  4814 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
W20260709 12:26:28.537674  3627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 249569us
I20260709 12:26:28.537674  4356 leader_election.cc:400] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.556097  3627 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.554236  4356 leader_election.cc:403] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:28.563781  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 49314.1us
I20260709 12:26:28.561177  4832 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.570235  3775 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:28.573375  4445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:28.574419  4445 raft_consensus.cc:2393] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 2: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:28.576498  4714 raft_consensus.cc:2804] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.577054  4714 raft_consensus.cc:697] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:28.578049  4714 consensus_queue.cc:237] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:28.584074  4356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 63355.9us
I20260709 12:26:28.585768  4808 raft_consensus.cc:3060] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.566172  4799 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.587365  4832 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.576813  4838 consensus_queue.cc:1048] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:26:28.574215  4792 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:28.597556  4832 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.597786  4814 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:28.600320  4799 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
W20260709 12:26:28.605008  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 155238us
I20260709 12:26:28.606613  4441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:28.608652  4441 raft_consensus.cc:2393] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 3: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:28.611261  4452 raft_consensus.cc:1275] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.612401  4704 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:28.618736  3777 leader_election.cc:400] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615) with higher term. Message: Invalid argument: T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 for earlier term 2. Current term is 3.
I20260709 12:26:28.624523  3777 leader_election.cc:403] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.611332  4437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:28.607412  4792 raft_consensus.cc:697] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:28.625710  4452 raft_consensus.cc:1275] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.638855  4605 raft_consensus.cc:2749] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615) with higher term. Message: Invalid argument: T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c78ef175c2d468993c1cb82527bef05 for earlier term 2. Current term is 3.
I20260709 12:26:28.626055  4422 raft_consensus.cc:1275] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:28.639791  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 396349us
I20260709 12:26:28.641582  4782 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.635694  4437 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.650158 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.656353  3806 raft_consensus.cc:1275] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.657037  4452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:28.657869  3808 raft_consensus.cc:1275] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.658931  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:28.659385  3805 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.665894  4836 consensus_queue.cc:1048] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:28.666517  3805 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:28.666954  4824 raft_consensus.cc:515] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:28.669098  4816 consensus_queue.cc:1048] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:28.671228  4459 raft_consensus.cc:2393] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 3: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
W20260709 12:26:28.672439  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 53869.9us
I20260709 12:26:28.673853  4792 consensus_queue.cc:237] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:28.627902  4704 consensus_queue.cc:1048] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:26:28.678673  4437 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:28.686261  4740 consensus_queue.cc:1048] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:28.687686  3482 catalog_manager.cc:5697] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.690879  3777 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:28.691386  3805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:28.692094  3805 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.691973  4585 raft_consensus.cc:2804] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:28.693955  4585 raft_consensus.cc:697] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:28.694924  4585 consensus_queue.cc:237] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:28.698477  4422 raft_consensus.cc:1275] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.707926  3702 leader_election.cc:400] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a for earlier term 4. Current term is 5.
I20260709 12:26:28.708397  3702 leader_election.cc:403] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:28.709152  3702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 55298.2us
I20260709 12:26:28.709615  4832 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a for earlier term 4. Current term is 5.
I20260709 12:26:28.698321  3627 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.715881  4832 consensus_queue.cc:1048] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.716048  3812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:28.718286  3702 leader_election.cc:304] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
W20260709 12:26:28.722054  3630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 210116us
I20260709 12:26:28.723244  3630 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:28.729432  3630 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:28.716378  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
W20260709 12:26:28.762333  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 71557.8us
I20260709 12:26:28.724431  4815 raft_consensus.cc:2804] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.732204  4674 raft_consensus.cc:2804] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.735656  4452 raft_consensus.cc:3060] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.771592  3777 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:28.736542  4704 raft_consensus.cc:2804] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.737578  4808 raft_consensus.cc:2749] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.726274  4788 consensus_queue.cc:1048] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:26:28.726486  4761 consensus_queue.cc:1048] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:26:28.791855  4844 raft_consensus.cc:2804] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.792375  4844 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.792711  4844 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.795993  4824 leader_election.cc:290] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:28.796499  4452 raft_consensus.cc:2468] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:28.787274  4704 raft_consensus.cc:697] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:28.774574  3807 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.803875  4836 consensus_queue.cc:1048] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.807369  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea70a27e95854669a0da5bb76b24e632" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.807674  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd7b1d038f32403881c972fd7d51e402" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.808071  3659 raft_consensus.cc:3060] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.808354  3655 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.808404  4704 consensus_queue.cc:237] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:28.774715  4674 raft_consensus.cc:493] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.809957  4674 raft_consensus.cc:3060] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.815994  3777 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:28.773787  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:28.816687  3735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:28.821750  4463 raft_consensus.cc:1275] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.829769  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:28.830498  3737 raft_consensus.cc:3060] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.780738  4815 raft_consensus.cc:697] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:28.831154  3736 raft_consensus.cc:3060] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.866560  3484 catalog_manager.cc:5697] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.868175  3484 catalog_manager.cc:5697] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.875985  4782 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:28.879148  4815 consensus_queue.cc:237] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:28.886962  3807 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:28.889405  3655 raft_consensus.cc:2468] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:28.889662  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.890556  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.892755  3661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48164492db145fda737e65bbfc255f5" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.892908  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f126cd9dac7407c92dc21d66fc9e353" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:28.893383  3661 raft_consensus.cc:3060] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.894142  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:28.891460  3664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c8b4d97a9042d9b1a9a19db2bea177" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:28.895991  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93135771a5a14169b53fb7a726a9ce2e" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:28.896848  3806 raft_consensus.cc:2368] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:28.897251  3664 raft_consensus.cc:1275] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.903534  3737 raft_consensus.cc:2468] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 3.
I20260709 12:26:28.911441  4357 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05
I20260709 12:26:28.912664  3729 raft_consensus.cc:3060] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.916007  3703 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:28.918373  3659 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:28.922731  3703 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:28.924661  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 77460.1us
I20260709 12:26:28.913101  3732 raft_consensus.cc:1275] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:28.926301  4836 raft_consensus.cc:2749] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.926836  4808 raft_consensus.cc:2804] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.927358  4808 raft_consensus.cc:697] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:28.928215  4808 consensus_queue.cc:237] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:28.931005  3731 raft_consensus.cc:1275] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:28.933079  4815 consensus_queue.cc:1048] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.887018  3805 raft_consensus.cc:2468] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:28.921567  4357 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:28.928455  4836 consensus_queue.cc:1048] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.900388  4718 raft_consensus.cc:2764] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:26:28.941922  4792 raft_consensus.cc:2764] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 12:26:28.972160  4863 log.cc:927] Time spent T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:26:28.973990  4850 log.cc:927] Time spent T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:26:28.953579  4643 raft_consensus.cc:2804] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.955327  4740 consensus_queue.cc:1048] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:26:28.957895  4674 raft_consensus.cc:515] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:29.017748  4643 raft_consensus.cc:697] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:29.153414  3729 raft_consensus.cc:1275] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.153807  4427 raft_consensus.cc:1275] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.032462  4844 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
W20260709 12:26:29.239176  3630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 82449.9us
I20260709 12:26:29.164875  3655 raft_consensus.cc:2393] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98dcd37d8895403d96ceb94f8c67412a in current term 4: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
I20260709 12:26:29.155820  3736 raft_consensus.cc:2468] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:29.158109  3661 raft_consensus.cc:2468] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 3.
I20260709 12:26:29.237258  4788 raft_consensus.cc:2749] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.264322  3658 raft_consensus.cc:2393] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba in current term 3: Already voted for candidate ea17b2b4fe5a4a33b586dd908fd673ce in this term.
W20260709 12:26:29.281396  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 47691.2us
I20260709 12:26:29.286703  4357 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:29.277633  4811 raft_consensus.cc:493] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
W20260709 12:26:29.282994  4826 log.cc:927] Time spent T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:26:29.291409  4782 raft_consensus.cc:2804] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:29.275931  4643 consensus_queue.cc:237] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:29.295301  4811 raft_consensus.cc:515] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:29.303437  4782 raft_consensus.cc:697] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:29.304137  3729 raft_consensus.cc:1275] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.304608  4782 consensus_queue.cc:237] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:29.305459  4811 leader_election.cc:290] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
W20260709 12:26:29.303642  4870 log.cc:927] Time spent T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:29.290241  4802 consensus_queue.cc:1048] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:26:29.307749  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:29.308465  3729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:29.321009  3659 raft_consensus.cc:1275] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:29.323318  4867 log.cc:927] Time spent T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:26:29.301888  4674 leader_election.cc:290] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:29.317282  4358 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:29.325676  4844 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:29.326519  4814 raft_consensus.cc:2804] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:29.327066  4814 raft_consensus.cc:697] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:29.327968  4814 consensus_queue.cc:237] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:29.331216  4811 consensus_queue.cc:1048] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.338040  3737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:29.338848  3737 raft_consensus.cc:2393] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 3: Already voted for candidate b06c1f1461ec46289edf63122a5863ba in this term.
I20260709 12:26:29.346486  4844 raft_consensus.cc:493] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:29.347191  4844 raft_consensus.cc:515] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:29.349397  4844 leader_election.cc:290] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:29.359815  3804 raft_consensus.cc:1275] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.367307  4459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09f7a90ab1c4f1b903c1c9b34494a93" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:29.368314  4441 raft_consensus.cc:1275] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:29.379179  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 45726.4us
I20260709 12:26:29.367457  4445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7269c445625d4453bc9b0c141c5fb9c9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:29.395943  4445 raft_consensus.cc:2393] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ea17b2b4fe5a4a33b586dd908fd673ce in current term 4: Already voted for candidate 98dcd37d8895403d96ceb94f8c67412a in this term.
I20260709 12:26:29.452412  3655 raft_consensus.cc:1240] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Rejecting Update request from peer 3c78ef175c2d468993c1cb82527bef05 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:29.460477  4715 consensus_queue.cc:1059] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.461468  4715 raft_consensus.cc:3055] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:29.461820  4715 raft_consensus.cc:740] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:29.463657  4715 consensus_queue.cc:260] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:29.465261  4463 raft_consensus.cc:1275] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:29.466269  4466 raft_consensus.cc:1275] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.464887  4715 raft_consensus.cc:3060] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.462777  4704 consensus_queue.cc:1048] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:29.474583  4788 consensus_queue.cc:1048] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.476509  4838 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:29.477053  4838 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:29.477573  4704 consensus_queue.cc:1048] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.479116  4838 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:29.480723  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:29.515885  4884 consensus_queue.cc:1048] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:26:29.493296  4815 consensus_queue.cc:1048] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:29.557920  3482 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37354 (request call id 153) took 1119 ms. Trace:
I20260709 12:26:29.566298  3630 leader_election.cc:304] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:29.574498  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 44082.5us
I20260709 12:26:29.567695  3630 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:29.558517  3482 rpcz_store.cc:276] 0709 12:26:28.438480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.441548 (+  3068us) service_pool.cc:224] Handling call
0709 12:26:29.557802 (+1116254us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:28.691714 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:28.692268 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:28.692300 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:26:28.692316 (+    16us) tablet.cc:662] Decoding operations
0709 12:26:28.692622 (+   306us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:28.692673 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:28.692702 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:28.692892 (+   190us) tablet.cc:701] Row locks acquired
0709 12:26:28.692908 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:28.693034 (+   126us) write_op.cc:270] Start()
0709 12:26:28.693143 (+   109us) write_op.cc:276] Timestamp: P: 1783599988692990 usec, L: 0
0709 12:26:28.693163 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:28.693731 (+   568us) log.cc:844] Serialized 531 byte log entry
0709 12:26:28.804059 (+110328us) op_driver.cc:464] REPLICATION: finished
0709 12:26:29.026601 (+222542us) write_op.cc:301] APPLY: starting
0709 12:26:29.032774 (+  6173us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:29.064768 (+ 31994us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:29.163910 (+ 99142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:29.255901 (+ 91991us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:29.271146 (+ 15245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:29.277216 (+  6070us) write_op.cc:312] APPLY: finished
0709 12:26:29.283768 (+  6552us) log.cc:844] Serialized 22 byte log entry
0709 12:26:29.289645 (+  5877us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:29.290918 (+  1273us) write_op.cc:454] Released schema lock
0709 12:26:29.293290 (+  2372us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:29.314119 (+ 20829us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:29.314154 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1040,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":207040,"apply.run_cpu_time_us":2688,"apply.run_wall_time_us":278242,"num_ops":1,"prepare.queue_time_us":1298,"prepare.run_cpu_time_us":2282,"prepare.run_wall_time_us":2282,"replication_time_us":110745,"thread_start_us":47448,"threads_started":1}]]}
I20260709 12:26:29.596388  3487 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38034 (request call id 55) took 1080 ms. Trace:
I20260709 12:26:29.596834  3487 rpcz_store.cc:276] 0709 12:26:28.515607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.515755 (+   148us) service_pool.cc:224] Handling call
0709 12:26:29.596314 (+1080559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128957,"reported_tablets":2}
I20260709 12:26:29.604753  3659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:29.606541  3807 raft_consensus.cc:1275] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.607528  4840 raft_consensus.cc:2749] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.608840  4459 raft_consensus.cc:1240] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Rejecting Update request from peer 3c78ef175c2d468993c1cb82527bef05 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:29.609576  3732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:29.610517  4356 leader_election.cc:400] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:29.610850  4441 raft_consensus.cc:1275] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:29.618147  3733 raft_consensus.cc:1275] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:29.570766  4788 consensus_queue.cc:1048] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:26:29.622762  3733 raft_consensus.cc:1275] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.593000  4815 raft_consensus.cc:2749] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.629451  3656 raft_consensus.cc:1275] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.631713  3660 raft_consensus.cc:1275] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:29.632594  4868 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:26:29.610869  4356 leader_election.cc:403] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:29.640491  4445 raft_consensus.cc:1275] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.642450  4849 raft_consensus.cc:2749] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093) with higher term. Message: Invalid argument: T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b06c1f1461ec46289edf63122a5863ba for earlier term 2. Current term is 3.
I20260709 12:26:29.646560  3483 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37372 (request call id 140) took 1043 ms. Trace:
I20260709 12:26:29.646968  3483 rpcz_store.cc:276] 0709 12:26:28.576154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.576392 (+   238us) service_pool.cc:224] Handling call
0709 12:26:29.619289 (+1042897us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37937,"reported_tablets":1}
I20260709 12:26:29.654973  4884 consensus_queue.cc:1048] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:26:29.679647  4731 consensus_queue.cc:1048] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.681574  4811 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:29.677937  4845 consensus_queue.cc:1048] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:26:29.701251  3703 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:29.703790  4704 consensus_queue.cc:1048] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:29.704051  4811 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:29.712666  4811 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:29.714713  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b06c1f1461ec46289edf63122a5863ba" is_pre_election: true
I20260709 12:26:29.716068  4788 raft_consensus.cc:2749] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.720436  4799 consensus_queue.cc:1048] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.736467  4788 raft_consensus.cc:493] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3c78ef175c2d468993c1cb82527bef05)
I20260709 12:26:29.760464  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4399494b9fc14dc7989c328e016df504" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:29.808887  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:29.810388  3659 raft_consensus.cc:1275] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.810289  3810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:29.825423  4845 consensus_queue.cc:1048] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.755786  4788 raft_consensus.cc:515] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:29.834110  4788 leader_election.cc:290] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:29.834163  4845 consensus_queue.cc:1048] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:29.851233  3659 raft_consensus.cc:1275] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.867450  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:29.872822  3657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" is_pre_election: true
I20260709 12:26:29.908908  3702 leader_election.cc:304] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:29.911844  4835 raft_consensus.cc:2749] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:29.879659  4808 consensus_queue.cc:1048] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:26:29.991020  3738 raft_consensus.cc:1275] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.984050  3657 raft_consensus.cc:1275] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:30.050320  3628 leader_election.cc:304] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
W20260709 12:26:30.051394  3628 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 64760.2us
I20260709 12:26:30.052438  3628 leader_election.cc:304] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:30.053005  3658 raft_consensus.cc:1275] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:30.053521  3628 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:30.054805  4714 raft_consensus.cc:2749] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.047746  4875 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:26:30.055974  4714 raft_consensus.cc:2749] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:30.051414  4782 consensus_queue.cc:1048] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:30.073199  4816 raft_consensus.cc:2749] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:30.076048  4731 consensus_queue.cc:1048] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.110545  3811 raft_consensus.cc:1275] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:30.117498  3483 catalog_manager.cc:5697] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.121524  3483 catalog_manager.cc:5697] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } }
I20260709 12:26:30.163156  3805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:30.165472  3805 raft_consensus.cc:606] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Received request to transfer leadership to TS 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:30.176621  3805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "b06c1f1461ec46289edf63122a5863ba"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:30.182873  3805 raft_consensus.cc:606] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 LEADER]: Received request to transfer leadership to TS b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:30.198385  3812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "b06c1f1461ec46289edf63122a5863ba"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:30.200405  3812 raft_consensus.cc:606] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Received request to transfer leadership to TS b06c1f1461ec46289edf63122a5863ba
W20260709 12:26:30.216027  4357 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 93314.3us
W20260709 12:26:30.216293  4356 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.4:37093, user_credentials={real_user=slave}} blocked reactor thread for 107657us
W20260709 12:26:30.223667  4358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 85181us
I20260709 12:26:30.236414  3804 raft_consensus.cc:1275] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:30.238154  4731 consensus_queue.cc:1048] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:30.280125  3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 44335.7us
I20260709 12:26:30.284149  4924 consensus_queue.cc:1048] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:26:30.289438  3775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.1:37069, user_credentials={real_user=slave}} blocked reactor thread for 55738.9us
I20260709 12:26:30.301744  3810 pending_rounds.cc:85] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: Aborting all ops after (but not including) 1
I20260709 12:26:30.291702  4782 consensus_queue.cc:1048] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:26:30.309329  3810 pending_rounds.cc:107] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:30.323962  3810 raft_consensus.cc:2889] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:30.332099  4605 raft_consensus.cc:993] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower b06c1f1461ec46289edf63122a5863ba to start an election
I20260709 12:26:30.334221  4818 raft_consensus.cc:1081] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 LEADER]: Signalling peer b06c1f1461ec46289edf63122a5863ba to start an election
W20260709 12:26:30.342609  3777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:40615, user_credentials={real_user=slave}} blocked reactor thread for 48380.4us
I20260709 12:26:30.394490  4462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39"
dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
 from {username='slave'} at 127.0.0.1:57016
I20260709 12:26:30.395064  4462 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.395397  4462 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:30.404639  3778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:35167, user_credentials={real_user=slave}} blocked reactor thread for 105710us
I20260709 12:26:30.452502  4462 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:30.461562  4462 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 6 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:30.462435  4877 raft_consensus.cc:993] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower b06c1f1461ec46289edf63122a5863ba to start an election
I20260709 12:26:30.463469  4877 raft_consensus.cc:1081] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Signalling peer b06c1f1461ec46289edf63122a5863ba to start an election
I20260709 12:26:30.465576  4462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74"
dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
 from {username='slave'} at 127.0.0.1:57016
I20260709 12:26:30.466177  4462 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.466537  4462 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.483387  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:30.484088  3811 raft_consensus.cc:3055] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:30.484377  3811 raft_consensus.cc:740] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:30.485055  3811 consensus_queue.cc:260] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:30.489740  3663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8"
dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
mode: GRACEFUL
new_leader_uuid: "b06c1f1461ec46289edf63122a5863ba"
 from {username='slave'} at 127.0.0.1:47754
I20260709 12:26:30.490134  3811 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:30.490350  3663 raft_consensus.cc:606] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Received request to transfer leadership to TS b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:30.499584  4885 raft_consensus.cc:993] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:30.498347  3807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:30.500496  3807 raft_consensus.cc:606] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Received request to transfer leadership to TS 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:30.503706  3487 catalog_manager.cc:5697] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.504436  4885 raft_consensus.cc:1081] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Signalling peer 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:30.506028  3811 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 6.
I20260709 12:26:30.513675  4462 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:30.516547  3806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:30.517081  3806 raft_consensus.cc:3055] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:30.517346  3806 raft_consensus.cc:740] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:30.518062  3806 consensus_queue.cc:260] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:30.519032  4462 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 5 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:30.519142  3806 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.521831  3735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d"
dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:26:30.509407  3487 catalog_manager.cc:5697] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.522315  3735 raft_consensus.cc:493] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.522606  3735 raft_consensus.cc:3060] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.527119  3487 catalog_manager.cc:5697] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } }
I20260709 12:26:30.531530  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5581ff41a8b438693f2fd8942489f74" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:30.532193  3656 raft_consensus.cc:3060] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.531605  3487 catalog_manager.cc:5697] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.535223  3806 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 5.
I20260709 12:26:30.536175  3487 catalog_manager.cc:5697] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } }
I20260709 12:26:30.538774  3487 catalog_manager.cc:5697] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } }
I20260709 12:26:30.547712  3487 catalog_manager.cc:5697] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 3 to 5, leader changed from 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 5 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } }
I20260709 12:26:30.538132  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:30.549244  3487 catalog_manager.cc:5697] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 1 to 3, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } }
I20260709 12:26:30.561929  3735 raft_consensus.cc:515] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:30.566080  3735 leader_election.cc:290] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:30.574407  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:30.537348  4356 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:30.567575  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d268ccfd8994a26a344654a181b615d" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:30.562867  3806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:30.557615  3730 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:30.575049  3663 raft_consensus.cc:3060] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.576948  3806 raft_consensus.cc:606] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Received request to transfer leadership to TS 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:30.578562  4356 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:30.578578  4731 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:30.579345  4924 raft_consensus.cc:2804] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:30.580041  4731 raft_consensus.cc:697] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 6 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:30.581107 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:30.582696  4731 consensus_queue.cc:237] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:30.581127  4924 raft_consensus.cc:697] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 5 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:30.584072  4924 consensus_queue.cc:237] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:30.587416  3663 raft_consensus.cc:2468] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:30.594074  3703 leader_election.cc:304] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:30.600535  3656 raft_consensus.cc:2468] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 5.
I20260709 12:26:30.604326  3730 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 6.
I20260709 12:26:30.612212 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:30.581025  3807 raft_consensus.cc:3055] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.625384 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.613564  4788 raft_consensus.cc:2804] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.633319  4788 raft_consensus.cc:697] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:30.616622  3807 raft_consensus.cc:740] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:30.637825  3483 catalog_manager.cc:5697] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 1 to 3, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.645401  4788 consensus_queue.cc:237] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:30.648298  3483 catalog_manager.cc:5697] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 1 to 3, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 3 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:30.660560  4944 log.cc:927] Time spent T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:26:30.666918  4605 raft_consensus.cc:993] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:30.667436  4605 raft_consensus.cc:1081] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Signalling peer 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:30.653803  3807 consensus_queue.cc:260] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:30.668875  3807 raft_consensus.cc:3060] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:30.690653  4945 log.cc:927] Time spent T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:30.687439  3736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e"
dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:26:30.692049  3736 raft_consensus.cc:493] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.692469  3736 raft_consensus.cc:3060] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:30.704227  4946 log.cc:927] Time spent T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:26:30.709357  3807 raft_consensus.cc:2468] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:30.711879  3736 raft_consensus.cc:515] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:30.741832  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:30.742399  3663 raft_consensus.cc:3060] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.743126  3736 leader_election.cc:290] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:30.745580  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e29a6aaafab344e1b9259bb9803dba3e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:30.746153  3804 raft_consensus.cc:3055] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.746441  3804 raft_consensus.cc:740] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:30.747654  3482 catalog_manager.cc:5697] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.747193  3804 consensus_queue.cc:260] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:30.757334  3804 raft_consensus.cc:3060] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.768270  3804 raft_consensus.cc:2468] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:30.776087  3702 leader_election.cc:304] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:30.776954  4788 raft_consensus.cc:2804] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.777428  4788 raft_consensus.cc:697] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:30.778265  4788 consensus_queue.cc:237] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:30.792902  3663 raft_consensus.cc:2468] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:30.792572  3483 catalog_manager.cc:5697] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 4 to 5, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 5 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.802495  3483 catalog_manager.cc:5697] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 5 to 6, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 6 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.814688  3487 catalog_manager.cc:5697] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.870977  4811 raft_consensus.cc:993] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce: : Instructing follower b06c1f1461ec46289edf63122a5863ba to start an election
I20260709 12:26:30.871464  4811 raft_consensus.cc:1081] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Signalling peer b06c1f1461ec46289edf63122a5863ba to start an election
I20260709 12:26:30.876238  4459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8"
dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:26:30.876835  4459 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.877192  4459 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.886341  4809 raft_consensus.cc:993] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:30.886945  4809 raft_consensus.cc:1081] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Signalling peer 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:30.888749  3731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd"
dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:26:30.889426  3731 raft_consensus.cc:493] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.889964  3731 raft_consensus.cc:3060] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.896766  4459 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:30.905332  4459 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:30.908485  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:30.909116  3736 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.909437  3663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81d335504724d14bafd66069e9ab3f8" candidate_uuid: "b06c1f1461ec46289edf63122a5863ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:30.910019  3663 raft_consensus.cc:3055] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:30.910297  3663 raft_consensus.cc:740] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:30.917069  3736 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 4.
I20260709 12:26:30.921442  4358 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba; no voters: 
I20260709 12:26:30.930891  4824 raft_consensus.cc:2804] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:30.933053  3663 consensus_queue.cc:260] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:30.936805  3663 raft_consensus.cc:3060] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.942777  3731 raft_consensus.cc:515] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:30.938308  4824 raft_consensus.cc:697] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 4 LEADER]: Becoming Leader. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:30.963995  3663 raft_consensus.cc:2468] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b06c1f1461ec46289edf63122a5863ba in term 4.
I20260709 12:26:30.965674  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:30.968340  3658 raft_consensus.cc:3060] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.969254  3731 leader_election.cc:290] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:30.967487  4824 consensus_queue.cc:237] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:30.971695  3804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fafdf9490c1f4d9b919cee9883ba04fd" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:30.974821  3804 raft_consensus.cc:3055] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.975162  3804 raft_consensus.cc:740] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:30.975916  3804 consensus_queue.cc:260] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:30.978037  3804 raft_consensus.cc:3060] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.009052  3807 raft_consensus.cc:1275] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:31.010776  3804 raft_consensus.cc:2468] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:31.011824  4922 consensus_queue.cc:1048] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:31.039490  3702 leader_election.cc:304] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:31.015461  3658 raft_consensus.cc:2468] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:31.040988  4788 raft_consensus.cc:2804] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:31.041496  4788 raft_consensus.cc:697] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:31.043891  3483 catalog_manager.cc:5697] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba reported cstate change: term changed from 3 to 4, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to b06c1f1461ec46289edf63122a5863ba (127.29.9.1). New cstate: current_term: 4 leader_uuid: "b06c1f1461ec46289edf63122a5863ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.042389  4788 consensus_queue.cc:237] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:31.069195  3731 raft_consensus.cc:1275] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 6 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:31.077639  4824 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:31.095072  3804 raft_consensus.cc:1275] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 6 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:31.094269  3483 catalog_manager.cc:5697] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.099390  4895 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:31.142742  3658 raft_consensus.cc:1275] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:31.145406  4895 consensus_queue.cc:1048] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:26:31.155821  3658 raft_consensus.cc:1275] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.159468  4761 consensus_queue.cc:1048] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.202462  3805 raft_consensus.cc:1275] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.204787  4788 consensus_queue.cc:1048] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.208364  3658 raft_consensus.cc:1275] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.211154  4788 consensus_queue.cc:1048] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.224414  3811 raft_consensus.cc:1275] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.227479  4761 consensus_queue.cc:1048] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.456875  3663 raft_consensus.cc:1275] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.465399  4788 consensus_queue.cc:1048] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.492765  3811 raft_consensus.cc:1275] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.498219  4788 consensus_queue.cc:1048] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:31.503252  3663 raft_consensus.cc:1275] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:31.505409  4895 consensus_queue.cc:1048] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.517917  3731 raft_consensus.cc:1275] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Refusing update from remote peer b06c1f1461ec46289edf63122a5863ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:31.546413  4922 consensus_queue.cc:1048] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.727767 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.806767  4427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6abb36e32e6d4008818136af56869542"
dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
mode: GRACEFUL
new_leader_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:57210
I20260709 12:26:31.807441  4427 raft_consensus.cc:606] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Received request to transfer leadership to TS 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:31.810235  3811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:31.810796  3811 raft_consensus.cc:606] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Received request to transfer leadership to TS ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:31.814821  3811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:31.815342  3811 raft_consensus.cc:606] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Received request to transfer leadership to TS 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:31.818226  3811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d"
dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
mode: GRACEFUL
new_leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
 from {username='slave'} at 127.0.0.1:54802
I20260709 12:26:31.818638  3811 raft_consensus.cc:606] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Received request to transfer leadership to TS ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:31.819658 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:31.820796 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:31.821432 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.901599  4809 raft_consensus.cc:993] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:31.902168  4938 raft_consensus.cc:1081] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Signalling peer 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:31.903913  3730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95"
dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:26:31.904477  3730 raft_consensus.cc:493] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.904857  3730 raft_consensus.cc:3060] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.912269  3730 raft_consensus.cc:515] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:31.914636  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:31.915211  3811 raft_consensus.cc:3055] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:31.915509  3811 raft_consensus.cc:740] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:31.917845  3811 consensus_queue.cc:260] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:31.918898  3811 raft_consensus.cc:3060] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.925915  3730 leader_election.cc:290] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:31.926875  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9174b8f24cdc43588daa58f89f3e0b95" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:31.927604  4427 raft_consensus.cc:3060] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.930647  3811 raft_consensus.cc:2468] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:31.932080  3702 leader_election.cc:304] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:31.932906  4960 raft_consensus.cc:2804] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:31.933450  4960 raft_consensus.cc:697] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:31.934373  4960 consensus_queue.cc:237] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:31.935968  4427 raft_consensus.cc:2468] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 2.
I20260709 12:26:31.945387  3483 catalog_manager.cc:5697] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 1 to 2, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 2 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.092563  4968 raft_consensus.cc:993] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower ea17b2b4fe5a4a33b586dd908fd673ce to start an election
I20260709 12:26:32.093109  4605 raft_consensus.cc:1081] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Signalling peer ea17b2b4fe5a4a33b586dd908fd673ce to start an election
I20260709 12:26:32.094755  3656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d"
dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
 from {username='slave'} at 127.0.0.1:55548
I20260709 12:26:32.095353  3656 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.095703  3656 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.103322  3656 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:32.106317  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:32.106498  4427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40efc51adc448f18f9e55927e61618d" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:32.106928  3807 raft_consensus.cc:3055] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.107187  4427 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.107458  3807 raft_consensus.cc:740] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:32.108353  3807 consensus_queue.cc:260] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:32.109928  3807 raft_consensus.cc:3060] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.117086  3656 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:32.119357  3807 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 4.
I20260709 12:26:32.121166  3628 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:32.123288  4811 raft_consensus.cc:2804] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:32.123409  4427 raft_consensus.cc:2468] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 4.
I20260709 12:26:32.123874  4811 raft_consensus.cc:697] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:32.124781  4811 consensus_queue.cc:237] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:32.147392  3483 catalog_manager.cc:5697] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 3 to 4, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 4 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.188081  4922 raft_consensus.cc:993] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba: : Instructing follower 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:32.188616  4922 raft_consensus.cc:1081] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Signalling peer 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:32.190513  3731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6abb36e32e6d4008818136af56869542"
dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:41918
I20260709 12:26:32.191080  3731 raft_consensus.cc:493] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.191419  3731 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.199707  3731 raft_consensus.cc:515] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:32.201630  3731 leader_election.cc:290] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Requested vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:32.202243  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:32.202539  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6abb36e32e6d4008818136af56869542" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:32.202944  4462 raft_consensus.cc:3055] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.203176  3656 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.203291  4462 raft_consensus.cc:740] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b06c1f1461ec46289edf63122a5863ba, State: Running, Role: LEADER
I20260709 12:26:32.204185  4462 consensus_queue.cc:260] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:32.205349  4462 raft_consensus.cc:3060] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.211959  3656 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 4.
I20260709 12:26:32.214475  3703 leader_election.cc:304] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:32.215410  4788 raft_consensus.cc:2804] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:32.216560  4788 raft_consensus.cc:697] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:32.217348  4462 raft_consensus.cc:2468] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 4.
I20260709 12:26:32.218019  4788 consensus_queue.cc:237] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:32.227885  3483 catalog_manager.cc:5697] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 3 to 4, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 4 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.343492  4605 raft_consensus.cc:993] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: : Instructing follower ea17b2b4fe5a4a33b586dd908fd673ce to start an election
I20260709 12:26:32.344025  4605 raft_consensus.cc:1081] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Signalling peer ea17b2b4fe5a4a33b586dd908fd673ce to start an election
I20260709 12:26:32.345579  3663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9"
dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
 from {username='slave'} at 127.0.0.1:55548
I20260709 12:26:32.346115  3663 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.346443  3663 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.351197  3663 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:32.353770  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:32.353788  3663 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 5 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:32.354107  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0f0423423342ecbdfe71d740533bf9" candidate_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b06c1f1461ec46289edf63122a5863ba"
I20260709 12:26:32.354698  3807 raft_consensus.cc:3055] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:32.355943  3807 raft_consensus.cc:740] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:32.356694  4462 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.356762  3807 consensus_queue.cc:260] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:32.358266  3807 raft_consensus.cc:3060] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.365298  4462 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 5.
I20260709 12:26:32.366339  3807 raft_consensus.cc:2468] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea17b2b4fe5a4a33b586dd908fd673ce in term 5.
I20260709 12:26:32.366420  3627 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce; no voters: 
I20260709 12:26:32.367390  4811 raft_consensus.cc:2804] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:32.367911  4811 raft_consensus.cc:697] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 LEADER]: Becoming Leader. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:32.368738  4811 consensus_queue.cc:237] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:32.379748  3483 catalog_manager.cc:5697] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce reported cstate change: term changed from 4 to 5, leader changed from 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4) to ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2). New cstate: current_term: 5 leader_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.508013  4427 raft_consensus.cc:1275] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.509150  4811 consensus_queue.cc:1048] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.530503  3807 raft_consensus.cc:1275] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.531944  4971 consensus_queue.cc:1048] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.542603  4427 raft_consensus.cc:1275] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:32.544628  4788 consensus_queue.cc:1048] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:32.564661  3807 raft_consensus.cc:1275] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:32.566406  4976 consensus_queue.cc:1048] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.653417  4427 raft_consensus.cc:1275] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:32.654608  4986 consensus_queue.cc:1048] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:32.684115  3663 raft_consensus.cc:1275] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:32.685812  4986 consensus_queue.cc:1048] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:32.854108 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:32.888808  3807 raft_consensus.cc:1275] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:32.890308  4971 consensus_queue.cc:1048] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:32.906157  4427 raft_consensus.cc:1275] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Refusing update from remote peer ea17b2b4fe5a4a33b586dd908fd673ce: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:32.910501  4971 consensus_queue.cc:1048] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:32.927364  3663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928"
dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
mode: GRACEFUL
new_leader_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:47754
I20260709 12:26:32.927982  3663 raft_consensus.cc:606] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Received request to transfer leadership to TS 98dcd37d8895403d96ceb94f8c67412a
I20260709 12:26:32.929446 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:32.931085 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:32.931860 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.112573  4992 raft_consensus.cc:993] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce: : Instructing follower 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:33.113065  4993 raft_consensus.cc:1081] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Signalling peer 98dcd37d8895403d96ceb94f8c67412a to start an election
I20260709 12:26:33.115854  3730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928"
dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
 from {username='slave'} at 127.0.0.1:35932
I20260709 12:26:33.116797  3730 raft_consensus.cc:493] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.117168  3730 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.124343  3730 raft_consensus.cc:515] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:33.128082  3658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce"
I20260709 12:26:33.128185  3807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80f5bd7b84f64e9c9817b9f7cfbe9928" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:33.128695  3658 raft_consensus.cc:3055] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.128785  3807 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.129112  3658 raft_consensus.cc:740] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ea17b2b4fe5a4a33b586dd908fd673ce, State: Running, Role: LEADER
I20260709 12:26:33.131584  3658 consensus_queue.cc:260] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:33.132723  3658 raft_consensus.cc:3060] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.136826  3730 leader_election.cc:290] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:33.138481  3807 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 4.
I20260709 12:26:33.139765  3702 leader_election.cc:304] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:33.141101  4788 raft_consensus.cc:2804] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:33.141541  4788 raft_consensus.cc:697] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:33.142252  4788 consensus_queue.cc:237] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:33.153556  3658 raft_consensus.cc:2468] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 4.
I20260709 12:26:33.167598  3487 catalog_manager.cc:5697] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 3 to 4, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 4 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.600695  3658 raft_consensus.cc:1275] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.602346  4998 consensus_queue.cc:1048] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:33.602546  3807 raft_consensus.cc:1275] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.604319  4976 consensus_queue.cc:1048] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:34.031915 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:34.076299 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:34.077617 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:34.078251 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:34.129372 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:34.179452 29732 tablet_server.cc:179] TabletServer@127.29.9.1:37069 shutting down...
W20260709 12:26:34.209558  3627 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:26:34.214537  3627 consensus_peers.cc:597] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.217458  3775 consensus_peers.cc:597] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.237787 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:34.243614 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.244910 29732 raft_consensus.cc:2243] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.245482 29732 raft_consensus.cc:2272] T 93135771a5a14169b53fb7a726a9ce2e P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.250125 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.251089 29732 raft_consensus.cc:2243] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.251665 29732 raft_consensus.cc:2272] T 67cdf8ac45ef43ee978cae31e085a9c3 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.254408 29732 tablet_replica.cc:333] stopping tablet replica
W20260709 12:26:34.255092  3775 consensus_peers.cc:597] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.255362 29732 raft_consensus.cc:2243] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.256093 29732 raft_consensus.cc:2272] T 5ddc19e80d1e47bf9adba05e63b9c08f P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.258909 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.267976 29732 raft_consensus.cc:2243] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.268630 29732 raft_consensus.cc:2272] T 546aeeaf20fb480bb5956ba5dc611e07 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.270072  3701 consensus_peers.cc:597] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.271508 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.272518 29732 raft_consensus.cc:2243] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.273029 29732 raft_consensus.cc:2272] T f54877140907478b8976ce4a6698da2e P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.275816 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.276635 29732 raft_consensus.cc:2243] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.277643 29732 raft_consensus.cc:2272] T 67c7c476412c475ea0783cadfd0ce30c P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.280511 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.281339 29732 raft_consensus.cc:2243] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.282291 29732 raft_consensus.cc:2272] T c09f7a90ab1c4f1b903c1c9b34494a93 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.284842 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.285707 29732 raft_consensus.cc:2243] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.286221 29732 raft_consensus.cc:2272] T 0e54ed26c20349f49856c2fcbc57dfdd P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.289119 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.289829 29732 raft_consensus.cc:2243] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.290264 29732 raft_consensus.cc:2272] T 03376bd538eb41c399158480df7d762a P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.292783 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.293486 29732 raft_consensus.cc:2243] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.293946 29732 raft_consensus.cc:2272] T 6abb36e32e6d4008818136af56869542 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.296356 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.297206 29732 raft_consensus.cc:2243] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.297757 29732 raft_consensus.cc:2272] T b52a9fcd5d784adaa61ed8592e34820a P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.300328 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.301017 29732 raft_consensus.cc:2243] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.301543 29732 raft_consensus.cc:2272] T 7269c445625d4453bc9b0c141c5fb9c9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.304011 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.304752 29732 raft_consensus.cc:2243] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.305202 29732 raft_consensus.cc:2272] T ac829ea617614c26806da188940d398d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.307914 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.308598 29732 raft_consensus.cc:2243] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.309649 29732 raft_consensus.cc:2272] T a8d333d5c60842c09b47c5f9bbf9df39 P b06c1f1461ec46289edf63122a5863ba [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.312084 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.312767 29732 raft_consensus.cc:2243] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.313199 29732 raft_consensus.cc:2272] T 96dca18b7eac43e78683c65edac5c3bc P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.315768 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.316816 29732 raft_consensus.cc:2243] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.317310 29732 raft_consensus.cc:2272] T 44d49c090caa4686add867d8afd82314 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.317579  3701 consensus_peers.cc:597] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.320037 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.320966 29732 raft_consensus.cc:2243] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.321499 29732 raft_consensus.cc:2272] T 22aa1145b1384ae3a8fa929b5bbcfc19 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.324582 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.325342 29732 raft_consensus.cc:2243] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.325788 29732 raft_consensus.cc:2272] T 9dfc6756ea0e486d869252fd8f102411 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.328388 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.329151 29732 raft_consensus.cc:2243] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.330106 29732 raft_consensus.cc:2272] T 8fb7c71c819749338585b76d644d3a94 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.332805 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.333570 29732 raft_consensus.cc:2243] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.334012 29732 raft_consensus.cc:2272] T d4576aeb4fdf46b0ab7c91d7b4389291 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.336508 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.337272 29732 raft_consensus.cc:2243] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.338173 29732 raft_consensus.cc:2272] T fd7b1d038f32403881c972fd7d51e402 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.340685 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.341416 29732 raft_consensus.cc:2243] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.342334 29732 raft_consensus.cc:2272] T b17a4df1bf1a4a6192febd99cd97d5bb P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.344828 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.345594 29732 raft_consensus.cc:2243] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.346100 29732 raft_consensus.cc:2272] T f6816ad0fe10401d80c7d91e289708d6 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.349272 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.350040 29732 raft_consensus.cc:2243] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.350963 29732 raft_consensus.cc:2272] T 16f7ac680c52440fbb826622012945b7 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.353281  3701 consensus_peers.cc:597] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.354027 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.354877 29732 raft_consensus.cc:2243] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.355374 29732 raft_consensus.cc:2272] T b7f9d51f74f24d96a2aa074b6ed09f7a P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.357854 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.358572 29732 raft_consensus.cc:2243] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.359031 29732 raft_consensus.cc:2272] T a40efc51adc448f18f9e55927e61618d P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.361681 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.362450 29732 raft_consensus.cc:2243] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.362968 29732 raft_consensus.cc:2272] T 9174b8f24cdc43588daa58f89f3e0b95 P b06c1f1461ec46289edf63122a5863ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.365674 29732 tablet_replica.cc:333] stopping tablet replica
W20260709 12:26:34.366346  3775 consensus_peers.cc:597] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.366374 29732 raft_consensus.cc:2243] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.367182 29732 raft_consensus.cc:2272] T d9c8b4d97a9042d9b1a9a19db2bea177 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.369927 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.370640 29732 raft_consensus.cc:2243] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.371536 29732 raft_consensus.cc:2272] T 28797f7f5b4c4196b96911477adabf4d P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.374058 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.374786 29732 raft_consensus.cc:2243] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.375207 29732 raft_consensus.cc:2272] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.377712 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.378422 29732 raft_consensus.cc:2243] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.379371 29732 raft_consensus.cc:2272] T 6cfe10809994448c8380df975eff45a9 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.381839 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.382504 29732 raft_consensus.cc:2243] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.382947 29732 raft_consensus.cc:2272] T e13f07f4920e4b38816a3a22b807b9c2 P b06c1f1461ec46289edf63122a5863ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.385329 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.386014 29732 raft_consensus.cc:2243] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.386498 29732 raft_consensus.cc:2272] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.388887 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.389547 29732 raft_consensus.cc:2243] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.390110 29732 raft_consensus.cc:2272] T e70956e754284b1d94ac89b470281cca P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.392716 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.393457 29732 raft_consensus.cc:2243] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.394366 29732 raft_consensus.cc:2272] T b81d335504724d14bafd66069e9ab3f8 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.396811 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.397471 29732 raft_consensus.cc:2243] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.397953 29732 raft_consensus.cc:2272] T 6420cbab7b6a413bb6a9a3bdc07aa918 P b06c1f1461ec46289edf63122a5863ba [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.398731  3627 consensus_peers.cc:597] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.400923 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.401708 29732 raft_consensus.cc:2243] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.402218 29732 raft_consensus.cc:2272] T 3f126cd9dac7407c92dc21d66fc9e353 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.404687 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.405397 29732 raft_consensus.cc:2243] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.405879 29732 raft_consensus.cc:2272] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.406242  3627 consensus_peers.cc:597] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.408223 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.408994 29732 raft_consensus.cc:2243] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.409473 29732 raft_consensus.cc:2272] T 5afddbeb03a24c0c80391699d45e6520 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.411881 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.412515 29732 raft_consensus.cc:2243] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.413264 29732 raft_consensus.cc:2272] T ea70a27e95854669a0da5bb76b24e632 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.413439  3627 consensus_peers.cc:597] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.415905 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.416679 29732 raft_consensus.cc:2243] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.417200 29732 raft_consensus.cc:2272] T 7d0f0423423342ecbdfe71d740533bf9 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.419694 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.420382 29732 raft_consensus.cc:2243] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.421271 29732 raft_consensus.cc:2272] T b5581ff41a8b438693f2fd8942489f74 P b06c1f1461ec46289edf63122a5863ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.423652 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.424341 29732 raft_consensus.cc:2243] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.425217 29732 raft_consensus.cc:2272] T f48164492db145fda737e65bbfc255f5 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.427691 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.428333 29732 raft_consensus.cc:2243] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.429176 29732 raft_consensus.cc:2272] T fae0cee41d4341debb2be23519d02ca9 P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.431592 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:34.432183 29732 raft_consensus.cc:2243] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:26:34.432498  3627 consensus_peers.cc:597] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.433035 29732 raft_consensus.cc:2272] T 97832336db4b4e6099c905fe241f299c P b06c1f1461ec46289edf63122a5863ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.456737  3775 consensus_peers.cc:597] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.477695  3701 consensus_peers.cc:597] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.486758  3627 consensus_peers.cc:597] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.502188  3627 consensus_peers.cc:597] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.511310  3627 consensus_peers.cc:597] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.518680 29732 tablet_server.cc:196] TabletServer@127.29.9.1:37069 shutdown complete.
W20260709 12:26:34.526698  3701 consensus_peers.cc:597] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.539008  3627 consensus_peers.cc:597] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.561806  3627 consensus_peers.cc:597] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.585505  3701 consensus_peers.cc:597] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.591975  3701 consensus_peers.cc:597] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.597146  3775 consensus_peers.cc:597] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.600704  3775 consensus_peers.cc:597] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.602466  3701 consensus_peers.cc:597] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.614296 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
W20260709 12:26:34.623428  3777 consensus_peers.cc:597] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.641530  3703 consensus_peers.cc:597] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.648701  3627 consensus_peers.cc:597] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.650142  3777 consensus_peers.cc:597] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.655563  3627 consensus_peers.cc:597] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.680303  3777 consensus_peers.cc:597] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.691816  3703 consensus_peers.cc:597] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.696249  3775 consensus_peers.cc:597] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.707109  3701 consensus_peers.cc:597] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.720047 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:34.720770  3627 consensus_peers.cc:597] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.721114 29732 tablet_replica.cc:333] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.722066 29732 raft_consensus.cc:2243] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.723085 29732 raft_consensus.cc:2272] T e7588d8d55964d0b898b81d0d67ed9ec P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.725735 29732 tablet_replica.cc:333] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.726480 29732 raft_consensus.cc:2243] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.727012 29732 raft_consensus.cc:2272] T fae0cee41d4341debb2be23519d02ca9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.729434 29732 tablet_replica.cc:333] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.730275 29732 raft_consensus.cc:2243] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.730764 29732 raft_consensus.cc:2272] T c09f7a90ab1c4f1b903c1c9b34494a93 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.733188 29732 tablet_replica.cc:333] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.733911 29732 raft_consensus.cc:2243] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.734377 29732 raft_consensus.cc:2272] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.736807 29732 tablet_replica.cc:333] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.737506 29732 raft_consensus.cc:2243] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.738466 29732 raft_consensus.cc:2272] T 1968be972d704af08e92759ec0557c1e P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.741417 29732 tablet_replica.cc:333] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.742257 29732 raft_consensus.cc:2243] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.742723 29732 raft_consensus.cc:2272] T 0d268ccfd8994a26a344654a181b615d P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.744470  3775 consensus_peers.cc:597] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.745158 29732 tablet_replica.cc:333] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.746014 29732 raft_consensus.cc:2243] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.746546 29732 raft_consensus.cc:2272] T 3317f960c9084fd08c81267ec5ea37d6 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.749032 29732 tablet_replica.cc:333] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.749770 29732 raft_consensus.cc:2243] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.750278 29732 raft_consensus.cc:2272] T 6abb36e32e6d4008818136af56869542 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.752821 29732 tablet_replica.cc:333] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.753608 29732 raft_consensus.cc:2243] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.754088 29732 raft_consensus.cc:2272] T b81d335504724d14bafd66069e9ab3f8 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.756656 29732 tablet_replica.cc:333] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.757427 29732 raft_consensus.cc:2243] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.758339 29732 raft_consensus.cc:2272] T 6420cbab7b6a413bb6a9a3bdc07aa918 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.760793 29732 tablet_replica.cc:333] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.761533 29732 raft_consensus.cc:2243] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.762036 29732 raft_consensus.cc:2272] T 7269c445625d4453bc9b0c141c5fb9c9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.764326 29732 tablet_replica.cc:333] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.765059 29732 raft_consensus.cc:2243] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.765972 29732 raft_consensus.cc:2272] T ac829ea617614c26806da188940d398d P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.768430 29732 tablet_replica.cc:333] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.769164 29732 raft_consensus.cc:2243] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.770107 29732 raft_consensus.cc:2272] T b52a9fcd5d784adaa61ed8592e34820a P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.772603 29732 tablet_replica.cc:333] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.773283 29732 raft_consensus.cc:2243] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.773782 29732 raft_consensus.cc:2272] T fd7b1d038f32403881c972fd7d51e402 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.776258 29732 tablet_replica.cc:333] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.776979 29732 raft_consensus.cc:2243] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.777489 29732 raft_consensus.cc:2272] T 16f7ac680c52440fbb826622012945b7 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.779951 29732 tablet_replica.cc:333] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.780676 29732 raft_consensus.cc:2243] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.781147 29732 raft_consensus.cc:2272] T b17a4df1bf1a4a6192febd99cd97d5bb P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.781406  3703 consensus_peers.cc:597] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.783594 29732 tablet_replica.cc:333] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.784468 29732 raft_consensus.cc:2243] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.784982 29732 raft_consensus.cc:2272] T ea70a27e95854669a0da5bb76b24e632 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.787276 29732 tablet_replica.cc:333] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.788023 29732 raft_consensus.cc:2243] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.788512 29732 raft_consensus.cc:2272] T 0f6c49b7c4db4f3fa1f03c887186ee66 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.791049 29732 tablet_replica.cc:333] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.791819 29732 raft_consensus.cc:2243] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.792307 29732 raft_consensus.cc:2272] T 5afddbeb03a24c0c80391699d45e6520 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.794653 29732 tablet_replica.cc:333] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.795383 29732 raft_consensus.cc:2243] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.795898 29732 raft_consensus.cc:2272] T 87a16122c42b40248f485b77753956bc P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.798238 29732 tablet_replica.cc:333] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.798949 29732 raft_consensus.cc:2243] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.799912 29732 raft_consensus.cc:2272] T 44d49c090caa4686add867d8afd82314 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.802449 29732 tablet_replica.cc:333] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.803165 29732 raft_consensus.cc:2243] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.804104 29732 raft_consensus.cc:2272] T 22aa1145b1384ae3a8fa929b5bbcfc19 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.806581 29732 tablet_replica.cc:333] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.807325 29732 raft_consensus.cc:2243] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.807870 29732 raft_consensus.cc:2272] T b5581ff41a8b438693f2fd8942489f74 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.810302 29732 tablet_replica.cc:333] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.810990 29732 raft_consensus.cc:2243] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.811506 29732 raft_consensus.cc:2272] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.813946 29732 tablet_replica.cc:333] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.814640 29732 raft_consensus.cc:2243] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.815111 29732 raft_consensus.cc:2272] T f48164492db145fda737e65bbfc255f5 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.817459 29732 tablet_replica.cc:333] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.818125 29732 raft_consensus.cc:2243] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.819048 29732 raft_consensus.cc:2272] T 7d0f0423423342ecbdfe71d740533bf9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.821434 29732 tablet_replica.cc:333] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.822173 29732 raft_consensus.cc:2243] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.822649 29732 raft_consensus.cc:2272] T 01be9c8eac8b49f581ef991385b23996 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.825107 29732 tablet_replica.cc:333] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.825819 29732 raft_consensus.cc:2243] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.826719 29732 raft_consensus.cc:2272] T d9c8b4d97a9042d9b1a9a19db2bea177 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.829169 29732 tablet_replica.cc:333] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.829880 29732 raft_consensus.cc:2243] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.830374 29732 raft_consensus.cc:2272] T 4399494b9fc14dc7989c328e016df504 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.831113  3777 consensus_peers.cc:597] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.832726 29732 tablet_replica.cc:333] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.833549 29732 raft_consensus.cc:2243] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.834084 29732 raft_consensus.cc:2272] T 28797f7f5b4c4196b96911477adabf4d P ea17b2b4fe5a4a33b586dd908fd673ce [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.836618 29732 tablet_replica.cc:333] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.837327 29732 raft_consensus.cc:2243] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.837831 29732 raft_consensus.cc:2272] T e29a6aaafab344e1b9259bb9803dba3e P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.840272 29732 tablet_replica.cc:333] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.840966 29732 raft_consensus.cc:2243] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.841440 29732 raft_consensus.cc:2272] T fafdf9490c1f4d9b919cee9883ba04fd P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.843820 29732 tablet_replica.cc:333] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.844528 29732 raft_consensus.cc:2243] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.845436 29732 raft_consensus.cc:2272] T a40efc51adc448f18f9e55927e61618d P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.847790 29732 tablet_replica.cc:333] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.848464 29732 raft_consensus.cc:2243] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.848934 29732 raft_consensus.cc:2272] T 99e2aa65e5fc4e0c9ba2625fea02a731 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.851353 29732 tablet_replica.cc:333] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.852049 29732 raft_consensus.cc:2243] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.852564 29732 raft_consensus.cc:2272] T 67c7c476412c475ea0783cadfd0ce30c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.854576  3777 consensus_peers.cc:597] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.854959 29732 tablet_replica.cc:333] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.855769 29732 raft_consensus.cc:2243] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.856262 29732 raft_consensus.cc:2272] T 9dfc6756ea0e486d869252fd8f102411 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.858711 29732 tablet_replica.cc:333] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.859382 29732 raft_consensus.cc:2243] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.859897 29732 raft_consensus.cc:2272] T 6cfe10809994448c8380df975eff45a9 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.862533 29732 tablet_replica.cc:333] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.863201 29732 raft_consensus.cc:2243] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.864171 29732 raft_consensus.cc:2272] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P ea17b2b4fe5a4a33b586dd908fd673ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.866595 29732 tablet_replica.cc:333] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.867231 29732 raft_consensus.cc:2243] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.868139 29732 raft_consensus.cc:2272] T e13f07f4920e4b38816a3a22b807b9c2 P ea17b2b4fe5a4a33b586dd908fd673ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.870510 29732 tablet_replica.cc:333] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.871160 29732 raft_consensus.cc:2243] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.872152 29732 raft_consensus.cc:2272] T 67cdf8ac45ef43ee978cae31e085a9c3 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.874470 29732 tablet_replica.cc:333] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.875074 29732 raft_consensus.cc:2243] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.875560 29732 raft_consensus.cc:2272] T a07c0d79152646f8aea06f98ab72cc07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.877930 29732 tablet_replica.cc:333] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.878535 29732 raft_consensus.cc:2243] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.879429 29732 raft_consensus.cc:2272] T 546aeeaf20fb480bb5956ba5dc611e07 P ea17b2b4fe5a4a33b586dd908fd673ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.881908 29732 tablet_replica.cc:333] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.882565 29732 raft_consensus.cc:2243] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:34.883469 29732 raft_consensus.cc:2272] T 3f126cd9dac7407c92dc21d66fc9e353 P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.885960 29732 tablet_replica.cc:333] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce: stopping tablet replica
I20260709 12:26:34.886579 29732 raft_consensus.cc:2243] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.887068 29732 raft_consensus.cc:2272] T 97832336db4b4e6099c905fe241f299c P ea17b2b4fe5a4a33b586dd908fd673ce [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:34.892223  3703 consensus_peers.cc:597] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.925414  3777 consensus_peers.cc:597] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.962829  3703 consensus_peers.cc:597] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:34.980993  3703 consensus_peers.cc:597] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:35.016742  3777 consensus_peers.cc:597] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:35.026575  3777 consensus_peers.cc:597] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:35.031826  3703 consensus_peers.cc:597] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:35.070533  3703 consensus_peers.cc:597] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.292835  4976 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.293386  4976 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:35.295491  4976 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:35.296211  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:35.300544  3701 leader_election.cc:336] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.300957  3701 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:35.301617  4976 raft_consensus.cc:2749] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:35.370038  5020 raft_consensus.cc:493] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.370575  5020 raft_consensus.cc:515] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.372774  5020 leader_election.cc:290] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.375691  3701 leader_election.cc:336] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:35.379863  3703 leader_election.cc:336] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:35.380275  3703 leader_election.cc:304] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.380937  5020 raft_consensus.cc:2749] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:35.455197  5017 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.455708  5017 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:35.457715  5017 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:35.458387  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
W20260709 12:26:35.463578  3775 leader_election.cc:336] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.464046  3775 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:35.464751  5017 raft_consensus.cc:2749] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.475927  5017 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.476333  5017 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:35.478404  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:35.478520  5017 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:35.479009  3730 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 6.
I20260709 12:26:35.480172  3778 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:35.481705  4605 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:35.482043  4605 raft_consensus.cc:493] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.482355  4605 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:35.490036  3775 leader_election.cc:336] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.491235  4605 raft_consensus.cc:515] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:35.492877  4605 leader_election.cc:290] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 7 election: Requested vote from peers 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
W20260709 12:26:35.496934  3775 leader_election.cc:336] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.498032  3730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d333d5c60842c09b47c5f9bbf9df39" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:35.498591  3730 raft_consensus.cc:3060] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:35.504331  3730 raft_consensus.cc:2468] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 7.
I20260709 12:26:35.505156  3778 leader_election.cc:304] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:35.505705  4605 raft_consensus.cc:2804] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:35.506104  4605 raft_consensus.cc:697] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 7 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:35.506737  4605 consensus_queue.cc:237] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:35.509123  5017 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.509603  5017 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:35.512349  5017 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.516090  3775 leader_election.cc:336] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.516378  3483 catalog_manager.cc:5697] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 6 to 7, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 7 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:35.517540  3777 leader_election.cc:336] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:35.517963  3777 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.518630  5017 raft_consensus.cc:2749] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.540544  4976 raft_consensus.cc:493] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.541042  4976 raft_consensus.cc:515] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.542695  4976 leader_election.cc:290] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.546744  3703 leader_election.cc:336] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.547322  3701 leader_election.cc:336] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.547747  3701 leader_election.cc:304] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.548276  4976 raft_consensus.cc:2749] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:35.588958  4998 raft_consensus.cc:493] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.589529  4998 raft_consensus.cc:515] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.591573  4998 leader_election.cc:290] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.595757  3703 leader_election.cc:336] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.596269  3701 leader_election.cc:336] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.596681  3701 leader_election.cc:304] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.597397  4998 raft_consensus.cc:2749] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:35.606000  4998 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.606421  4998 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:35.608165  4998 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:35.608736  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:35.609392  3811 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:35.610472  3702 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:35.611457  5021 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.611892  5021 raft_consensus.cc:493] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.612231  5021 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:35.612703  3701 leader_election.cc:336] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.620894  5021 raft_consensus.cc:515] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
I20260709 12:26:35.623539  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb7c71c819749338585b76d644d3a94" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:35.623046  5021 leader_election.cc:290] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Requested vote from peers 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093), b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069)
I20260709 12:26:35.624135  3811 raft_consensus.cc:3060] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:35.626431  3701 leader_election.cc:336] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.631574  3811 raft_consensus.cc:2468] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 4.
I20260709 12:26:35.639585  4809 raft_consensus.cc:493] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.639815  3702 leader_election.cc:304] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba
I20260709 12:26:35.640430  4809 raft_consensus.cc:515] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:35.642581  4809 leader_election.cc:290] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:35.644863  4976 raft_consensus.cc:2804] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:35.645397  4976 raft_consensus.cc:697] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:35.646169  4976 consensus_queue.cc:237] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } }
W20260709 12:26:35.655689  3777 leader_election.cc:336] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.656833  3775 leader_election.cc:336] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.657330  3775 leader_election.cc:304] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.658598  4809 raft_consensus.cc:2749] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.668490  3483 catalog_manager.cc:5697] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 3 to 4, leader changed from b06c1f1461ec46289edf63122a5863ba (127.29.9.1) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 4 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.671887  4809 raft_consensus.cc:493] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.672487  4809 raft_consensus.cc:515] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:35.674803  4809 leader_election.cc:290] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.680332  3777 leader_election.cc:336] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.681859  3775 leader_election.cc:336] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.682343  3775 leader_election.cc:304] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.682969  4809 raft_consensus.cc:2749] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:35.694325  5020 raft_consensus.cc:493] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.694787  5020 raft_consensus.cc:515] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.696379  5020 leader_election.cc:290] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.700434  3703 leader_election.cc:336] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.703255  3701 leader_election.cc:336] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.703677  3701 leader_election.cc:304] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.704377  5020 raft_consensus.cc:2749] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.706540  5020 raft_consensus.cc:493] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.706998  5020 raft_consensus.cc:515] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.712270  5020 leader_election.cc:290] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.713052  3703 leader_election.cc:336] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.716307  3701 leader_election.cc:336] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.717010  3701 leader_election.cc:304] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.717623  5020 raft_consensus.cc:2749] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.739039  4809 raft_consensus.cc:493] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.739509  4809 raft_consensus.cc:515] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:35.741041  4809 leader_election.cc:290] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.744727  3777 leader_election.cc:336] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.745489  3775 leader_election.cc:336] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.745891  5020 raft_consensus.cc:493] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.745949  3775 leader_election.cc:304] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.746923  4809 raft_consensus.cc:2749] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.746697  5020 raft_consensus.cc:515] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.748682  5020 leader_election.cc:290] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.752560  3701 leader_election.cc:336] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:35.752951  3703 leader_election.cc:336] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:35.753364  3703 leader_election.cc:304] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.753980  5020 raft_consensus.cc:2749] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.785671  4809 raft_consensus.cc:493] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.786161  4809 raft_consensus.cc:515] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:35.787906  4809 leader_election.cc:290] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.793846  3777 leader_election.cc:336] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.794713  3775 leader_election.cc:336] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.795130  3775 leader_election.cc:304] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.796411  4605 raft_consensus.cc:2749] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.849680  4809 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:35.850281  4809 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:35.853876  4998 raft_consensus.cc:493] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:35.854064  4809 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:35.854470  4998 raft_consensus.cc:515] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.854893  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:35.858691  4998 leader_election.cc:290] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.859220  3777 leader_election.cc:336] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:35.859692  3777 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: 98dcd37d8895403d96ceb94f8c67412a, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.860980  4605 raft_consensus.cc:2749] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:35.863222  3703 leader_election.cc:336] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.866345  3701 leader_election.cc:336] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.866789  3701 leader_election.cc:304] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.867781  4998 raft_consensus.cc:2749] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.870306  4809 raft_consensus.cc:493] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.870740  4809 raft_consensus.cc:515] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:35.872213  4809 leader_election.cc:290] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.875626  3777 leader_election.cc:336] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.876151  3775 leader_election.cc:336] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.876577  3775 leader_election.cc:304] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.877218  4809 raft_consensus.cc:2749] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.892181  4998 raft_consensus.cc:493] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:35.892760  4998 raft_consensus.cc:515] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:35.894716  4998 leader_election.cc:290] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.898386  3703 leader_election.cc:336] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:35.898869  3701 leader_election.cc:336] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:35.899252  3701 leader_election.cc:304] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.899906  4998 raft_consensus.cc:2749] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:35.907675  5020 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:35.908226  5020 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:35.910137  5020 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:35.911501  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
W20260709 12:26:35.914515  3703 leader_election.cc:336] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:35.914837  3703 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: 3c78ef175c2d468993c1cb82527bef05, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.915347  5020 raft_consensus.cc:2749] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:35.973023 29732 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3685)
I20260709 12:26:35.989301  4809 raft_consensus.cc:493] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:35.989868  4809 raft_consensus.cc:515] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:35.991673  4809 leader_election.cc:290] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:35.994926  3775 leader_election.cc:336] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:35.996387  3777 leader_election.cc:336] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:35.996696  3777 leader_election.cc:304] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:35.997224  4809 raft_consensus.cc:2749] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:36.000511  5020 raft_consensus.cc:493] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.000949  5020 raft_consensus.cc:515] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:36.002452  5020 leader_election.cc:290] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.006239  3701 leader_election.cc:336] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.006661  3703 leader_election.cc:336] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.007068  3703 leader_election.cc:304] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.007674  5020 raft_consensus.cc:2749] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:36.008307  4809 raft_consensus.cc:493] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.008790  4809 raft_consensus.cc:515] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:36.010519  4809 leader_election.cc:290] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.014083  3775 leader_election.cc:336] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.014658  3777 leader_election.cc:336] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.015147  3777 leader_election.cc:304] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.015818  4809 raft_consensus.cc:2749] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:36.016068  3775 consensus_peers.cc:597] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.034464  5020 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.034976  5020 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:36.037024  5020 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:36.038017  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05" is_pre_election: true
I20260709 12:26:36.038655  3811 raft_consensus.cc:2468] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 3.
I20260709 12:26:36.039566  3702 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
W20260709 12:26:36.040087  3703 leader_election.cc:336] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.040334  5020 raft_consensus.cc:2804] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.040748  5020 raft_consensus.cc:493] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.041080  5020 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.048118  5020 raft_consensus.cc:515] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:36.049993  5020 leader_election.cc:290] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4:37093)
I20260709 12:26:36.050889  3811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7588d8d55964d0b898b81d0d67ed9ec" candidate_uuid: "98dcd37d8895403d96ceb94f8c67412a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3c78ef175c2d468993c1cb82527bef05"
I20260709 12:26:36.052488  3811 raft_consensus.cc:3060] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.057050  3736 raft_consensus.cc:1275] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 7 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:26:36.058171  3703 leader_election.cc:336] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.059289  5018 consensus_queue.cc:1048] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:36.061178  3811 raft_consensus.cc:2468] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98dcd37d8895403d96ceb94f8c67412a in term 4.
I20260709 12:26:36.062820  3702 leader_election.cc:304] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.064296  4998 raft_consensus.cc:2804] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:36.064770  4998 raft_consensus.cc:697] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Becoming Leader. State: Replica: 98dcd37d8895403d96ceb94f8c67412a, State: Running, Role: LEADER
I20260709 12:26:36.065784  4998 consensus_queue.cc:237] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:36.083839  3483 catalog_manager.cc:5697] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a reported cstate change: term changed from 3 to 4, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3). New cstate: current_term: 4 leader_uuid: "98dcd37d8895403d96ceb94f8c67412a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.108062  4605 raft_consensus.cc:493] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.108662  4605 raft_consensus.cc:515] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:36.112417  4605 leader_election.cc:290] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.114550  3775 leader_election.cc:336] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.116219  3777 leader_election.cc:336] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.116637  3777 leader_election.cc:304] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.117274  4605 raft_consensus.cc:2749] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:36.117784  4809 raft_consensus.cc:493] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.118211  4809 raft_consensus.cc:515] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:36.119562  4809 leader_election.cc:290] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.125809  3777 leader_election.cc:336] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:36.127350  3775 leader_election.cc:336] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:36.127764  3775 leader_election.cc:304] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.128304  4809 raft_consensus.cc:2749] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.151872  4809 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.152374  4809 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:36.154278  4809 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:36.155191  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a" is_pre_election: true
I20260709 12:26:36.155763  3736 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 3.
I20260709 12:26:36.156769  3778 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: 
I20260709 12:26:36.157543  4809 raft_consensus.cc:2804] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.157872  4809 raft_consensus.cc:493] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.158179  4809 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:36.158617  3777 leader_election.cc:336] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:36.166441  3701 consensus_peers.cc:597] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.166587  4809 raft_consensus.cc:515] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:36.168426  4809 leader_election.cc:290] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 election: Requested vote from peers ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615), 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167)
I20260709 12:26:36.169412  3736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1968be972d704af08e92759ec0557c1e" candidate_uuid: "3c78ef175c2d468993c1cb82527bef05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "98dcd37d8895403d96ceb94f8c67412a"
I20260709 12:26:36.169988  3736 raft_consensus.cc:3060] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.170140  4809 raft_consensus.cc:493] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
W20260709 12:26:36.172149  3777 leader_election.cc:336] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.177294  3736 raft_consensus.cc:2468] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c78ef175c2d468993c1cb82527bef05 in term 4.
I20260709 12:26:36.178339  3778 leader_election.cc:304] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05, 98dcd37d8895403d96ceb94f8c67412a; no voters: ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.179544  4605 raft_consensus.cc:2804] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:36.170747  4809 raft_consensus.cc:515] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:36.181371  4605 raft_consensus.cc:697] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Becoming Leader. State: Replica: 3c78ef175c2d468993c1cb82527bef05, State: Running, Role: LEADER
I20260709 12:26:36.182183  4605 consensus_queue.cc:237] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } }
I20260709 12:26:36.183909  4809 leader_election.cc:290] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.185314  3775 leader_election.cc:336] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.190469  3777 leader_election.cc:336] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.190866  3777 leader_election.cc:304] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.191387  4605 raft_consensus.cc:2749] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.195627  3483 catalog_manager.cc:5697] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 reported cstate change: term changed from 3 to 4, leader changed from ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2) to 3c78ef175c2d468993c1cb82527bef05 (127.29.9.4). New cstate: current_term: 4 leader_uuid: "3c78ef175c2d468993c1cb82527bef05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.256609  4998 raft_consensus.cc:493] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.257025  4998 raft_consensus.cc:515] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:36.257665  4605 raft_consensus.cc:493] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.258209  4605 raft_consensus.cc:515] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:36.258939  4998 leader_election.cc:290] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:36.261555  4605 leader_election.cc:290] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.264875  3775 leader_election.cc:336] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.265362  3701 leader_election.cc:336] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.267109  3703 leader_election.cc:336] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.267437  3703 leader_election.cc:304] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
W20260709 12:26:36.268074  3777 leader_election.cc:336] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.268092  4998 raft_consensus.cc:2749] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.268767  3777 leader_election.cc:304] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.269488  4809 raft_consensus.cc:2749] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.270856  3807 raft_consensus.cc:1275] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:36.271960  4809 raft_consensus.cc:493] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.272043  4998 consensus_queue.cc:1048] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.272303  4809 raft_consensus.cc:515] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:36.273808  4809 leader_election.cc:290] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.278187  3775 leader_election.cc:336] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.280782  3777 leader_election.cc:336] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.281165  3777 leader_election.cc:304] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.282380  4809 raft_consensus.cc:2749] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:36.304003  4998 raft_consensus.cc:493] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.304484  4998 raft_consensus.cc:515] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:36.305241  5020 raft_consensus.cc:493] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.305757  5020 raft_consensus.cc:515] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } } peers { permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 } }
I20260709 12:26:36.306372  4998 leader_election.cc:290] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
I20260709 12:26:36.307672  5020 leader_election.cc:290] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.311380  3703 leader_election.cc:336] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:36.311852  3701 leader_election.cc:336] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:36.311885  3703 leader_election.cc:336] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:36.312227  3701 leader_election.cc:304] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.312832  5020 raft_consensus.cc:2749] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:36.312983  3701 leader_election.cc:336] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:36.313433  3701 leader_election.cc:304] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98dcd37d8895403d96ceb94f8c67412a; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.313932  5020 raft_consensus.cc:2749] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.361356  4605 raft_consensus.cc:493] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ea17b2b4fe5a4a33b586dd908fd673ce)
I20260709 12:26:36.361855  4605 raft_consensus.cc:515] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:36.364251  4605 leader_election.cc:290] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:36.370417  3777 leader_election.cc:336] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
W20260709 12:26:36.372251  3775 leader_election.cc:336] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
I20260709 12:26:36.372716  3775 leader_election.cc:304] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:36.373430  4809 raft_consensus.cc:2749] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.502576  3807 raft_consensus.cc:1275] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Refusing update from remote peer 98dcd37d8895403d96ceb94f8c67412a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:36.503763  5020 consensus_queue.cc:1048] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:36.520442  3703 consensus_peers.cc:597] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.579628  3736 raft_consensus.cc:1275] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Refusing update from remote peer 3c78ef175c2d468993c1cb82527bef05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:36.581103  4809 consensus_queue.cc:1048] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98dcd37d8895403d96ceb94f8c67412a" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 35167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:36.598112  3777 consensus_peers.cc:597] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:36.599742  3775 consensus_peers.cc:597] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.657570  3701 consensus_peers.cc:597] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.714476  3775 consensus_peers.cc:597] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.748175  3777 consensus_peers.cc:597] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.761103  3701 consensus_peers.cc:597] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.823172 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
W20260709 12:26:36.836550  3775 consensus_peers.cc:597] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.841904  3775 consensus_peers.cc:597] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.895397 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
W20260709 12:26:36.904422  3778 consensus_peers.cc:597] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.928293 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:36.929046 29732 tablet_replica.cc:333] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.929616 29732 raft_consensus.cc:2243] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.930367 29732 raft_consensus.cc:2272] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.932297 29732 tablet_replica.cc:333] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.932859 29732 raft_consensus.cc:2243] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.933271 29732 raft_consensus.cc:2272] T 6cfe10809994448c8380df975eff45a9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.935137 29732 tablet_replica.cc:333] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.935811 29732 raft_consensus.cc:2243] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.936355 29732 raft_consensus.cc:2272] T 0e54ed26c20349f49856c2fcbc57dfdd P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:36.938045  3778 consensus_peers.cc:597] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.938810 29732 tablet_replica.cc:333] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
W20260709 12:26:36.939248  3778 consensus_peers.cc:597] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.939484 29732 raft_consensus.cc:2243] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.939985 29732 raft_consensus.cc:2272] T c09f7a90ab1c4f1b903c1c9b34494a93 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.941748 29732 tablet_replica.cc:333] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.942273 29732 raft_consensus.cc:2243] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.943053 29732 raft_consensus.cc:2272] T e7588d8d55964d0b898b81d0d67ed9ec P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.944999 29732 tablet_replica.cc:333] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.945508 29732 raft_consensus.cc:2243] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.945887 29732 raft_consensus.cc:2272] T 03376bd538eb41c399158480df7d762a P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.947499 29732 tablet_replica.cc:333] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.948033 29732 raft_consensus.cc:2243] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.948702 29732 raft_consensus.cc:2272] T 7269c445625d4453bc9b0c141c5fb9c9 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.950773 29732 tablet_replica.cc:333] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.951586 29732 raft_consensus.cc:2243] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.952060 29732 raft_consensus.cc:2272] T 1968be972d704af08e92759ec0557c1e P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.954988 29732 tablet_replica.cc:333] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.955538 29732 raft_consensus.cc:2243] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.955960 29732 raft_consensus.cc:2272] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.957763 29732 tablet_replica.cc:333] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.958302 29732 raft_consensus.cc:2243] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.958994 29732 raft_consensus.cc:2272] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.960723 29732 tablet_replica.cc:333] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.961220 29732 raft_consensus.cc:2243] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.961606 29732 raft_consensus.cc:2272] T b81d335504724d14bafd66069e9ab3f8 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.963124 29732 tablet_replica.cc:333] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.963606 29732 raft_consensus.cc:2243] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.964022 29732 raft_consensus.cc:2272] T 6420cbab7b6a413bb6a9a3bdc07aa918 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.966163 29732 tablet_replica.cc:333] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.966853 29732 raft_consensus.cc:2243] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.967839 29732 raft_consensus.cc:2272] T 8fb7c71c819749338585b76d644d3a94 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.970259 29732 tablet_replica.cc:333] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.970971 29732 raft_consensus.cc:2243] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.971482 29732 raft_consensus.cc:2272] T d4576aeb4fdf46b0ab7c91d7b4389291 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.973794 29732 tablet_replica.cc:333] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.974442 29732 raft_consensus.cc:2243] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.975301 29732 raft_consensus.cc:2272] T b7f9d51f74f24d96a2aa074b6ed09f7a P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.977602 29732 tablet_replica.cc:333] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
W20260709 12:26:36.978143  3701 consensus_peers.cc:597] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:36.978168 29732 raft_consensus.cc:2243] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.978770 29732 raft_consensus.cc:2272] T a8d333d5c60842c09b47c5f9bbf9df39 P 98dcd37d8895403d96ceb94f8c67412a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.980928 29732 tablet_replica.cc:333] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.981444 29732 raft_consensus.cc:2243] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.981819 29732 raft_consensus.cc:2272] T 96dca18b7eac43e78683c65edac5c3bc P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.983448 29732 tablet_replica.cc:333] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.983986 29732 raft_consensus.cc:2243] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.984344 29732 raft_consensus.cc:2272] T 22aa1145b1384ae3a8fa929b5bbcfc19 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.986011 29732 tablet_replica.cc:333] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.986500 29732 raft_consensus.cc:2243] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.987177 29732 raft_consensus.cc:2272] T 5afddbeb03a24c0c80391699d45e6520 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.988864 29732 tablet_replica.cc:333] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.989365 29732 raft_consensus.cc:2243] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.989728 29732 raft_consensus.cc:2272] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.991408 29732 tablet_replica.cc:333] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.991933 29732 raft_consensus.cc:2243] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:36.992295 29732 raft_consensus.cc:2272] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.993966 29732 tablet_replica.cc:333] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.994444 29732 raft_consensus.cc:2243] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.995110 29732 raft_consensus.cc:2272] T 6abb36e32e6d4008818136af56869542 P 98dcd37d8895403d96ceb94f8c67412a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:36.996978 29732 tablet_replica.cc:333] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:36.997552 29732 raft_consensus.cc:2243] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:36.998330 29732 raft_consensus.cc:2272] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.000136 29732 tablet_replica.cc:333] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.000752 29732 raft_consensus.cc:2243] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.001168 29732 raft_consensus.cc:2272] T 3f126cd9dac7407c92dc21d66fc9e353 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.002748 29732 tablet_replica.cc:333] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.003278 29732 raft_consensus.cc:2243] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.003686 29732 raft_consensus.cc:2272] T 67c7c476412c475ea0783cadfd0ce30c P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.005363 29732 tablet_replica.cc:333] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.005885 29732 raft_consensus.cc:2243] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.006538 29732 raft_consensus.cc:2272] T 9174b8f24cdc43588daa58f89f3e0b95 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.008219 29732 tablet_replica.cc:333] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.008702 29732 raft_consensus.cc:2243] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.009080 29732 raft_consensus.cc:2272] T 01be9c8eac8b49f581ef991385b23996 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.010720 29732 tablet_replica.cc:333] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.011183 29732 raft_consensus.cc:2243] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.011561 29732 raft_consensus.cc:2272] T d9c8b4d97a9042d9b1a9a19db2bea177 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.013099 29732 tablet_replica.cc:333] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.013566 29732 raft_consensus.cc:2243] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.013949 29732 raft_consensus.cc:2272] T 28797f7f5b4c4196b96911477adabf4d P 98dcd37d8895403d96ceb94f8c67412a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.015447 29732 tablet_replica.cc:333] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.015938 29732 raft_consensus.cc:2243] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.016304 29732 raft_consensus.cc:2272] T 4399494b9fc14dc7989c328e016df504 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.017910 29732 tablet_replica.cc:333] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.018391 29732 raft_consensus.cc:2243] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.019104 29732 raft_consensus.cc:2272] T e29a6aaafab344e1b9259bb9803dba3e P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.020663 29732 tablet_replica.cc:333] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.021144 29732 raft_consensus.cc:2243] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.021809 29732 raft_consensus.cc:2272] T fafdf9490c1f4d9b919cee9883ba04fd P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.023413 29732 tablet_replica.cc:333] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.023927 29732 raft_consensus.cc:2243] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.024567 29732 raft_consensus.cc:2272] T 0d268ccfd8994a26a344654a181b615d P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.026160 29732 tablet_replica.cc:333] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.026635 29732 raft_consensus.cc:2243] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.027014 29732 raft_consensus.cc:2272] T 3317f960c9084fd08c81267ec5ea37d6 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.028918 29732 tablet_replica.cc:333] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.029557 29732 raft_consensus.cc:2243] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.030004 29732 raft_consensus.cc:2272] T f54877140907478b8976ce4a6698da2e P 98dcd37d8895403d96ceb94f8c67412a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.031668  3777 consensus_peers.cc:597] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:37.032155 29732 tablet_replica.cc:333] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.032754 29732 raft_consensus.cc:2243] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.033224 29732 raft_consensus.cc:2272] T a07c0d79152646f8aea06f98ab72cc07 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.035460 29732 tablet_replica.cc:333] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.036120 29732 raft_consensus.cc:2243] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.037051 29732 raft_consensus.cc:2272] T f6816ad0fe10401d80c7d91e289708d6 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.039093 29732 tablet_replica.cc:333] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.039615 29732 raft_consensus.cc:2243] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.040069 29732 raft_consensus.cc:2272] T 16f7ac680c52440fbb826622012945b7 P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.040207  3701 consensus_peers.cc:597] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:37.041828 29732 tablet_replica.cc:333] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.042392 29732 raft_consensus.cc:2243] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.042788 29732 raft_consensus.cc:2272] T b17a4df1bf1a4a6192febd99cd97d5bb P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.044675 29732 tablet_replica.cc:333] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.045147 29732 raft_consensus.cc:2243] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.045854 29732 raft_consensus.cc:2272] T e70956e754284b1d94ac89b470281cca P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.047824 29732 tablet_replica.cc:333] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.048306 29732 raft_consensus.cc:2243] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.048815 29732 raft_consensus.cc:2272] T 5ddc19e80d1e47bf9adba05e63b9c08f P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.050935 29732 tablet_replica.cc:333] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.051488 29732 raft_consensus.cc:2243] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.051890 29732 raft_consensus.cc:2272] T 87a16122c42b40248f485b77753956bc P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.053629 29732 tablet_replica.cc:333] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.054068 29732 raft_consensus.cc:2243] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.054738 29732 raft_consensus.cc:2272] T 93135771a5a14169b53fb7a726a9ce2e P 98dcd37d8895403d96ceb94f8c67412a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.056512 29732 tablet_replica.cc:333] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a: stopping tablet replica
I20260709 12:26:37.056922 29732 raft_consensus.cc:2243] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.057281 29732 raft_consensus.cc:2272] T 67cdf8ac45ef43ee978cae31e085a9c3 P 98dcd37d8895403d96ceb94f8c67412a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.090482  3778 consensus_peers.cc:597] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.107965  3778 consensus_peers.cc:597] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.111330  3777 consensus_peers.cc:597] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:37.122169  3778 consensus_peers.cc:597] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.137877  3778 consensus_peers.cc:597] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.144616  3775 consensus_peers.cc:597] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:37.148772 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
W20260709 12:26:37.163128  3778 consensus_peers.cc:597] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.180032  3778 consensus_peers.cc:597] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.198170  3778 consensus_peers.cc:597] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.209753 29732 tablet_server.cc:179] TabletServer@127.29.9.4:0 shutting down...
W20260709 12:26:37.225715  3778 consensus_peers.cc:597] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.235611  4809 raft_consensus.cc:493] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b06c1f1461ec46289edf63122a5863ba)
I20260709 12:26:37.236245  4809 raft_consensus.cc:515] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c78ef175c2d468993c1cb82527bef05" member_type: VOTER last_known_addr { host: "127.29.9.4" port: 37093 } } peers { permanent_uuid: "b06c1f1461ec46289edf63122a5863ba" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 37069 } } peers { permanent_uuid: "ea17b2b4fe5a4a33b586dd908fd673ce" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40615 } }
I20260709 12:26:37.238412  4809 leader_election.cc:290] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069), ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615)
W20260709 12:26:37.242913  3775 leader_election.cc:336] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111)
W20260709 12:26:37.243831  3777 leader_election.cc:336] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111)
I20260709 12:26:37.244246  3777 leader_election.cc:304] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c78ef175c2d468993c1cb82527bef05; no voters: b06c1f1461ec46289edf63122a5863ba, ea17b2b4fe5a4a33b586dd908fd673ce
I20260709 12:26:37.244789  4809 raft_consensus.cc:2749] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.251142 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:37.252031 29732 tablet_replica.cc:333] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.252851 29732 raft_consensus.cc:2243] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.253783 29732 raft_consensus.cc:2272] T 0e54ed26c20349f49856c2fcbc57dfdd P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.255707 29732 tablet_replica.cc:333] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.256246 29732 raft_consensus.cc:2243] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.256605 29732 raft_consensus.cc:2272] T 80f5bd7b84f64e9c9817b9f7cfbe9928 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.258175 29732 tablet_replica.cc:333] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.258656 29732 raft_consensus.cc:2243] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.259341 29732 raft_consensus.cc:2272] T 03376bd538eb41c399158480df7d762a P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.261318 29732 tablet_replica.cc:333] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.261986 29732 raft_consensus.cc:2243] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.262488 29732 raft_consensus.cc:2272] T e7588d8d55964d0b898b81d0d67ed9ec P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.265018 29732 tablet_replica.cc:333] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.265563 29732 raft_consensus.cc:2243] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.265946 29732 raft_consensus.cc:2272] T fae0cee41d4341debb2be23519d02ca9 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.267606 29732 tablet_replica.cc:333] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.268201 29732 raft_consensus.cc:2243] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.268589 29732 raft_consensus.cc:2272] T b7f9d51f74f24d96a2aa074b6ed09f7a P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.270295 29732 tablet_replica.cc:333] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.270771 29732 raft_consensus.cc:2243] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.271229 29732 raft_consensus.cc:2272] T b52a9fcd5d784adaa61ed8592e34820a P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.273165 29732 tablet_replica.cc:333] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.273674 29732 raft_consensus.cc:2243] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.274148 29732 raft_consensus.cc:2272] T ac829ea617614c26806da188940d398d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.274884  3778 consensus_peers.cc:597] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.276597 29732 tablet_replica.cc:333] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.277451 29732 raft_consensus.cc:2243] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.277879 29732 raft_consensus.cc:2272] T 25f1c4fb6ccb4909b6ed39a42499e6c4 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.278925  3775 consensus_peers.cc:597] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 -> Peer b06c1f1461ec46289edf63122a5863ba (127.29.9.1:37069): Couldn't send request to peer b06c1f1461ec46289edf63122a5863ba. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:37069: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:37.279129  3778 consensus_peers.cc:597] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.280114 29732 tablet_replica.cc:333] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.280844 29732 raft_consensus.cc:2243] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.281348 29732 raft_consensus.cc:2272] T ea70a27e95854669a0da5bb76b24e632 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.281441  3778 consensus_peers.cc:597] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 -> Peer 98dcd37d8895403d96ceb94f8c67412a (127.29.9.3:35167): Couldn't send request to peer 98dcd37d8895403d96ceb94f8c67412a. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.3:35167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.283109 29732 tablet_replica.cc:333] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.283851 29732 raft_consensus.cc:2243] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.284770 29732 raft_consensus.cc:2272] T 0f6c49b7c4db4f3fa1f03c887186ee66 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.286639 29732 tablet_replica.cc:333] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.287158 29732 raft_consensus.cc:2243] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.287909 29732 raft_consensus.cc:2272] T 1968be972d704af08e92759ec0557c1e P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.289779 29732 tablet_replica.cc:333] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.290292 29732 raft_consensus.cc:2243] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.290974 29732 raft_consensus.cc:2272] T 4399494b9fc14dc7989c328e016df504 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.292758 29732 tablet_replica.cc:333] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.293273 29732 raft_consensus.cc:2243] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.293720 29732 raft_consensus.cc:2272] T 8fb7c71c819749338585b76d644d3a94 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.295532 29732 tablet_replica.cc:333] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.296052 29732 raft_consensus.cc:2243] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.296702 29732 raft_consensus.cc:2272] T d4576aeb4fdf46b0ab7c91d7b4389291 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.298329 29732 tablet_replica.cc:333] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.298799 29732 raft_consensus.cc:2243] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.299468 29732 raft_consensus.cc:2272] T 755d2f3e3f0a4ae7ba1f73aec0f49a2d P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.301116 29732 tablet_replica.cc:333] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.301622 29732 raft_consensus.cc:2243] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.302001 29732 raft_consensus.cc:2272] T 99e2aa65e5fc4e0c9ba2625fea02a731 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.303608 29732 tablet_replica.cc:333] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.304123 29732 raft_consensus.cc:2243] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.304473 29732 raft_consensus.cc:2272] T b5581ff41a8b438693f2fd8942489f74 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.306141 29732 tablet_replica.cc:333] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.306620 29732 raft_consensus.cc:2243] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.306993 29732 raft_consensus.cc:2272] T f48164492db145fda737e65bbfc255f5 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.308569 29732 tablet_replica.cc:333] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.309036 29732 raft_consensus.cc:2243] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.309728 29732 raft_consensus.cc:2272] T 5a18a9b9a99d401eba8bd3955ea7dbb1 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.311348 29732 tablet_replica.cc:333] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.311883 29732 raft_consensus.cc:2243] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.312245 29732 raft_consensus.cc:2272] T 7d0f0423423342ecbdfe71d740533bf9 P 3c78ef175c2d468993c1cb82527bef05 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.313855 29732 tablet_replica.cc:333] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.314319 29732 raft_consensus.cc:2243] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.314672 29732 raft_consensus.cc:2272] T 9174b8f24cdc43588daa58f89f3e0b95 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.316238 29732 tablet_replica.cc:333] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.316722 29732 raft_consensus.cc:2243] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.317411 29732 raft_consensus.cc:2272] T 01be9c8eac8b49f581ef991385b23996 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.319006 29732 tablet_replica.cc:333] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.319535 29732 raft_consensus.cc:2243] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.320262 29732 raft_consensus.cc:2272] T 9dfc6756ea0e486d869252fd8f102411 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.321974 29732 tablet_replica.cc:333] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.322479 29732 raft_consensus.cc:2243] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.322829 29732 raft_consensus.cc:2272] T 38d4a07cbac64bc1b4cfa2f52f4e4808 P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.324461 29732 tablet_replica.cc:333] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.324937 29732 raft_consensus.cc:2243] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.325282 29732 raft_consensus.cc:2272] T e13f07f4920e4b38816a3a22b807b9c2 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.327090 29732 tablet_replica.cc:333] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.327584 29732 raft_consensus.cc:2243] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.327980 29732 raft_consensus.cc:2272] T f6816ad0fe10401d80c7d91e289708d6 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.329658 29732 tablet_replica.cc:333] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.330138 29732 raft_consensus.cc:2243] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.330499 29732 raft_consensus.cc:2272] T fd7b1d038f32403881c972fd7d51e402 P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.332154 29732 tablet_replica.cc:333] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.332636 29732 raft_consensus.cc:2243] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.333339 29732 raft_consensus.cc:2272] T a8d333d5c60842c09b47c5f9bbf9df39 P 3c78ef175c2d468993c1cb82527bef05 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.334955 29732 tablet_replica.cc:333] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.335449 29732 raft_consensus.cc:2243] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.335809 29732 raft_consensus.cc:2272] T 44d49c090caa4686add867d8afd82314 P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.337514 29732 tablet_replica.cc:333] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.337998 29732 raft_consensus.cc:2243] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.338732 29732 raft_consensus.cc:2272] T 96dca18b7eac43e78683c65edac5c3bc P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.340415 29732 tablet_replica.cc:333] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.340888 29732 raft_consensus.cc:2243] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.341578 29732 raft_consensus.cc:2272] T f54877140907478b8976ce4a6698da2e P 3c78ef175c2d468993c1cb82527bef05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.343236 29732 tablet_replica.cc:333] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.343822 29732 raft_consensus.cc:2243] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.344635 29732 raft_consensus.cc:2272] T a07c0d79152646f8aea06f98ab72cc07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.346901 29732 tablet_replica.cc:333] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.347456 29732 raft_consensus.cc:2243] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.347908 29732 raft_consensus.cc:2272] T 0d268ccfd8994a26a344654a181b615d P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.348475  3777 consensus_peers.cc:597] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 -> Peer ea17b2b4fe5a4a33b586dd908fd673ce (127.29.9.2:40615): Couldn't send request to peer ea17b2b4fe5a4a33b586dd908fd673ce. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:40615: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:37.349742 29732 tablet_replica.cc:333] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.350270 29732 raft_consensus.cc:2243] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.350977 29732 raft_consensus.cc:2272] T 3317f960c9084fd08c81267ec5ea37d6 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.352721 29732 tablet_replica.cc:333] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.353204 29732 raft_consensus.cc:2243] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.353585 29732 raft_consensus.cc:2272] T 93135771a5a14169b53fb7a726a9ce2e P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.355387 29732 tablet_replica.cc:333] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.355975 29732 raft_consensus.cc:2243] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.356338 29732 raft_consensus.cc:2272] T e29a6aaafab344e1b9259bb9803dba3e P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.357995 29732 tablet_replica.cc:333] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.358479 29732 raft_consensus.cc:2243] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.358819 29732 raft_consensus.cc:2272] T a40efc51adc448f18f9e55927e61618d P 3c78ef175c2d468993c1cb82527bef05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.360546 29732 tablet_replica.cc:333] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.361011 29732 raft_consensus.cc:2243] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.361361 29732 raft_consensus.cc:2272] T fafdf9490c1f4d9b919cee9883ba04fd P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.362987 29732 tablet_replica.cc:333] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.363443 29732 raft_consensus.cc:2243] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.364143 29732 raft_consensus.cc:2272] T 5ddc19e80d1e47bf9adba05e63b9c08f P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.365818 29732 tablet_replica.cc:333] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.366262 29732 raft_consensus.cc:2243] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.366618 29732 raft_consensus.cc:2272] T e70956e754284b1d94ac89b470281cca P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.368302 29732 tablet_replica.cc:333] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.368754 29732 raft_consensus.cc:2243] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.369103 29732 raft_consensus.cc:2272] T 97832336db4b4e6099c905fe241f299c P 3c78ef175c2d468993c1cb82527bef05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.370692 29732 tablet_replica.cc:333] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.371127 29732 raft_consensus.cc:2243] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.371506 29732 raft_consensus.cc:2272] T 546aeeaf20fb480bb5956ba5dc611e07 P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.373165 29732 tablet_replica.cc:333] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05: stopping tablet replica
I20260709 12:26:37.373584 29732 raft_consensus.cc:2243] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.374264 29732 raft_consensus.cc:2272] T 87a16122c42b40248f485b77753956bc P 3c78ef175c2d468993c1cb82527bef05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.449157 29732 tablet_server.cc:196] TabletServer@127.29.9.4:0 shutdown complete.
I20260709 12:26:37.504130 29732 master.cc:562] Master@127.29.9.62:34565 shutting down...
I20260709 12:26:37.527864 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.528437 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.528733 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P d6b27c144de84ce9941a5f23151e47d5: stopping tablet replica
I20260709 12:26:37.550141 29732 master.cc:584] Master@127.29.9.62:34565 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34554 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:26:37.630077 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:46169
I20260709 12:26:37.631269 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:37.637135  5041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.637387  5040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.637514  5043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:37.638819 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:37.640093 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:37.640273 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:37.640386 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599997640375 us; error 0 us; skew 500 ppm
I20260709 12:26:37.640847 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:37.643015 29732 webserver.cc:533] Webserver started at http://127.29.9.62:35965/ using document root <none> and password file <none>
I20260709 12:26:37.643438 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:37.643582 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:37.643872 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:37.644968 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "c71c642b85734905a8d0ac5ea9919cbd"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-ftzc"
I20260709 12:26:37.649281 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:37.652480  5048 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.653218 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:26:37.653469 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "c71c642b85734905a8d0ac5ea9919cbd"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-ftzc"
I20260709 12:26:37.653733 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:37.675285 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:37.676465 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:37.713143 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:46169
I20260709 12:26:37.713250  5099 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:46169 every 8 connection(s)
I20260709 12:26:37.717005  5100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:37.727092  5100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd: Bootstrap starting.
I20260709 12:26:37.731612  5100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:37.735613  5100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd: No bootstrap required, opened a new log
I20260709 12:26:37.737716  5100 raft_consensus.cc:359] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c71c642b85734905a8d0ac5ea9919cbd" member_type: VOTER }
I20260709 12:26:37.738085  5100 raft_consensus.cc:385] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:37.738292  5100 raft_consensus.cc:740] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c71c642b85734905a8d0ac5ea9919cbd, State: Initialized, Role: FOLLOWER
I20260709 12:26:37.738837  5100 consensus_queue.cc:260] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c71c642b85734905a8d0ac5ea9919cbd" member_type: VOTER }
I20260709 12:26:37.739234  5100 raft_consensus.cc:399] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:37.739439  5100 raft_consensus.cc:493] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:37.739677  5100 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:37.744050  5100 raft_consensus.cc:515] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c71c642b85734905a8d0ac5ea9919cbd" member_type: VOTER }
I20260709 12:26:37.744535  5100 leader_election.cc:304] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c71c642b85734905a8d0ac5ea9919cbd; no voters: 
I20260709 12:26:37.745570  5100 leader_election.cc:290] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:37.745924  5103 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:37.747175  5103 raft_consensus.cc:697] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 1 LEADER]: Becoming Leader. State: Replica: c71c642b85734905a8d0ac5ea9919cbd, State: Running, Role: LEADER
I20260709 12:26:37.747838  5103 consensus_queue.cc:237] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c71c642b85734905a8d0ac5ea9919cbd" member_type: VOTER }
I20260709 12:26:37.748260  5100 sys_catalog.cc:565] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:37.751464  5105 sys_catalog.cc:455] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c71c642b85734905a8d0ac5ea9919cbd. Latest consensus state: current_term: 1 leader_uuid: "c71c642b85734905a8d0ac5ea9919cbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c71c642b85734905a8d0ac5ea9919cbd" member_type: VOTER } }
I20260709 12:26:37.751588  5104 sys_catalog.cc:455] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c71c642b85734905a8d0ac5ea9919cbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c71c642b85734905a8d0ac5ea9919cbd" member_type: VOTER } }
I20260709 12:26:37.752177  5105 sys_catalog.cc:458] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:37.752233  5104 sys_catalog.cc:458] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:37.755038  5109 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:37.762136  5109 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:37.763872 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:37.770694  5109 catalog_manager.cc:1383] Generated new cluster ID: 51468ad5a26045f99ee8568ee43acf01
I20260709 12:26:37.770985  5109 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:37.807118  5109 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:37.808444  5109 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:37.828178  5109 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd: Generated new TSK 0
I20260709 12:26:37.828713  5109 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:37.895306 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:37.902374  5122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.903173  5123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.904474  5125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:37.904982 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:37.905979 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:37.906157 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:37.906291 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599997906280 us; error 0 us; skew 500 ppm
I20260709 12:26:37.906775 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:37.909229 29732 webserver.cc:533] Webserver started at http://127.29.9.1:34321/ using document root <none> and password file <none>
I20260709 12:26:37.909708 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:37.909864 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:37.910110 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:37.911496 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "70d220019f2844d39e6b4d4a82d58651"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-ftzc"
I20260709 12:26:37.916124 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:37.919529  5130 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.920305 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:37.920606 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "70d220019f2844d39e6b4d4a82d58651"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-ftzc"
I20260709 12:26:37.920922 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:37.937362 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:37.938679 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:37.940217 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:37.942691 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:37.942888 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.943127 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:37.943289 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:37.983601 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:44589
I20260709 12:26:37.983705  5192 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:44589 every 8 connection(s)
I20260709 12:26:37.988961 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:37.996889  5197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.997110  5198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:37.999542  5200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.000042 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:38.001226 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:38.001423 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:38.001592 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599998001573 us; error 0 us; skew 500 ppm
I20260709 12:26:38.002132 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:38.004966 29732 webserver.cc:533] Webserver started at http://127.29.9.2:36427/ using document root <none> and password file <none>
I20260709 12:26:38.005631 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:38.005847 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:38.006158 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:38.006397  5193 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46169
I20260709 12:26:38.006807  5193 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:38.007499 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "6c73e1310d404f02a954bd5b1417ee5f"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-ftzc"
I20260709 12:26:38.007543  5193 heartbeater.cc:507] Master 127.29.9.62:46169 requested a full tablet report, sending...
I20260709 12:26:38.009739  5065 ts_manager.cc:194] Registered new tserver with Master: 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589)
I20260709 12:26:38.011761  5065 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56448
I20260709 12:26:38.012506 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:38.015934  5205 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.016580 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:38.016855 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "6c73e1310d404f02a954bd5b1417ee5f"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-ftzc"
I20260709 12:26:38.017092 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:38.058117 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:38.059355 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:38.060767 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:38.062930 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:38.063109 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.063341 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:38.063493 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.102414 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:40589
I20260709 12:26:38.102504  5267 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:40589 every 8 connection(s)
I20260709 12:26:38.107112 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:38.114269  5271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:38.115127  5272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.116665 29732 server_base.cc:1061] running on GCE node
W20260709 12:26:38.117647  5275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:38.118630 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:38.118908 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:38.118949  5268 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46169
I20260709 12:26:38.119107 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783599998119089 us; error 0 us; skew 500 ppm
I20260709 12:26:38.119438  5268 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:38.119855 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:38.120221  5268 heartbeater.cc:507] Master 127.29.9.62:46169 requested a full tablet report, sending...
I20260709 12:26:38.122366  5065 ts_manager.cc:194] Registered new tserver with Master: 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:38.122442 29732 webserver.cc:533] Webserver started at http://127.29.9.3:37953/ using document root <none> and password file <none>
I20260709 12:26:38.123051 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:38.123245 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:38.123486 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:38.123924  5065 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56458
I20260709 12:26:38.124886 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "c94fa553e252439ea1cebcb127e9cf85"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-ftzc"
I20260709 12:26:38.129241 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:38.132462  5279 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.133163 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:38.133427 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "c94fa553e252439ea1cebcb127e9cf85"
format_stamp: "Formatted at 2026-07-09 12:26:38 on dist-test-slave-ftzc"
I20260709 12:26:38.133682 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:38.171753 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:38.173100 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:38.174316 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:38.176750 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:38.176951 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.177166 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:38.177318 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:38.215359 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:39609
I20260709 12:26:38.215467  5341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:39609 every 8 connection(s)
I20260709 12:26:38.229324  5342 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46169
I20260709 12:26:38.229764  5342 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:38.230476  5342 heartbeater.cc:507] Master 127.29.9.62:46169 requested a full tablet report, sending...
I20260709 12:26:38.232389  5065 ts_manager.cc:194] Registered new tserver with Master: c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.233142 29732 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014586009s
I20260709 12:26:38.234010  5065 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56464
I20260709 12:26:38.259341  5065 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56472:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:38.262331  5065 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:38.343950  5233 tablet_service.cc:1511] Processing CreateTablet for tablet 23b7a75d9e3f4997b83329a3a2e7d084 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:38.345460  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b7a75d9e3f4997b83329a3a2e7d084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.349757  5232 tablet_service.cc:1511] Processing CreateTablet for tablet c4639b2888d9464585dc1130e85a74ce (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:38.351246  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4639b2888d9464585dc1130e85a74ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.352496  5307 tablet_service.cc:1511] Processing CreateTablet for tablet 23b7a75d9e3f4997b83329a3a2e7d084 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:38.353892  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b7a75d9e3f4997b83329a3a2e7d084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.356935  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 99ada8b79d5549229ded6a85cfe4d014 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:38.358413  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ada8b79d5549229ded6a85cfe4d014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.364516  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 3245713e7c7e482c8d7c30265e516027 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:38.365288  5306 tablet_service.cc:1511] Processing CreateTablet for tablet c4639b2888d9464585dc1130e85a74ce (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:38.365972  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3245713e7c7e482c8d7c30265e516027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.366715  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4639b2888d9464585dc1130e85a74ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.373133  5305 tablet_service.cc:1511] Processing CreateTablet for tablet 3245713e7c7e482c8d7c30265e516027 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:38.374581  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3245713e7c7e482c8d7c30265e516027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.378626  5304 tablet_service.cc:1511] Processing CreateTablet for tablet 99ada8b79d5549229ded6a85cfe4d014 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:38.381012  5158 tablet_service.cc:1511] Processing CreateTablet for tablet 23b7a75d9e3f4997b83329a3a2e7d084 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:38.381821  5152 tablet_service.cc:1511] Processing CreateTablet for tablet 0a09e43c400a4342a80c735e7a584846 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:38.382436  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b7a75d9e3f4997b83329a3a2e7d084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.382174  5153 tablet_service.cc:1511] Processing CreateTablet for tablet 253f5465ed0141cdb7779f548101d1b4 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:38.383145  5152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a09e43c400a4342a80c735e7a584846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.384522  5151 tablet_service.cc:1511] Processing CreateTablet for tablet acd0176396da4860a111677176304f6d (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:38.385839  5151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd0176396da4860a111677176304f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.385679  5156 tablet_service.cc:1511] Processing CreateTablet for tablet 3245713e7c7e482c8d7c30265e516027 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:38.387008  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3245713e7c7e482c8d7c30265e516027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.388430  5153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f5465ed0141cdb7779f548101d1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.384562  5157 tablet_service.cc:1511] Processing CreateTablet for tablet c4639b2888d9464585dc1130e85a74ce (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:38.394838  5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4639b2888d9464585dc1130e85a74ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.400255  5357 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:38.406239  5149 tablet_service.cc:1511] Processing CreateTablet for tablet c4a532a53221439fa03f8448feb5fb2c (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:38.407747  5304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ada8b79d5549229ded6a85cfe4d014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.408567  5150 tablet_service.cc:1511] Processing CreateTablet for tablet 94ebfb69ab2747489b1cd5a37b2bccee (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:38.410251  5155 tablet_service.cc:1511] Processing CreateTablet for tablet 99ada8b79d5549229ded6a85cfe4d014 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:38.411962  5154 tablet_service.cc:1511] Processing CreateTablet for tablet ec83743ec8e94e45b585d768fb747b46 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:38.420804  5149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a532a53221439fa03f8448feb5fb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.421460  5154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec83743ec8e94e45b585d768fb747b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.422091  5155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ada8b79d5549229ded6a85cfe4d014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.421489  5233 tablet_service.cc:1511] Processing CreateTablet for tablet ec83743ec8e94e45b585d768fb747b46 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:38.427027  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec83743ec8e94e45b585d768fb747b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.428504  5150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ebfb69ab2747489b1cd5a37b2bccee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.434829  5357 tablet_bootstrap.cc:654] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.449826  5303 tablet_service.cc:1511] Processing CreateTablet for tablet ec83743ec8e94e45b585d768fb747b46 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:38.450941  5230 tablet_service.cc:1511] Processing CreateTablet for tablet acd0176396da4860a111677176304f6d (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:38.451409  5229 tablet_service.cc:1511] Processing CreateTablet for tablet 94ebfb69ab2747489b1cd5a37b2bccee (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:38.452322  5232 tablet_service.cc:1511] Processing CreateTablet for tablet 0a09e43c400a4342a80c735e7a584846 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:38.453850  5228 tablet_service.cc:1511] Processing CreateTablet for tablet c4a532a53221439fa03f8448feb5fb2c (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:38.455636  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 253f5465ed0141cdb7779f548101d1b4 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:38.452291  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd0176396da4860a111677176304f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.457778  5302 tablet_service.cc:1511] Processing CreateTablet for tablet 253f5465ed0141cdb7779f548101d1b4 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:38.459146  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f5465ed0141cdb7779f548101d1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.460210  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a532a53221439fa03f8448feb5fb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.460098  5301 tablet_service.cc:1511] Processing CreateTablet for tablet 0a09e43c400a4342a80c735e7a584846 (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:38.462966  5300 tablet_service.cc:1511] Processing CreateTablet for tablet 94ebfb69ab2747489b1cd5a37b2bccee (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:38.465566  5299 tablet_service.cc:1511] Processing CreateTablet for tablet c4a532a53221439fa03f8448feb5fb2c (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:38.467397  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ebfb69ab2747489b1cd5a37b2bccee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.451359  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec83743ec8e94e45b585d768fb747b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.471935  5299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a532a53221439fa03f8448feb5fb2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.480018  5301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a09e43c400a4342a80c735e7a584846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.480195  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a09e43c400a4342a80c735e7a584846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.482128  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253f5465ed0141cdb7779f548101d1b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.488147  5300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94ebfb69ab2747489b1cd5a37b2bccee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.499115  5358 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.517174  5304 tablet_service.cc:1511] Processing CreateTablet for tablet acd0176396da4860a111677176304f6d (DEFAULT_TABLE table=test-workload [id=b149078b66eb4c34bb3e99ec3d34edaf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:38.520531  5359 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:38.533804  5304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd0176396da4860a111677176304f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:38.538195  5359 tablet_bootstrap.cc:654] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.540531  5358 tablet_bootstrap.cc:654] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.551784  5358 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.552285  5358 ts_tablet_manager.cc:1403] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 12:26:38.554114  5357 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:38.556205  5357 ts_tablet_manager.cc:1403] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.003s
I20260709 12:26:38.555213  5358 raft_consensus.cc:359] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.559705  5358 raft_consensus.cc:385] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.559914  5357 raft_consensus.cc:359] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.560644  5357 raft_consensus.cc:385] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.560937  5357 raft_consensus.cc:740] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.561452  5358 raft_consensus.cc:740] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.562323  5358 consensus_queue.cc:260] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.565758  5359 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:38.566254  5359 ts_tablet_manager.cc:1403] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.046s	user 0.003s	sys 0.008s
I20260709 12:26:38.568742  5359 raft_consensus.cc:359] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.569270  5342 heartbeater.cc:499] Master 127.29.9.62:46169 was elected leader, sending a full tablet report...
I20260709 12:26:38.569674  5358 ts_tablet_manager.cc:1434] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:26:38.569978  5357 consensus_queue.cc:260] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.570672  5358 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.569350  5359 raft_consensus.cc:385] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.571416  5359 raft_consensus.cc:740] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.572184  5268 heartbeater.cc:499] Master 127.29.9.62:46169 was elected leader, sending a full tablet report...
I20260709 12:26:38.576303  5358 tablet_bootstrap.cc:654] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.577003  5357 ts_tablet_manager.cc:1434] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:38.578006  5357 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:38.581163  5359 consensus_queue.cc:260] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.582844  5365 raft_consensus.cc:493] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.583416  5365 raft_consensus.cc:515] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.585649  5193 heartbeater.cc:499] Master 127.29.9.62:46169 was elected leader, sending a full tablet report...
I20260709 12:26:38.590886  5359 ts_tablet_manager.cc:1434] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:26:38.584429  5357 tablet_bootstrap.cc:654] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.591938  5359 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:38.594556  5365 leader_election.cc:290] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.591918  5358 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.598304  5358 ts_tablet_manager.cc:1403] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 12:26:38.600029  5359 tablet_bootstrap.cc:654] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.601536  5358 raft_consensus.cc:359] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.602365  5358 raft_consensus.cc:385] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.602655  5358 raft_consensus.cc:740] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.603477  5358 consensus_queue.cc:260] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.605962  5358 ts_tablet_manager.cc:1434] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:26:38.606549  5269 tablet.cc:2406] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:38.606920  5358 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.614078  5358 tablet_bootstrap.cc:654] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.655751  5357 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:38.656569  5357 ts_tablet_manager.cc:1403] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.079s	user 0.035s	sys 0.032s
I20260709 12:26:38.658761  5358 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.659451  5358 ts_tablet_manager.cc:1403] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.016s
I20260709 12:26:38.659875  5357 raft_consensus.cc:359] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.660595  5359 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:38.661134  5359 ts_tablet_manager.cc:1403] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.034s
I20260709 12:26:38.660646  5357 raft_consensus.cc:385] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.661741  5357 raft_consensus.cc:740] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.662009  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0176396da4860a111677176304f6d" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.662648  5357 consensus_queue.cc:260] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
W20260709 12:26:38.664191  5131 leader_election.cc:343] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.664067  5359 raft_consensus.cc:359] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.664824  5359 raft_consensus.cc:385] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.664894  5357 ts_tablet_manager.cc:1434] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:38.665170  5359 raft_consensus.cc:740] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.666121  5357 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:38.665982  5359 consensus_queue.cc:260] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.666661  5358 raft_consensus.cc:359] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.667398  5358 raft_consensus.cc:385] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.667706  5358 raft_consensus.cc:740] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.668113  5359 ts_tablet_manager.cc:1434] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:26:38.669072  5359 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:38.668646  5358 consensus_queue.cc:260] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.670989  5358 ts_tablet_manager.cc:1434] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:26:38.672624  5358 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.673117  5357 tablet_bootstrap.cc:654] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.675359  5359 tablet_bootstrap.cc:654] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.663621  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0176396da4860a111677176304f6d" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
W20260709 12:26:38.677783  5131 leader_election.cc:343] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.678248  5131 leader_election.cc:304] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651; no voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:38.678751  5358 tablet_bootstrap.cc:654] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.679457  5365 raft_consensus.cc:2749] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:38.683470  5364 raft_consensus.cc:493] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.684111  5364 raft_consensus.cc:515] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.696219  5357 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:38.696825  5357 ts_tablet_manager.cc:1403] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.021s
I20260709 12:26:38.699888  5357 raft_consensus.cc:359] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.701274  5364 leader_election.cc:290] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.702574  5357 raft_consensus.cc:385] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.703771  5357 raft_consensus.cc:740] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.704640  5357 consensus_queue.cc:260] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.706907  5357 ts_tablet_manager.cc:1434] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:38.707975  5357 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:38.713330  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.714046  5317 raft_consensus.cc:2468] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 0.
I20260709 12:26:38.714744  5358 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.715277  5358 ts_tablet_manager.cc:1403] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.005s
I20260709 12:26:38.715442  5206 leader_election.cc:304] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:38.716368  5364 raft_consensus.cc:2804] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.716710  5364 raft_consensus.cc:493] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.716846  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:38.717145  5364 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:38.718535  5209 leader_election.cc:343] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.719596  5359 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:38.720119  5359 ts_tablet_manager.cc:1403] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.016s
I20260709 12:26:38.721266  5358 raft_consensus.cc:359] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.721992  5358 raft_consensus.cc:385] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.722255  5358 raft_consensus.cc:740] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.723134  5359 raft_consensus.cc:359] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.723007  5358 consensus_queue.cc:260] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.724032  5359 raft_consensus.cc:385] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.723907  5364 raft_consensus.cc:515] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.724601  5359 raft_consensus.cc:740] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.725580  5359 consensus_queue.cc:260] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.726320  5357 tablet_bootstrap.cc:654] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.727543  5358 ts_tablet_manager.cc:1434] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:26:38.727649  5359 ts_tablet_manager.cc:1434] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:38.728626  5358 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.729238  5359 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:38.733848  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:38.735260  5358 tablet_bootstrap.cc:654] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.736033  5359 tablet_bootstrap.cc:654] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:38.738595  5209 leader_election.cc:343] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.743078  5357 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:38.743341  5364 leader_election.cc:290] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.743691  5357 ts_tablet_manager.cc:1403] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.008s
I20260709 12:26:38.745026  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:38.745644  5317 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.746966  5357 raft_consensus.cc:359] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.747879  5363 raft_consensus.cc:493] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.748374  5363 raft_consensus.cc:515] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.753110  5358 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.753690  5358 ts_tablet_manager.cc:1403] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.001s
I20260709 12:26:38.754448  5363 leader_election.cc:290] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589)
I20260709 12:26:38.755848  5357 raft_consensus.cc:385] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.756279  5357 raft_consensus.cc:740] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.757122  5357 consensus_queue.cc:260] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
W20260709 12:26:38.759560  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:38.760149  5358 raft_consensus.cc:359] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.760880  5358 raft_consensus.cc:385] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.761260  5364 raft_consensus.cc:493] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.761811  5364 raft_consensus.cc:515] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.762465  5357 ts_tablet_manager.cc:1434] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 12:26:38.763487  5357 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:38.763918  5364 leader_election.cc:290] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.765028  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ada8b79d5549229ded6a85cfe4d014" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
W20260709 12:26:38.766712  5209 leader_election.cc:343] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.768231  5316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ada8b79d5549229ded6a85cfe4d014" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.768890  5316 raft_consensus.cc:2468] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 0.
I20260709 12:26:38.769495  5357 tablet_bootstrap.cc:654] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.770046  5206 leader_election.cc:304] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:38.770577  5359 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:38.771272  5359 ts_tablet_manager.cc:1403] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.017s
I20260709 12:26:38.761165  5358 raft_consensus.cc:740] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.772379  5358 consensus_queue.cc:260] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.773770  5365 raft_consensus.cc:493] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.774551  5358 ts_tablet_manager.cc:1434] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:38.774178  5359 raft_consensus.cc:359] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.774235  5365 raft_consensus.cc:515] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.775044  5359 raft_consensus.cc:385] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.775372  5359 raft_consensus.cc:740] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.775552  5358 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.776173  5359 consensus_queue.cc:260] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.778041  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:38.778455  5359 ts_tablet_manager.cc:1434] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:38.779424  5359 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:38.776536  5365 leader_election.cc:290] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.782338  5358 tablet_bootstrap.cc:654] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.785712  5359 tablet_bootstrap.cc:654] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:38.779515  5131 leader_election.cc:343] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.789027  5316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.789711  5316 raft_consensus.cc:2468] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 0.
I20260709 12:26:38.793331  5131 leader_election.cc:304] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:38.794092  5358 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.794128  5365 raft_consensus.cc:2804] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.794787  5365 raft_consensus.cc:493] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.794895  5358 ts_tablet_manager.cc:1403] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:26:38.795173  5365 raft_consensus.cc:3060] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.797909  5317 raft_consensus.cc:2468] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 1.
I20260709 12:26:38.795260  5364 raft_consensus.cc:2804] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.798317  5358 raft_consensus.cc:359] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.803476  5358 raft_consensus.cc:385] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.803453  5364 raft_consensus.cc:493] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.803798  5206 leader_election.cc:304] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:38.804378  5364 raft_consensus.cc:3060] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.802358  5359 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:38.807626  5359 ts_tablet_manager.cc:1403] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 12:26:38.803205  5365 raft_consensus.cc:515] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.817651  5359 raft_consensus.cc:359] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.818300  5359 raft_consensus.cc:385] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.818614  5359 raft_consensus.cc:740] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.820032  5359 consensus_queue.cc:260] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.821048  5386 raft_consensus.cc:2804] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.822588  5359 ts_tablet_manager.cc:1434] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:38.823140  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:38.823050  5364 raft_consensus.cc:515] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.823971  5359 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:38.823932  5243 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 0.
I20260709 12:26:38.825294  5280 leader_election.cc:304] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:38.826472  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ada8b79d5549229ded6a85cfe4d014" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:38.827414  5363 raft_consensus.cc:2804] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.827674  5357 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:38.827868  5363 raft_consensus.cc:493] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.816072  5358 raft_consensus.cc:740] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.828292  5363 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.828730  5358 consensus_queue.cc:260] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.830138  5357 ts_tablet_manager.cc:1403] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.012s
I20260709 12:26:38.820959  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:38.831709  5359 tablet_bootstrap.cc:654] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.831898  5168 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 0.
I20260709 12:26:38.833120  5357 raft_consensus.cc:359] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.833868  5357 raft_consensus.cc:385] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.834148  5357 raft_consensus.cc:740] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.836598  5357 consensus_queue.cc:260] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.838790  5364 leader_election.cc:290] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.839465  5363 raft_consensus.cc:515] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
W20260709 12:26:38.841579  5209 leader_election.cc:343] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.843089  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ada8b79d5549229ded6a85cfe4d014" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:38.843801  5317 raft_consensus.cc:3060] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.844125  5365 leader_election.cc:290] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Requested vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.844326  5316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:38.844863  5316 raft_consensus.cc:3060] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.845794  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:38.847193  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
W20260709 12:26:38.847389  5131 leader_election.cc:343] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.847856  5167 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.852871  5316 raft_consensus.cc:2468] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 1.
I20260709 12:26:38.854308  5131 leader_election.cc:304] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:38.854552  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:38.855201  5243 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.855664  5365 raft_consensus.cc:2804] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.856285  5365 raft_consensus.cc:697] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 LEADER]: Becoming Leader. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Running, Role: LEADER
I20260709 12:26:38.856721  5359 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:38.853920  5317 raft_consensus.cc:2468] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 1.
I20260709 12:26:38.857203  5365 consensus_queue.cc:237] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.860668  5206 leader_election.cc:304] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:38.861579  5364 raft_consensus.cc:2804] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.862054  5364 raft_consensus.cc:697] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:38.862854  5364 consensus_queue.cc:237] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.863193  5243 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:38.864532  5280 leader_election.cc:304] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:38.865573  5167 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:38.866628  5363 leader_election.cc:290] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Requested vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589)
I20260709 12:26:38.857249  5359 ts_tablet_manager.cc:1403] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.010s
I20260709 12:26:38.872547  5363 raft_consensus.cc:2804] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.873030  5063 catalog_manager.cc:5697] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "70d220019f2844d39e6b4d4a82d58651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.873112  5363 raft_consensus.cc:697] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:38.876333  5358 ts_tablet_manager.cc:1434] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.081s	user 0.001s	sys 0.023s
I20260709 12:26:38.875929  5363 consensus_queue.cc:237] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.879151  5357 ts_tablet_manager.cc:1434] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.013s
I20260709 12:26:38.880889  5359 raft_consensus.cc:359] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.881801  5359 raft_consensus.cc:385] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.882151  5357 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:38.882583  5386 raft_consensus.cc:697] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:38.884007  5365 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.883919  5386 consensus_queue.cc:237] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.882845  5359 raft_consensus.cc:740] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.884577  5365 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.885546  5358 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.885951  5359 consensus_queue.cc:260] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.888414  5365 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.889134  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.889995  5317 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 0.
I20260709 12:26:38.891394  5131 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:38.889216  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:38.894342  5357 tablet_bootstrap.cc:654] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.896449  5367 raft_consensus.cc:2804] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:38.896953  5367 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:38.896739  5131 leader_election.cc:343] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.897383  5367 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.897018  5365 raft_consensus.cc:493] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.898221  5365 raft_consensus.cc:515] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.900357  5365 leader_election.cc:290] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.902519  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.902644  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:38.903393  5317 raft_consensus.cc:2393] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70d220019f2844d39e6b4d4a82d58651 in current term 1: Already voted for candidate 6c73e1310d404f02a954bd5b1417ee5f in this term.
I20260709 12:26:38.904524  5131 leader_election.cc:304] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651; no voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:38.905242  5367 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.905784  5365 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.908128  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
W20260709 12:26:38.909397  5131 leader_election.cc:343] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.910908  5367 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Requested vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.911499  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:38.912194  5317 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.912832  5358 tablet_bootstrap.cc:654] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.913225  5359 ts_tablet_manager.cc:1434] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 12:26:38.914347  5359 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:38.919446  5317 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 1.
I20260709 12:26:38.920856  5131 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:38.921896  5367 raft_consensus.cc:2804] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:38.926349  5365 raft_consensus.cc:2749] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:38.937354  5367 raft_consensus.cc:697] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 LEADER]: Becoming Leader. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Running, Role: LEADER
I20260709 12:26:38.938482  5367 consensus_queue.cc:237] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.941841  5365 raft_consensus.cc:493] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.942528  5365 raft_consensus.cc:515] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.943691  5386 raft_consensus.cc:493] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.945418  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ada8b79d5549229ded6a85cfe4d014" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:38.944240  5386 raft_consensus.cc:515] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.947925  5365 leader_election.cc:290] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.942996  5064 catalog_manager.cc:5697] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.945890  5359 tablet_bootstrap.cc:654] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.949033  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ada8b79d5549229ded6a85cfe4d014" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.949787  5317 raft_consensus.cc:2393] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70d220019f2844d39e6b4d4a82d58651 in current term 1: Already voted for candidate 6c73e1310d404f02a954bd5b1417ee5f in this term.
I20260709 12:26:38.950770  5386 leader_election.cc:290] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:38.950700  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:38.951884  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:38.951449  5131 leader_election.cc:304] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651; no voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85
W20260709 12:26:38.953279  5206 leader_election.cc:343] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:38.953737  5209 leader_election.cc:343] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:38.954174  5209 leader_election.cc:304] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f; no voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:38.954516  5358 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.955202  5358 ts_tablet_manager.cc:1403] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.016s
I20260709 12:26:38.955178  5386 raft_consensus.cc:2749] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:38.956351  5365 raft_consensus.cc:3060] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:38.958623  5358 raft_consensus.cc:359] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.959400  5358 raft_consensus.cc:385] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.959669  5358 raft_consensus.cc:740] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.960578  5358 consensus_queue.cc:260] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.963102  5358 ts_tablet_manager.cc:1434] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:26:38.963476  5365 raft_consensus.cc:2749] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:38.964363  5358 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:38.955104  5063 catalog_manager.cc:5697] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 1 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.977622  5358 tablet_bootstrap.cc:654] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:38.989483  5358 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:38.990128  5358 ts_tablet_manager.cc:1403] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 12:26:38.989526  5065 catalog_manager.cc:5697] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 1 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.993170  5358 raft_consensus.cc:359] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:38.993940  5358 raft_consensus.cc:385] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:38.994185  5358 raft_consensus.cc:740] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:38.995062  5358 consensus_queue.cc:260] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.002514  5358 ts_tablet_manager.cc:1434] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:39.003517  5358 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:39.009290  5358 tablet_bootstrap.cc:654] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.015293  5357 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:39.015858  5357 ts_tablet_manager.cc:1403] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.026s
I20260709 12:26:39.016883  5061 catalog_manager.cc:5697] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "70d220019f2844d39e6b4d4a82d58651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.018930  5357 raft_consensus.cc:359] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.019706  5357 raft_consensus.cc:385] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.020000  5357 raft_consensus.cc:740] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.020807  5359 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:39.021417  5359 ts_tablet_manager.cc:1403] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.007s
I20260709 12:26:39.020879  5357 consensus_queue.cc:260] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.021615  5358 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:39.022068  5358 ts_tablet_manager.cc:1403] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:26:39.024672  5359 raft_consensus.cc:359] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.024889  5358 raft_consensus.cc:359] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.025431  5359 raft_consensus.cc:385] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.025573  5358 raft_consensus.cc:385] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.025787  5359 raft_consensus.cc:740] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.025934  5358 raft_consensus.cc:740] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.026698  5359 consensus_queue.cc:260] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.026868  5358 consensus_queue.cc:260] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.028703  5359 ts_tablet_manager.cc:1434] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:39.029222  5358 ts_tablet_manager.cc:1434] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:26:39.029704  5359 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:39.030140  5358 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85: Bootstrap starting.
I20260709 12:26:39.030567  5363 raft_consensus.cc:493] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.031044  5363 raft_consensus.cc:515] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.033274  5363 leader_election.cc:290] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:39.036265  5358 tablet_bootstrap.cc:654] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.036082  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:39.036798  5243 raft_consensus.cc:2468] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 0.
I20260709 12:26:39.037359  5359 tablet_bootstrap.cc:654] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.037699  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:39.039355  5280 leader_election.cc:304] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
W20260709 12:26:39.041028  5283 leader_election.cc:343] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.042140  5363 raft_consensus.cc:2804] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.042687  5363 raft_consensus.cc:493] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.043097  5363 raft_consensus.cc:3060] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.047448  5358 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85: No bootstrap required, opened a new log
I20260709 12:26:39.048013  5358 ts_tablet_manager.cc:1403] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:26:39.050901  5358 raft_consensus.cc:359] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.051505  5358 raft_consensus.cc:385] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.051792  5358 raft_consensus.cc:740] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.051641  5363 raft_consensus.cc:515] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.053648  5357 ts_tablet_manager.cc:1434] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:26:39.053733  5358 consensus_queue.cc:260] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.054875  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
W20260709 12:26:39.056514  5283 leader_election.cc:343] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:39.058145  5358 ts_tablet_manager.cc:1434] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:39.058665  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:39.059258  5243 raft_consensus.cc:3060] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.060905  5357 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:39.061163  5386 raft_consensus.cc:493] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.061623  5386 raft_consensus.cc:515] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.063696  5386 leader_election.cc:290] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:39.066140  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:39.067011  5317 raft_consensus.cc:2393] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c73e1310d404f02a954bd5b1417ee5f in current term 1: Already voted for candidate 70d220019f2844d39e6b4d4a82d58651 in this term.
I20260709 12:26:39.067520  5243 raft_consensus.cc:2468] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:39.068344  5357 tablet_bootstrap.cc:654] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.068092  5363 leader_election.cc:290] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:39.071312  5359 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:39.071863  5359 ts_tablet_manager.cc:1403] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.007s
I20260709 12:26:39.068282  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:39.071915  5280 leader_election.cc:304] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:39.073385  5363 raft_consensus.cc:2804] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.073700  5209 leader_election.cc:304] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f; no voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:39.073823  5363 raft_consensus.cc:697] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:39.074537  5359 raft_consensus.cc:359] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.075199  5359 raft_consensus.cc:385] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.074858  5386 raft_consensus.cc:3060] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.075533  5359 raft_consensus.cc:740] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.074996  5363 consensus_queue.cc:237] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.077975  5357 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:39.078611  5357 ts_tablet_manager.cc:1403] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 12:26:39.080046  5359 consensus_queue.cc:260] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.082091  5359 ts_tablet_manager.cc:1434] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:26:39.082988  5359 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:39.084594  5064 catalog_manager.cc:5697] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.086941  5386 raft_consensus.cc:2749] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.088421  5359 tablet_bootstrap.cc:654] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.088744  5357 raft_consensus.cc:359] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.089464  5357 raft_consensus.cc:385] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.089735  5357 raft_consensus.cc:740] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.090484  5357 consensus_queue.cc:260] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.092932  5357 ts_tablet_manager.cc:1434] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:26:39.093930  5357 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:39.099812  5359 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:39.100144  5357 tablet_bootstrap.cc:654] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.100351  5359 ts_tablet_manager.cc:1403] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 12:26:39.102738  5359 raft_consensus.cc:359] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.103399  5359 raft_consensus.cc:385] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.103597  5359 raft_consensus.cc:740] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.104182  5359 consensus_queue.cc:260] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.104482  5357 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:39.104943  5357 ts_tablet_manager.cc:1403] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 12:26:39.105331  5386 raft_consensus.cc:493] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.106009  5359 ts_tablet_manager.cc:1434] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:39.105813  5386 raft_consensus.cc:515] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.106983  5359 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:39.107404  5357 raft_consensus.cc:359] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.108062  5357 raft_consensus.cc:385] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.108327  5357 raft_consensus.cc:740] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.108904  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:39.108975  5357 consensus_queue.cc:260] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.109980  5386 leader_election.cc:290] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:39.111397  5357 ts_tablet_manager.cc:1434] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:39.111515  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:39.109640  5167 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 0.
I20260709 12:26:39.112180  5317 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 0.
I20260709 12:26:39.113065  5359 tablet_bootstrap.cc:654] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.113008  5209 leader_election.cc:304] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:39.114089  5386 raft_consensus.cc:2804] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.114341  5386 raft_consensus.cc:493] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.114552  5386 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.118372  5359 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: No bootstrap required, opened a new log
I20260709 12:26:39.118894  5359 ts_tablet_manager.cc:1403] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:26:39.120164  5357 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:39.120958  5386 raft_consensus.cc:515] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.121485  5359 raft_consensus.cc:359] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.122184  5359 raft_consensus.cc:385] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.122426  5359 raft_consensus.cc:740] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.123237  5359 consensus_queue.cc:260] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.123939  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:39.124513  5167 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.125468  5359 ts_tablet_manager.cc:1434] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:39.126173  5357 tablet_bootstrap.cc:654] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.130837  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:39.131224  5357 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:39.131485  5317 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.131467  5167 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 1.
I20260709 12:26:39.131747  5357 ts_tablet_manager.cc:1403] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:26:39.132042  5386 leader_election.cc:290] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:39.133080  5209 leader_election.cc:304] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:39.134001  5387 raft_consensus.cc:2804] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.134475  5387 raft_consensus.cc:697] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:39.134992  5357 raft_consensus.cc:359] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.135780  5357 raft_consensus.cc:385] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.136073  5357 raft_consensus.cc:740] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.135331  5387 consensus_queue.cc:237] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.136730  5357 consensus_queue.cc:260] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.138890  5357 ts_tablet_manager.cc:1434] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:39.139154  5317 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 1.
I20260709 12:26:39.139786  5357 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f: Bootstrap starting.
I20260709 12:26:39.145336  5357 tablet_bootstrap.cc:654] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.146126  5064 catalog_manager.cc:5697] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 1 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.149331  5357 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f: No bootstrap required, opened a new log
I20260709 12:26:39.149806  5357 ts_tablet_manager.cc:1403] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:26:39.152225  5357 raft_consensus.cc:359] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.152856  5357 raft_consensus.cc:385] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.153113  5357 raft_consensus.cc:740] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.153759  5357 consensus_queue.cc:260] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.155355  5357 ts_tablet_manager.cc:1434] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:39.188215  5363 raft_consensus.cc:493] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.188737  5363 raft_consensus.cc:515] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.190403  5363 leader_election.cc:290] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:39.191138  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0176396da4860a111677176304f6d" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:39.191469  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0176396da4860a111677176304f6d" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:39.191898  5167 raft_consensus.cc:2468] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 0.
I20260709 12:26:39.192153  5243 raft_consensus.cc:2468] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 0.
I20260709 12:26:39.192975  5283 leader_election.cc:304] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:39.193642  5363 raft_consensus.cc:2804] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.193924  5363 raft_consensus.cc:493] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.194177  5363 raft_consensus.cc:3060] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.199070  5363 raft_consensus.cc:515] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.200675  5363 leader_election.cc:290] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:39.201421  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0176396da4860a111677176304f6d" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:39.201746  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd0176396da4860a111677176304f6d" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:39.202092  5167 raft_consensus.cc:3060] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.202306  5243 raft_consensus.cc:3060] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.204466  5363 raft_consensus.cc:493] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.204972  5363 raft_consensus.cc:515] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.207293  5168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:39.207829  5363 leader_election.cc:290] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:39.207882  5168 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 0.
I20260709 12:26:39.209045  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:39.209371  5243 raft_consensus.cc:2468] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:39.209357  5283 leader_election.cc:304] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:39.209846  5242 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 0.
I20260709 12:26:39.210466  5363 raft_consensus.cc:2804] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.210482  5167 raft_consensus.cc:2468] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:39.211022  5280 leader_election.cc:304] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:39.211984  5392 raft_consensus.cc:2804] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.210894  5363 raft_consensus.cc:493] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.212527  5392 raft_consensus.cc:697] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:39.212554  5363 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.213650  5392 consensus_queue.cc:237] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.218832  5367 raft_consensus.cc:493] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.219348  5367 raft_consensus.cc:515] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.219429  5363 raft_consensus.cc:515] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.221127  5367 leader_election.cc:290] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:39.221441  5064 catalog_manager.cc:5697] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.222366  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83743ec8e94e45b585d768fb747b46" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:39.223659  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:39.223893  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:39.224272  5167 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.224546  5242 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.222735  5363 leader_election.cc:290] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:39.222743  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83743ec8e94e45b585d768fb747b46" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:39.223502  5243 raft_consensus.cc:2468] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 0.
I20260709 12:26:39.227907  5317 raft_consensus.cc:2468] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 0.
I20260709 12:26:39.228927  5131 leader_election.cc:304] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:39.231757  5367 raft_consensus.cc:2804] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:39.232122  5367 raft_consensus.cc:493] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.232340  5167 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:39.232887  5242 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:39.232456  5367 raft_consensus.cc:3060] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.233640  5283 leader_election.cc:304] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:39.234524  5363 raft_consensus.cc:2804] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.235739  5363 raft_consensus.cc:697] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:39.236508  5363 consensus_queue.cc:237] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.238617  5399 consensus_queue.cc:1048] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:39.240002  5367 raft_consensus.cc:515] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.244072  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83743ec8e94e45b585d768fb747b46" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:39.244652  5242 raft_consensus.cc:3060] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.245110  5065 catalog_manager.cc:5697] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.247359  5367 leader_election.cc:290] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Requested vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:39.248562  5316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83743ec8e94e45b585d768fb747b46" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:39.249254  5316 raft_consensus.cc:3060] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.252722  5242 raft_consensus.cc:2468] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 1.
I20260709 12:26:39.254158  5131 leader_election.cc:304] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:39.255172  5367 raft_consensus.cc:2804] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.255824  5367 raft_consensus.cc:697] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 LEADER]: Becoming Leader. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Running, Role: LEADER
I20260709 12:26:39.256624  5367 consensus_queue.cc:237] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.257462  5316 raft_consensus.cc:2468] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70d220019f2844d39e6b4d4a82d58651 in term 1.
I20260709 12:26:39.263970  5387 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.264472  5387 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.266502  5387 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:39.266981  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70d220019f2844d39e6b4d4a82d58651" is_pre_election: true
I20260709 12:26:39.267232  5367 consensus_queue.cc:1048] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.267364  5064 catalog_manager.cc:5697] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "70d220019f2844d39e6b4d4a82d58651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.269153  5316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:39.269906  5316 raft_consensus.cc:2393] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c73e1310d404f02a954bd5b1417ee5f in current term 1: Already voted for candidate 70d220019f2844d39e6b4d4a82d58651 in this term.
I20260709 12:26:39.271106  5206 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f; no voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:39.272483  5387 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.282647  5387 raft_consensus.cc:2749] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.285127  5387 consensus_queue.cc:1048] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.296706  5386 consensus_queue.cc:1048] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.302363  5363 consensus_queue.cc:1048] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.316185  5388 consensus_queue.cc:1048] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:39.324756  5367 raft_consensus.cc:493] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.325232  5367 raft_consensus.cc:515] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:39.326903  5367 leader_election.cc:290] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:39.327877  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:39.327875  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3245713e7c7e482c8d7c30265e516027" candidate_uuid: "70d220019f2844d39e6b4d4a82d58651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:39.328888  5242 raft_consensus.cc:2393] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70d220019f2844d39e6b4d4a82d58651 in current term 1: Already voted for candidate c94fa553e252439ea1cebcb127e9cf85 in this term.
I20260709 12:26:39.329824  5131 leader_election.cc:304] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651; no voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:39.330529  5367 raft_consensus.cc:3060] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.335381  5367 raft_consensus.cc:2749] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:39.407081  5364 consensus_queue.cc:1048] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.417227  5386 consensus_queue.cc:1048] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.454504 29732 ts_manager.cc:295] Set tserver state for 70d220019f2844d39e6b4d4a82d58651 to MAINTENANCE_MODE
I20260709 12:26:39.455298 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
I20260709 12:26:39.459357  5367 consensus_queue.cc:1048] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.476150  5365 consensus_queue.cc:1048] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.485142  5388 consensus_queue.cc:1048] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.494766 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:39.495687 29732 tablet_replica.cc:333] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.496531 29732 raft_consensus.cc:2243] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.496949 29732 raft_consensus.cc:2272] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.499924 29732 tablet_replica.cc:333] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
W20260709 12:26:39.500382  5283 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 280 similar messages]
I20260709 12:26:39.501245 29732 raft_consensus.cc:2243] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.502139 29732 pending_rounds.cc:70] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Trying to abort 1 pending ops.
I20260709 12:26:39.502403 29732 pending_rounds.cc:77] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625596964290560 op_type: NO_OP noop_request { }
I20260709 12:26:39.502803 29732 raft_consensus.cc:2889] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:39.503135 29732 raft_consensus.cc:2272] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.505714  5283 consensus_peers.cc:597] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.508201 29732 tablet_replica.cc:333] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.508801 29732 raft_consensus.cc:2243] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.509265 29732 raft_consensus.cc:2272] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.511119 29732 tablet_replica.cc:333] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.511606 29732 raft_consensus.cc:2243] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.511987 29732 raft_consensus.cc:2272] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.514170 29732 tablet_replica.cc:333] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.514652 29732 raft_consensus.cc:2243] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.515372 29732 raft_consensus.cc:2272] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.517313 29732 tablet_replica.cc:333] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.517791 29732 raft_consensus.cc:2243] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.518088 29732 raft_consensus.cc:2272] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.519939 29732 tablet_replica.cc:333] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.520414 29732 raft_consensus.cc:2243] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.520756 29732 raft_consensus.cc:2272] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.522672 29732 tablet_replica.cc:333] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.523211 29732 raft_consensus.cc:2243] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.523543 29732 raft_consensus.cc:2272] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.525357 29732 tablet_replica.cc:333] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.525811 29732 raft_consensus.cc:2243] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.526568 29732 raft_consensus.cc:2272] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.528566 29732 tablet_replica.cc:333] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: stopping tablet replica
I20260709 12:26:39.529012 29732 raft_consensus.cc:2243] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.529346 29732 raft_consensus.cc:2272] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.559373 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
W20260709 12:26:39.583927  5209 consensus_peers.cc:597] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.650060  5392 consensus_queue.cc:1048] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:39.663427  5283 consensus_peers.cc:597] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.674889  5283 consensus_peers.cc:597] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.688597  5388 consensus_queue.cc:1048] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:39.707249  5386 consensus_queue.cc:1048] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:39.714973  5283 consensus_peers.cc:597] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.760612  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:39.923250  5209 consensus_peers.cc:597] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.992993  5209 consensus_peers.cc:597] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:40.761600  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:40.768075  5442 raft_consensus.cc:493] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70d220019f2844d39e6b4d4a82d58651)
I20260709 12:26:40.768611  5442 raft_consensus.cc:515] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:40.770231  5442 leader_election.cc:290] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:40.770891  5386 raft_consensus.cc:493] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70d220019f2844d39e6b4d4a82d58651)
I20260709 12:26:40.771378  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
I20260709 12:26:40.771436  5386 raft_consensus.cc:515] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:40.772598  5242 raft_consensus.cc:2468] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 1.
I20260709 12:26:40.773494  5386 leader_election.cc:290] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:40.773780  5280 leader_election.cc:304] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
W20260709 12:26:40.774331  5283 leader_election.cc:336] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:40.774586  5442 raft_consensus.cc:2804] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.775020  5442 raft_consensus.cc:493] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70d220019f2844d39e6b4d4a82d58651)
I20260709 12:26:40.775413  5442 raft_consensus.cc:3060] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.775213  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
W20260709 12:26:40.777362  5209 leader_election.cc:336] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:40.780304  5442 raft_consensus.cc:515] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:40.781205  5317 raft_consensus.cc:2393] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c73e1310d404f02a954bd5b1417ee5f in current term 2: Already voted for candidate c94fa553e252439ea1cebcb127e9cf85 in this term.
I20260709 12:26:40.781960  5442 leader_election.cc:290] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:40.783179  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253f5465ed0141cdb7779f548101d1b4" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:40.783669  5242 raft_consensus.cc:3060] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.784072  5206 leader_election.cc:304] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f; no voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85
W20260709 12:26:40.785647  5283 leader_election.cc:336] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:40.789553  5242 raft_consensus.cc:2468] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 2.
I20260709 12:26:40.789983  5386 raft_consensus.cc:2749] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.790443  5280 leader_election.cc:304] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:40.791119  5442 raft_consensus.cc:2804] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.791555  5442 raft_consensus.cc:697] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:40.792253  5442 consensus_queue.cc:237] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:40.798586  5064 catalog_manager.cc:5697] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 1 to 2, leader changed from 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1) to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.975529  5442 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70d220019f2844d39e6b4d4a82d58651)
I20260709 12:26:40.976208  5442 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:40.978322  5442 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:40.980331  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f" is_pre_election: true
W20260709 12:26:40.981971  5283 leader_election.cc:336] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:40.982590  5280 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c94fa553e252439ea1cebcb127e9cf85; no voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:40.983366  5442 raft_consensus.cc:2749] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.984570  5386 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 70d220019f2844d39e6b4d4a82d58651)
I20260709 12:26:40.985119  5386 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:40.987294  5386 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:40.988336  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:40.989037  5317 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 1.
I20260709 12:26:40.990022  5206 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:40.990780  5386 raft_consensus.cc:2804] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.991200  5386 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 70d220019f2844d39e6b4d4a82d58651)
I20260709 12:26:40.991632  5386 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:40.991880  5209 leader_election.cc:336] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:40.999279  5386 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:41.001662  5386 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:41.005541  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
W20260709 12:26:41.006114  5209 leader_election.cc:336] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:41.006218  5317 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.011404  5317 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 2.
I20260709 12:26:41.012326  5206 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:41.012917  5386 raft_consensus.cc:2804] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:41.013289  5386 raft_consensus.cc:697] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:41.014029  5386 consensus_queue.cc:237] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:41.020522  5064 catalog_manager.cc:5697] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 1 to 2, leader changed from 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1) to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 2 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.287437  5242 raft_consensus.cc:1275] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.288578  5442 consensus_queue.cc:1048] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:41.302706  5283 consensus_peers.cc:597] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.341657  5386 raft_consensus.cc:493] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.342181  5386 raft_consensus.cc:515] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:41.344092  5386 leader_election.cc:290] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:41.345228  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83743ec8e94e45b585d768fb747b46" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85" is_pre_election: true
I20260709 12:26:41.345844  5317 raft_consensus.cc:2468] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 1.
I20260709 12:26:41.346735  5206 leader_election.cc:304] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:41.347321  5386 raft_consensus.cc:2804] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:41.347584  5386 raft_consensus.cc:493] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:41.347708  5209 leader_election.cc:336] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:41.347888  5386 raft_consensus.cc:3060] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.352905  5386 raft_consensus.cc:515] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:41.354321  5386 leader_election.cc:290] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:41.355371  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec83743ec8e94e45b585d768fb747b46" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:41.355957  5317 raft_consensus.cc:3060] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:41.357512  5209 leader_election.cc:336] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111)
I20260709 12:26:41.360888  5317 raft_consensus.cc:2468] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 2.
I20260709 12:26:41.361750  5206 leader_election.cc:304] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, c94fa553e252439ea1cebcb127e9cf85; no voters: 70d220019f2844d39e6b4d4a82d58651
I20260709 12:26:41.362314  5386 raft_consensus.cc:2804] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:41.362639  5386 raft_consensus.cc:697] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:41.363207  5386 consensus_queue.cc:237] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:41.370124  5063 catalog_manager.cc:5697] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 1 to 2, leader changed from 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1) to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 2 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.397993  5317 raft_consensus.cc:1275] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:41.399093  5386 consensus_queue.cc:1048] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:41.413893  5209 consensus_peers.cc:597] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.762451  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:41.796310  5209 consensus_peers.cc:597] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.945832  5317 raft_consensus.cc:1275] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:41.946944  5457 consensus_queue.cc:1048] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:42.059031  5283 consensus_peers.cc:597] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:42.070233  5283 consensus_peers.cc:597] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:42.250735  5209 consensus_peers.cc:597] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:42.352432  5283 consensus_peers.cc:597] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:42.419654  5283 consensus_peers.cc:597] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:42.520701  5209 consensus_peers.cc:597] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:42.613886  5209 consensus_peers.cc:597] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:42.763391  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:43.617668  5283 consensus_peers.cc:597] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:43.764467  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:26:43.906415  5209 consensus_peers.cc:597] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:44.474632  5209 consensus_peers.cc:597] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:44.556792  5209 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111) [suppressed 96 similar messages]
I20260709 12:26:44.577347 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:44.583552  5463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:44.583784  5464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:44.587872  5466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:44.589636 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:44.591890 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:44.592157 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:44.592303 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600004592290 us; error 0 us; skew 500 ppm
I20260709 12:26:44.592768 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:44.595028 29732 webserver.cc:533] Webserver started at http://127.29.9.1:34321/ using document root <none> and password file <none>
I20260709 12:26:44.595464 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:44.595607 29732 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:44.599043 29732 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:26:44.602612  5471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:44.603433 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:44.603756 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "70d220019f2844d39e6b4d4a82d58651"
format_stamp: "Formatted at 2026-07-09 12:26:37 on dist-test-slave-ftzc"
I20260709 12:26:44.604048 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:44.619422 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:44.620508 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:44.621938 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:44.625138  5478 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:26:44.649554  5283 consensus_peers.cc:597] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:44.671265  5283 consensus_peers.cc:597] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:44.672318 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:26:44.672631 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.048s	user 0.002s	sys 0.000s
I20260709 12:26:44.672912 29732 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:26:44.678048  5478 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.689852  5478 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.690537  5478 tablet_bootstrap.cc:492] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.691044  5478 ts_tablet_manager.cc:1403] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:44.692950  5478 raft_consensus.cc:359] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.693436  5478 raft_consensus.cc:740] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.694023  5478 consensus_queue.cc:260] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.696362  5478 ts_tablet_manager.cc:1434] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:26:44.697103  5478 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.709856  5478 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.710464  5478 tablet_bootstrap.cc:492] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.711063  5478 ts_tablet_manager.cc:1403] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:26:44.713407  5478 raft_consensus.cc:359] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.713646 29732 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:26:44.714111 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.041s	user 0.041s	sys 0.000s
I20260709 12:26:44.713999  5478 raft_consensus.cc:740] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.714993  5478 consensus_queue.cc:260] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
W20260709 12:26:44.715679  5209 consensus_peers.cc:597] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:44.716761  5478 ts_tablet_manager.cc:1434] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:26:44.717446  5478 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.730086  5478 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.730856  5478 tablet_bootstrap.cc:492] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.731393  5478 ts_tablet_manager.cc:1403] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:26:44.733613  5478 raft_consensus.cc:359] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.734144  5478 raft_consensus.cc:740] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.734787  5478 consensus_queue.cc:260] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.736590  5478 ts_tablet_manager.cc:1434] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:44.737258  5478 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.746968  5478 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.747664  5478 tablet_bootstrap.cc:492] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.748359  5478 ts_tablet_manager.cc:1403] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:26:44.750242  5478 raft_consensus.cc:359] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.750900  5478 raft_consensus.cc:740] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.751469  5478 consensus_queue.cc:260] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.752969  5478 ts_tablet_manager.cc:1434] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:44.753568  5478 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
W20260709 12:26:44.765529  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:44.765663  5478 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.766520  5478 tablet_bootstrap.cc:492] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.767117  5478 ts_tablet_manager.cc:1403] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:26:44.768658 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:44589
I20260709 12:26:44.768757  5540 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:44589 every 8 connection(s)
I20260709 12:26:44.769232  5478 raft_consensus.cc:359] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.769753  5478 raft_consensus.cc:740] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.770280  5478 consensus_queue.cc:260] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.771620  5478 ts_tablet_manager.cc:1434] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20260709 12:26:44.772221  5478 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.777565 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.800130  5478 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.800751  5478 tablet_bootstrap.cc:492] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.801257  5478 ts_tablet_manager.cc:1403] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.008s
I20260709 12:26:44.803313  5478 raft_consensus.cc:359] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.805450  5478 raft_consensus.cc:740] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.806169  5478 consensus_queue.cc:260] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.808168  5541 heartbeater.cc:344] Connected to a master server at 127.29.9.62:46169
I20260709 12:26:44.808382  5478 ts_tablet_manager.cc:1434] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:26:44.808583  5541 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:44.809239  5478 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.809888  5541 heartbeater.cc:507] Master 127.29.9.62:46169 requested a full tablet report, sending...
I20260709 12:26:44.816303  5063 ts_manager.cc:194] Re-registered known tserver with Master: 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589)
I20260709 12:26:44.818182  5317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
mode: GRACEFUL
new_leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:26:44.818934  5317 raft_consensus.cc:606] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Received request to transfer leadership to TS 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:44.826721  5063 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32992
I20260709 12:26:44.829504  5478 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.829972  5541 heartbeater.cc:499] Master 127.29.9.62:46169 was elected leader, sending a full tablet report...
I20260709 12:26:44.830353  5478 tablet_bootstrap.cc:492] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.831054  5478 ts_tablet_manager.cc:1403] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:26:44.831522  5242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
mode: GRACEFUL
new_leader_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:32908
I20260709 12:26:44.832185  5242 raft_consensus.cc:606] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Received request to transfer leadership to TS c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:44.837512 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:44.837622  5478 raft_consensus.cc:359] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.838174 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:44.838289  5478 raft_consensus.cc:740] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.838930 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.839212  5478 consensus_queue.cc:260] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.841207  5478 ts_tablet_manager.cc:1434] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:26:44.841979  5478 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.854465  5478 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:26:44.855420  5478 tablet_bootstrap.cc:492] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.856076  5478 ts_tablet_manager.cc:1403] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:26:44.858080  5478 raft_consensus.cc:359] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.858704  5478 raft_consensus.cc:740] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.859251  5478 consensus_queue.cc:260] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.860662  5478 ts_tablet_manager.cc:1434] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:26:44.861290  5478 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.873591  5478 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.874219  5478 tablet_bootstrap.cc:492] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.874688  5478 ts_tablet_manager.cc:1403] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:26:44.876367  5478 raft_consensus.cc:359] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.876808  5478 raft_consensus.cc:740] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.877293  5478 consensus_queue.cc:260] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.878633  5478 ts_tablet_manager.cc:1434] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:44.879230  5478 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap starting.
I20260709 12:26:44.892136  5478 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:44.892835  5478 tablet_bootstrap.cc:492] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Bootstrap complete.
I20260709 12:26:44.893333  5478 ts_tablet_manager.cc:1403] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:26:44.894924  5478 raft_consensus.cc:359] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.895386  5478 raft_consensus.cc:740] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d220019f2844d39e6b4d4a82d58651, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.895888  5478 consensus_queue.cc:260] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:44.897553  5478 ts_tablet_manager.cc:1434] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:44.974419  5515 raft_consensus.cc:3060] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.980724  5515 pending_rounds.cc:85] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Aborting all ops after (but not including) 0
I20260709 12:26:44.981065  5515 pending_rounds.cc:107] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:26:44.981290  5515 raft_consensus.cc:2889] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.012502  5515 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.032394  5459 raft_consensus.cc:993] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f: : Instructing follower c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:45.032792  5559 raft_consensus.cc:1081] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Signalling peer c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:45.034087  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:57960
I20260709 12:26:45.034565  5317 raft_consensus.cc:493] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:45.034842  5317 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.039675  5317 raft_consensus.cc:515] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.040984  5317 leader_election.cc:290] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:45.041677  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:45.041934  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:45.042310  5515 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.042487  5242 raft_consensus.cc:3055] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:45.042877  5242 raft_consensus.cc:740] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:45.043644  5242 consensus_queue.cc:260] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.044917  5242 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.048785  5515 raft_consensus.cc:2468] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 2.
I20260709 12:26:45.050007  5283 leader_election.cc:304] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:45.050832  5462 raft_consensus.cc:2804] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:45.051350  5242 raft_consensus.cc:2468] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 2.
I20260709 12:26:45.052160  5462 raft_consensus.cc:697] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:45.053030  5462 consensus_queue.cc:237] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.059245  5064 catalog_manager.cc:5697] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 1 to 2, leader changed from 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2) to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.198187  5560 raft_consensus.cc:993] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85: : Instructing follower 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:45.198621  5462 raft_consensus.cc:1081] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Signalling peer 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:45.199921  5242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:35798
I20260709 12:26:45.200349  5242 raft_consensus.cc:493] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:45.200618  5242 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.206277  5242 raft_consensus.cc:515] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.207882  5242 leader_election.cc:290] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:45.208097  5515 raft_consensus.cc:3060] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.208707  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:45.208961  5316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:45.209388  5513 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.209520  5316 raft_consensus.cc:3055] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:45.210197  5316 raft_consensus.cc:740] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:45.210872  5316 consensus_queue.cc:260] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.211853  5316 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.216604  5513 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 2.
I20260709 12:26:45.217121  5316 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 2.
I20260709 12:26:45.218036  5209 leader_election.cc:304] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:45.219586  5459 raft_consensus.cc:2804] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:45.220039  5459 raft_consensus.cc:697] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:45.220659  5459 consensus_queue.cc:237] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.227550  5064 catalog_manager.cc:5697] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 1 to 2, leader changed from c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3) to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 2 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.496130  5242 raft_consensus.cc:1275] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:45.497381  5571 consensus_queue.cc:1048] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:45.507582  5515 raft_consensus.cc:1275] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:45.509140  5462 consensus_queue.cc:1048] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:45.631965  5316 raft_consensus.cc:1275] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:45.633152  5559 consensus_queue.cc:1048] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:45.641834  5513 raft_consensus.cc:1275] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:45.643397  5459 consensus_queue.cc:1048] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:45.766695  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:45.846482 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:45.853710  5242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
mode: GRACEFUL
new_leader_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:32908
I20260709 12:26:45.854190  5242 raft_consensus.cc:606] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Received request to transfer leadership to TS c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:45.856510  5316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
mode: GRACEFUL
new_leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:26:45.856961  5316 raft_consensus.cc:606] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Received request to transfer leadership to TS 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:45.858003 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:45.858429 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:45.858982 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:45.985774  5462 raft_consensus.cc:993] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85: : Instructing follower 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:45.986264  5571 raft_consensus.cc:1081] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Signalling peer 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:45.987810  5242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:35798
I20260709 12:26:45.988353  5242 raft_consensus.cc:493] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:45.988632  5242 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.994665  5242 raft_consensus.cc:515] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.996342  5242 leader_election.cc:290] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 3 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:45.996937  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:45.997241  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4639b2888d9464585dc1130e85a74ce" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:45.997561  5513 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.997736  5317 raft_consensus.cc:3055] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:45.998044  5317 raft_consensus.cc:740] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:45.998725  5317 consensus_queue.cc:260] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:45.999588  5317 raft_consensus.cc:3060] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.002349  5513 raft_consensus.cc:2468] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 3.
I20260709 12:26:46.003302  5209 leader_election.cc:304] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:46.004072  5570 raft_consensus.cc:2804] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:46.004226  5317 raft_consensus.cc:2468] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 3.
I20260709 12:26:46.004478  5570 raft_consensus.cc:697] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 3 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:46.005347  5570 consensus_queue.cc:237] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:46.010885  5064 catalog_manager.cc:5697] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 2 to 3, leader changed from c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3) to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 3 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.019022  5459 raft_consensus.cc:993] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f: : Instructing follower c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:46.019447  5570 raft_consensus.cc:1081] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Signalling peer c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:46.020730  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:57960
I20260709 12:26:46.021191  5317 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.021481  5317 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.025678  5317 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:46.027035  5317 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 3 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:46.027676  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:46.028175  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:46.028203  5513 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.028649  5242 raft_consensus.cc:3055] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:46.028877  5242 raft_consensus.cc:740] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:46.029408  5242 consensus_queue.cc:260] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:46.030236  5242 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.033003  5513 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 3.
I20260709 12:26:46.033963  5283 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:46.034439  5242 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 3.
I20260709 12:26:46.034601  5571 raft_consensus.cc:2804] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:46.035107  5571 raft_consensus.cc:697] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:46.036036  5571 consensus_queue.cc:237] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:46.041965  5064 catalog_manager.cc:5697] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 2 to 3, leader changed from 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2) to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.531407  5317 raft_consensus.cc:1275] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:46.532518  5570 consensus_queue.cc:1048] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:46.543174  5513 raft_consensus.cc:1275] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:46.545563  5570 consensus_queue.cc:1048] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:46.551944  5515 raft_consensus.cc:1275] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:46.553612  5571 consensus_queue.cc:1048] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:46.563490  5242 raft_consensus.cc:1275] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:46.570359  5588 consensus_queue.cc:1048] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:46.767665  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:46.865067 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.872357  5317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
mode: GRACEFUL
new_leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:26:46.872886  5317 raft_consensus.cc:606] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Received request to transfer leadership to TS 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:46.875388  5242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
mode: GRACEFUL
new_leader_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:32908
I20260709 12:26:46.875850  5242 raft_consensus.cc:606] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Received request to transfer leadership to TS c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:46.876905 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:46.877378 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:46.877904 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.890100  5589 raft_consensus.cc:993] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85: : Instructing follower 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:46.890568  5588 raft_consensus.cc:1081] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Signalling peer 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:46.892055  5242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:35798
I20260709 12:26:46.892526  5242 raft_consensus.cc:493] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.892772  5242 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.897058  5242 raft_consensus.cc:515] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:46.898379  5242 leader_election.cc:290] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:46.899124  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:46.899356  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:46.899783  5513 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.899881  5317 raft_consensus.cc:3055] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:46.900272  5317 raft_consensus.cc:740] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:46.901001  5317 consensus_queue.cc:260] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:46.902160  5317 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.906471  5513 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 2.
I20260709 12:26:46.907764  5209 leader_election.cc:304] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:46.908475  5570 raft_consensus.cc:2804] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:46.908565  5317 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 2.
I20260709 12:26:46.908903  5570 raft_consensus.cc:697] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:46.909701  5570 consensus_queue.cc:237] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:46.915632  5064 catalog_manager.cc:5697] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 1 to 2, leader changed from c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3) to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 2 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.037662  5559 raft_consensus.cc:993] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f: : Instructing follower c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:47.038128  5570 raft_consensus.cc:1081] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Signalling peer c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:47.039428  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:57960
I20260709 12:26:47.039887  5317 raft_consensus.cc:493] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.040148  5317 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.044679  5317 raft_consensus.cc:515] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:47.046095  5317 leader_election.cc:290] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:47.046829  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:47.047139  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:47.047387  5513 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.047712  5242 raft_consensus.cc:3055] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:47.047995  5242 raft_consensus.cc:740] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:47.048586  5242 consensus_queue.cc:260] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:47.049449  5242 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.052349  5513 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 2.
I20260709 12:26:47.053354  5283 leader_election.cc:304] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:47.054059  5242 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 2.
I20260709 12:26:47.054095  5588 raft_consensus.cc:2804] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:47.054818  5588 raft_consensus.cc:697] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:47.055660  5588 consensus_queue.cc:237] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:47.062978  5064 catalog_manager.cc:5697] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 1 to 2, leader changed from 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2) to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.347502  5513 raft_consensus.cc:1275] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:47.348757  5559 consensus_queue.cc:1048] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:47.355567  5317 raft_consensus.cc:1275] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:47.357057  5559 consensus_queue.cc:1048] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:47.472687  5242 raft_consensus.cc:1275] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:47.474088  5588 consensus_queue.cc:1048] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:47.476413  5513 raft_consensus.cc:1275] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:47.477622  5589 consensus_queue.cc:1048] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:47.768625  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:47.884274 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:47.928561  5242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
mode: GRACEFUL
new_leader_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:32908
I20260709 12:26:47.929365  5242 raft_consensus.cc:606] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Received request to transfer leadership to TS c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:47.932435  5317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
mode: GRACEFUL
new_leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:26:47.932943  5317 raft_consensus.cc:606] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Received request to transfer leadership to TS 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:47.934346 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:47.934894 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:47.935704 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:48.321803  5589 raft_consensus.cc:993] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85: : Instructing follower 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:48.322331  5606 raft_consensus.cc:1081] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Signalling peer 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:48.323711  5242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:35798
I20260709 12:26:48.324203  5242 raft_consensus.cc:493] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.324498  5242 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.331507  5242 raft_consensus.cc:515] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:48.333237  5242 leader_election.cc:290] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 3 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:48.334326  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:48.334196  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4a532a53221439fa03f8448feb5fb2c" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:48.334957  5317 raft_consensus.cc:3055] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:48.335076  5513 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.335319  5317 raft_consensus.cc:740] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:48.336476  5317 consensus_queue.cc:260] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:48.337837  5317 raft_consensus.cc:3060] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.344183  5513 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 3.
I20260709 12:26:48.345510  5209 leader_election.cc:304] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:48.346371  5596 raft_consensus.cc:2804] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:48.346560  5317 raft_consensus.cc:2468] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 3.
I20260709 12:26:48.346935  5596 raft_consensus.cc:697] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 3 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:48.348299  5596 consensus_queue.cc:237] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:48.351541  5596 raft_consensus.cc:993] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: : Instructing follower c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:48.352207  5559 raft_consensus.cc:1081] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Signalling peer c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:48.353829  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:57960
I20260709 12:26:48.354389  5317 raft_consensus.cc:493] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.354720  5317 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.356604  5065 catalog_manager.cc:5697] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 2 to 3, leader changed from c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3) to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 3 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.359547  5317 raft_consensus.cc:515] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:48.361605  5317 leader_election.cc:290] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 3 election: Requested vote from peers 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589), 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589)
I20260709 12:26:48.362527  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:48.363121  5515 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.363165  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23b7a75d9e3f4997b83329a3a2e7d084" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:48.363926  5242 raft_consensus.cc:3055] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:48.364305  5242 raft_consensus.cc:740] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:48.365283  5242 consensus_queue.cc:260] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:48.366650  5242 raft_consensus.cc:3060] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.372287  5515 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 3.
I20260709 12:26:48.373461  5283 leader_election.cc:304] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:48.373574  5242 raft_consensus.cc:2468] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 3.
I20260709 12:26:48.374157  5606 raft_consensus.cc:2804] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:48.374647  5606 raft_consensus.cc:697] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:48.375542  5606 consensus_queue.cc:237] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:48.382859  5065 catalog_manager.cc:5697] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 2 to 3, leader changed from 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2) to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:48.769656  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:48.777712  5317 raft_consensus.cc:1275] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:48.778939  5559 consensus_queue.cc:1048] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:48.787883  5515 raft_consensus.cc:1275] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:48.790140  5559 consensus_queue.cc:1048] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:48.848654  5242 raft_consensus.cc:1275] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:48.849812  5606 consensus_queue.cc:1048] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:48.858300  5513 raft_consensus.cc:1275] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:48.860466  5606 consensus_queue.cc:1048] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:48.942225 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:48.949450  5317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
mode: GRACEFUL
new_leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:36450
I20260709 12:26:48.949910  5317 raft_consensus.cc:606] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Received request to transfer leadership to TS 6c73e1310d404f02a954bd5b1417ee5f
I20260709 12:26:48.952371  5242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
mode: GRACEFUL
new_leader_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:32908
I20260709 12:26:48.952842  5242 raft_consensus.cc:606] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Received request to transfer leadership to TS c94fa553e252439ea1cebcb127e9cf85
I20260709 12:26:48.953981 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:48.954457 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:48.954988 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.180126  5596 raft_consensus.cc:993] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f: : Instructing follower c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:49.180627  5559 raft_consensus.cc:1081] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Signalling peer c94fa553e252439ea1cebcb127e9cf85 to start an election
I20260709 12:26:49.182046  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee"
dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
 from {username='slave'} at 127.0.0.1:57960
I20260709 12:26:49.182441  5317 raft_consensus.cc:493] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.182664  5317 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.187484  5317 raft_consensus.cc:515] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:49.189028  5317 leader_election.cc:290] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 3 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2:40589)
I20260709 12:26:49.189774  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:49.190254  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94ebfb69ab2747489b1cd5a37b2bccee" candidate_uuid: "c94fa553e252439ea1cebcb127e9cf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
I20260709 12:26:49.190429  5513 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.190853  5242 raft_consensus.cc:3055] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:49.191157  5242 raft_consensus.cc:740] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:49.192073  5242 consensus_queue.cc:260] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:49.193385  5242 raft_consensus.cc:3060] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.197849  5513 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 3.
I20260709 12:26:49.199169  5283 leader_election.cc:304] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70d220019f2844d39e6b4d4a82d58651, c94fa553e252439ea1cebcb127e9cf85; no voters: 
I20260709 12:26:49.199970  5606 raft_consensus.cc:2804] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:49.200357  5606 raft_consensus.cc:697] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Becoming Leader. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:49.200368  5242 raft_consensus.cc:2468] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c94fa553e252439ea1cebcb127e9cf85 in term 3.
I20260709 12:26:49.201371  5606 consensus_queue.cc:237] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:49.210346  5065 catalog_manager.cc:5697] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 reported cstate change: term changed from 2 to 3, leader changed from 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2) to c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "c94fa553e252439ea1cebcb127e9cf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:49.426697  5619 raft_consensus.cc:993] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85: : Instructing follower 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:49.427186  5606 raft_consensus.cc:1081] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Signalling peer 6c73e1310d404f02a954bd5b1417ee5f to start an election
I20260709 12:26:49.428511  5242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846"
dest_uuid: "6c73e1310d404f02a954bd5b1417ee5f"
 from {username='slave'} at 127.0.0.1:35798
I20260709 12:26:49.428918  5242 raft_consensus.cc:493] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.429175  5242 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.433480  5242 raft_consensus.cc:515] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:49.434841  5242 leader_election.cc:290] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 4 election: Requested vote from peers 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589), c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3:39609)
I20260709 12:26:49.435698  5513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "70d220019f2844d39e6b4d4a82d58651"
I20260709 12:26:49.435833  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a09e43c400a4342a80c735e7a584846" candidate_uuid: "6c73e1310d404f02a954bd5b1417ee5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c94fa553e252439ea1cebcb127e9cf85"
I20260709 12:26:49.436378  5513 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.436452  5317 raft_consensus.cc:3055] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:49.436803  5317 raft_consensus.cc:740] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c94fa553e252439ea1cebcb127e9cf85, State: Running, Role: LEADER
I20260709 12:26:49.437547  5317 consensus_queue.cc:260] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:49.438578  5317 raft_consensus.cc:3060] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.441180  5513 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 4.
I20260709 12:26:49.442178  5209 leader_election.cc:304] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c73e1310d404f02a954bd5b1417ee5f, 70d220019f2844d39e6b4d4a82d58651; no voters: 
I20260709 12:26:49.443012  5559 raft_consensus.cc:2804] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:49.443389  5317 raft_consensus.cc:2468] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c73e1310d404f02a954bd5b1417ee5f in term 4.
I20260709 12:26:49.443408  5559 raft_consensus.cc:697] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 4 LEADER]: Becoming Leader. State: Replica: 6c73e1310d404f02a954bd5b1417ee5f, State: Running, Role: LEADER
I20260709 12:26:49.444422  5559 consensus_queue.cc:237] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } }
I20260709 12:26:49.451153  5064 catalog_manager.cc:5697] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f reported cstate change: term changed from 3 to 4, leader changed from c94fa553e252439ea1cebcb127e9cf85 (127.29.9.3) to 6c73e1310d404f02a954bd5b1417ee5f (127.29.9.2). New cstate: current_term: 4 leader_uuid: "6c73e1310d404f02a954bd5b1417ee5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.711449  5513 raft_consensus.cc:1275] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:49.712549  5606 consensus_queue.cc:1048] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:49.722903  5242 raft_consensus.cc:1275] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Refusing update from remote peer c94fa553e252439ea1cebcb127e9cf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:49.724584  5619 consensus_queue.cc:1048] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c73e1310d404f02a954bd5b1417ee5f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:49.770640  5113 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:26:49.828806  5513 raft_consensus.cc:1275] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 4 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:49.830026  5559 consensus_queue.cc:1048] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "70d220019f2844d39e6b4d4a82d58651" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 44589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:49.838586  5317 raft_consensus.cc:1275] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 4 FOLLOWER]: Refusing update from remote peer 6c73e1310d404f02a954bd5b1417ee5f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:49.840713  5559 consensus_queue.cc:1048] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c94fa553e252439ea1cebcb127e9cf85" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 39609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:49.961241 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.990561 29732 tablet_server.cc:179] TabletServer@127.29.9.1:44589 shutting down...
I20260709 12:26:50.010830 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:50.011580 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.012307 29732 raft_consensus.cc:2243] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.012780 29732 raft_consensus.cc:2272] T ec83743ec8e94e45b585d768fb747b46 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.015197 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.015901 29732 raft_consensus.cc:2243] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.016376 29732 raft_consensus.cc:2272] T acd0176396da4860a111677176304f6d P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.018707 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.019366 29732 raft_consensus.cc:2243] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.019860 29732 raft_consensus.cc:2272] T 3245713e7c7e482c8d7c30265e516027 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.021973 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.022495 29732 raft_consensus.cc:2243] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.022854 29732 raft_consensus.cc:2272] T 23b7a75d9e3f4997b83329a3a2e7d084 P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.024952 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.025522 29732 raft_consensus.cc:2243] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.025945 29732 raft_consensus.cc:2272] T 253f5465ed0141cdb7779f548101d1b4 P 70d220019f2844d39e6b4d4a82d58651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.028046 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.028509 29732 raft_consensus.cc:2243] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.028947 29732 raft_consensus.cc:2272] T c4a532a53221439fa03f8448feb5fb2c P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.031111 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.031590 29732 raft_consensus.cc:2243] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.032039 29732 raft_consensus.cc:2272] T 0a09e43c400a4342a80c735e7a584846 P 70d220019f2844d39e6b4d4a82d58651 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.034668 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.035183 29732 raft_consensus.cc:2243] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.035687 29732 raft_consensus.cc:2272] T 94ebfb69ab2747489b1cd5a37b2bccee P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.038188 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.038667 29732 raft_consensus.cc:2243] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.039021 29732 raft_consensus.cc:2272] T 99ada8b79d5549229ded6a85cfe4d014 P 70d220019f2844d39e6b4d4a82d58651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.041070 29732 tablet_replica.cc:333] stopping tablet replica
I20260709 12:26:50.041576 29732 raft_consensus.cc:2243] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.042021 29732 raft_consensus.cc:2272] T c4639b2888d9464585dc1130e85a74ce P 70d220019f2844d39e6b4d4a82d58651 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:50.052289  5209 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:26:50.055207  5209 consensus_peers.cc:597] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.073699 29732 tablet_server.cc:196] TabletServer@127.29.9.1:44589 shutdown complete.
W20260709 12:26:50.097658  5209 consensus_peers.cc:597] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.102744 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
W20260709 12:26:50.119900  5283 consensus_peers.cc:597] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.126291 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:50.127038 29732 tablet_replica.cc:333] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.127693 29732 raft_consensus.cc:2243] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.128327 29732 raft_consensus.cc:2272] T acd0176396da4860a111677176304f6d P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.130560 29732 tablet_replica.cc:333] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.131114 29732 raft_consensus.cc:2243] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.131943 29732 raft_consensus.cc:2272] T 0a09e43c400a4342a80c735e7a584846 P 6c73e1310d404f02a954bd5b1417ee5f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.134403 29732 tablet_replica.cc:333] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.134987 29732 raft_consensus.cc:2243] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.135913 29732 raft_consensus.cc:2272] T ec83743ec8e94e45b585d768fb747b46 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.138212 29732 tablet_replica.cc:333] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.138770 29732 raft_consensus.cc:2243] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.139155 29732 raft_consensus.cc:2272] T 94ebfb69ab2747489b1cd5a37b2bccee P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.141887 29732 tablet_replica.cc:333] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.142464 29732 raft_consensus.cc:2243] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.142926 29732 raft_consensus.cc:2272] T 253f5465ed0141cdb7779f548101d1b4 P 6c73e1310d404f02a954bd5b1417ee5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.145102 29732 tablet_replica.cc:333] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.145790 29732 raft_consensus.cc:2243] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.146639 29732 raft_consensus.cc:2272] T c4a532a53221439fa03f8448feb5fb2c P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.148788 29732 tablet_replica.cc:333] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.149353 29732 raft_consensus.cc:2243] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.149742 29732 raft_consensus.cc:2272] T 23b7a75d9e3f4997b83329a3a2e7d084 P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.151925 29732 tablet_replica.cc:333] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.152431 29732 raft_consensus.cc:2243] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.152891 29732 raft_consensus.cc:2272] T 3245713e7c7e482c8d7c30265e516027 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.154981 29732 tablet_replica.cc:333] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.155578 29732 raft_consensus.cc:2243] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.156450 29732 raft_consensus.cc:2272] T c4639b2888d9464585dc1130e85a74ce P 6c73e1310d404f02a954bd5b1417ee5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.158514 29732 tablet_replica.cc:333] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f: stopping tablet replica
I20260709 12:26:50.159025 29732 raft_consensus.cc:2243] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.159898 29732 raft_consensus.cc:2272] T 99ada8b79d5549229ded6a85cfe4d014 P 6c73e1310d404f02a954bd5b1417ee5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.191167 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
W20260709 12:26:50.206393  5283 consensus_peers.cc:597] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:50.216800  5283 consensus_peers.cc:597] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.218336 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
W20260709 12:26:50.234450  5283 consensus_peers.cc:597] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.244867 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:50.245568 29732 tablet_replica.cc:333] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.246184 29732 raft_consensus.cc:2243] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.247014 29732 raft_consensus.cc:2272] T acd0176396da4860a111677176304f6d P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.249199 29732 tablet_replica.cc:333] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.249778 29732 raft_consensus.cc:2243] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.250221 29732 raft_consensus.cc:2272] T ec83743ec8e94e45b585d768fb747b46 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.252317 29732 tablet_replica.cc:333] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.252846 29732 raft_consensus.cc:2243] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.253563 29732 raft_consensus.cc:2272] T 94ebfb69ab2747489b1cd5a37b2bccee P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.256122 29732 tablet_replica.cc:333] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.256660 29732 raft_consensus.cc:2243] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.257023 29732 raft_consensus.cc:2272] T 0a09e43c400a4342a80c735e7a584846 P c94fa553e252439ea1cebcb127e9cf85 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.259887 29732 tablet_replica.cc:333] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.260375 29732 raft_consensus.cc:2243] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.260777 29732 raft_consensus.cc:2272] T 99ada8b79d5549229ded6a85cfe4d014 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.262923 29732 tablet_replica.cc:333] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.263458 29732 raft_consensus.cc:2243] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.263916 29732 raft_consensus.cc:2272] T c4639b2888d9464585dc1130e85a74ce P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.265754 29732 tablet_replica.cc:333] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.266219 29732 raft_consensus.cc:2243] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.266588 29732 raft_consensus.cc:2272] T c4a532a53221439fa03f8448feb5fb2c P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.268812 29732 tablet_replica.cc:333] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.269356 29732 raft_consensus.cc:2243] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.270406 29732 raft_consensus.cc:2272] T 253f5465ed0141cdb7779f548101d1b4 P c94fa553e252439ea1cebcb127e9cf85 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:50.271549  5283 consensus_peers.cc:597] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 -> Peer 70d220019f2844d39e6b4d4a82d58651 (127.29.9.1:44589): Couldn't send request to peer 70d220019f2844d39e6b4d4a82d58651. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:44589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.272845 29732 tablet_replica.cc:333] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.273468 29732 raft_consensus.cc:2243] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.274245 29732 raft_consensus.cc:2272] T 3245713e7c7e482c8d7c30265e516027 P c94fa553e252439ea1cebcb127e9cf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.276306 29732 tablet_replica.cc:333] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85: stopping tablet replica
I20260709 12:26:50.276724 29732 raft_consensus.cc:2243] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.277383 29732 raft_consensus.cc:2272] T 23b7a75d9e3f4997b83329a3a2e7d084 P c94fa553e252439ea1cebcb127e9cf85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.307103 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
I20260709 12:26:50.331842 29732 master.cc:562] Master@127.29.9.62:46169 shutting down...
I20260709 12:26:50.353631 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:50.354277 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.354604 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P c71c642b85734905a8d0ac5ea9919cbd: stopping tablet replica
I20260709 12:26:50.374894 29732 master.cc:584] Master@127.29.9.62:46169 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12786 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:26:50.416813 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:36821
I20260709 12:26:50.417906 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:50.423846  5643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.424026  5642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.424264  5645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.425331 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:50.426204 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:50.426399 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:50.426542 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600010426525 us; error 0 us; skew 500 ppm
I20260709 12:26:50.427047 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:50.429392 29732 webserver.cc:533] Webserver started at http://127.29.9.62:36371/ using document root <none> and password file <none>
I20260709 12:26:50.429876 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:50.430037 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:50.430294 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:50.431365 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "a9ccf77cc40e40e29d91a6266cee5b9a"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.435631 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 12:26:50.439018  5650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.439688 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:50.440008 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "a9ccf77cc40e40e29d91a6266cee5b9a"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.440284 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:50.450698 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:50.451912 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:50.488569 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:36821
I20260709 12:26:50.488704  5701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:36821 every 8 connection(s)
I20260709 12:26:50.492295  5702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:50.502950  5702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a: Bootstrap starting.
I20260709 12:26:50.507694  5702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.511801  5702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a: No bootstrap required, opened a new log
I20260709 12:26:50.513907  5702 raft_consensus.cc:359] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" member_type: VOTER }
I20260709 12:26:50.514272  5702 raft_consensus.cc:385] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.514487  5702 raft_consensus.cc:740] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9ccf77cc40e40e29d91a6266cee5b9a, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.515017  5702 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" member_type: VOTER }
I20260709 12:26:50.515451  5702 raft_consensus.cc:399] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:50.515657  5702 raft_consensus.cc:493] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:50.515928  5702 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.520695  5702 raft_consensus.cc:515] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" member_type: VOTER }
I20260709 12:26:50.521162  5702 leader_election.cc:304] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9ccf77cc40e40e29d91a6266cee5b9a; no voters: 
I20260709 12:26:50.522233  5702 leader_election.cc:290] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:50.522518  5705 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.523743  5705 raft_consensus.cc:697] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 1 LEADER]: Becoming Leader. State: Replica: a9ccf77cc40e40e29d91a6266cee5b9a, State: Running, Role: LEADER
I20260709 12:26:50.524410  5705 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" member_type: VOTER }
I20260709 12:26:50.525004  5702 sys_catalog.cc:565] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:50.527144  5706 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" member_type: VOTER } }
I20260709 12:26:50.527310  5707 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9ccf77cc40e40e29d91a6266cee5b9a. Latest consensus state: current_term: 1 leader_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9ccf77cc40e40e29d91a6266cee5b9a" member_type: VOTER } }
I20260709 12:26:50.527860  5706 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:50.527917  5707 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:50.531333  5711 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:50.538379  5711 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:50.539283 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:50.546519  5711 catalog_manager.cc:1383] Generated new cluster ID: 5fafe95f261541aca9aa308c5868d4be
I20260709 12:26:50.546802  5711 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:50.565822  5711 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:50.567104  5711 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:50.580693  5711 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a: Generated new TSK 0
I20260709 12:26:50.581341  5711 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:50.605945 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:50.612002  5723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.612725  5724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.614215  5726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.614781 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:50.615602 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:50.615818 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:50.615974 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600010615951 us; error 0 us; skew 500 ppm
I20260709 12:26:50.616478 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:50.618569 29732 webserver.cc:533] Webserver started at http://127.29.9.1:38823/ using document root <none> and password file <none>
I20260709 12:26:50.619016 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:50.619184 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:50.619426 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:50.620509 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "7995cea5430443eba515ea3396f0c02b"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.624797 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:50.628052  5731 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.628726 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:50.629027 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "7995cea5430443eba515ea3396f0c02b"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.629290 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:50.646214 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:50.647425 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:50.648869 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:50.651063 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:50.651252 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.651469 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:50.651629 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.689585 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:41637
I20260709 12:26:50.689694  5793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:41637 every 8 connection(s)
I20260709 12:26:50.694216 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:50.700884  5798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.704705  5799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.709483 29732 server_base.cc:1061] running on GCE node
W20260709 12:26:50.709638  5801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.710162  5794 heartbeater.cc:344] Connected to a master server at 127.29.9.62:36821
I20260709 12:26:50.710633  5794 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:50.710975 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:50.711254 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:50.711452 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600010711433 us; error 0 us; skew 500 ppm
I20260709 12:26:50.711515  5794 heartbeater.cc:507] Master 127.29.9.62:36821 requested a full tablet report, sending...
I20260709 12:26:50.712253 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:50.713804  5667 ts_manager.cc:194] Registered new tserver with Master: 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637)
I20260709 12:26:50.715508  5667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39488
I20260709 12:26:50.717654 29732 webserver.cc:533] Webserver started at http://127.29.9.2:45215/ using document root <none> and password file <none>
I20260709 12:26:50.718256 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:50.718418 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:50.718612 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:50.719691 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "33a483799c2d4453bfbda41c243d1d2f"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.723982 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:26:50.727308  5806 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.728091 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:50.728375 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "33a483799c2d4453bfbda41c243d1d2f"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.728654 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:50.750320 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:50.751473 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:50.752923 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:50.755060 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:50.755247 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.755462 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:50.755609 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.793021 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:46395
I20260709 12:26:50.793115  5868 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:46395 every 8 connection(s)
I20260709 12:26:50.797508 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:50.805199  5872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:50.805339  5873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.809862  5869 heartbeater.cc:344] Connected to a master server at 127.29.9.62:36821
W20260709 12:26:50.810065  5875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:50.810369  5869 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:50.811041 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:50.811357  5869 heartbeater.cc:507] Master 127.29.9.62:36821 requested a full tablet report, sending...
I20260709 12:26:50.812012 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:50.812255 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:50.812443 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600010812413 us; error 0 us; skew 500 ppm
I20260709 12:26:50.813030 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:50.813457  5667 ts_manager.cc:194] Registered new tserver with Master: 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395)
I20260709 12:26:50.814824  5667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39494
I20260709 12:26:50.815760 29732 webserver.cc:533] Webserver started at http://127.29.9.3:37125/ using document root <none> and password file <none>
I20260709 12:26:50.816295 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:50.816478 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:50.816718 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:50.817878 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.822409 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:50.825690  5880 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.826493 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:50.826803 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
format_stamp: "Formatted at 2026-07-09 12:26:50 on dist-test-slave-ftzc"
I20260709 12:26:50.827070 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:50.836261 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:50.837378 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:50.838771 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:50.840925 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:50.841110 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.841321 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:50.841470 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:50.879240 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:41781
I20260709 12:26:50.879356  5942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:41781 every 8 connection(s)
I20260709 12:26:50.892537  5943 heartbeater.cc:344] Connected to a master server at 127.29.9.62:36821
I20260709 12:26:50.892975  5943 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:50.893639  5943 heartbeater.cc:507] Master 127.29.9.62:36821 requested a full tablet report, sending...
I20260709 12:26:50.895413  5667 ts_manager.cc:194] Registered new tserver with Master: 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781)
I20260709 12:26:50.895865 29732 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013565038s
I20260709 12:26:50.897064  5667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39506
I20260709 12:26:50.919634  5667 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39510:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:50.921732  5667 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:50.958936  5908 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6f2ae1b1064e64ac79ecd32b4582ea (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c0ff7c83fabd4eb5aa76e5be54487f75]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:50.960407  5908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6f2ae1b1064e64ac79ecd32b4582ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:50.973922  5907 tablet_service.cc:1511] Processing CreateTablet for tablet fc90347724c548f3b82cabb3bb83576f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c0ff7c83fabd4eb5aa76e5be54487f75]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:50.975522  5907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc90347724c548f3b82cabb3bb83576f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:50.986626  5834 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6f2ae1b1064e64ac79ecd32b4582ea (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c0ff7c83fabd4eb5aa76e5be54487f75]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:50.987706  5834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6f2ae1b1064e64ac79ecd32b4582ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:50.990010  5759 tablet_service.cc:1511] Processing CreateTablet for tablet 9f6f2ae1b1064e64ac79ecd32b4582ea (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c0ff7c83fabd4eb5aa76e5be54487f75]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:50.990757  5758 tablet_service.cc:1511] Processing CreateTablet for tablet fc90347724c548f3b82cabb3bb83576f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c0ff7c83fabd4eb5aa76e5be54487f75]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:50.991387  5759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6f2ae1b1064e64ac79ecd32b4582ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:50.992156  5758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc90347724c548f3b82cabb3bb83576f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:50.992859  5833 tablet_service.cc:1511] Processing CreateTablet for tablet fc90347724c548f3b82cabb3bb83576f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c0ff7c83fabd4eb5aa76e5be54487f75]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:50.994110  5833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc90347724c548f3b82cabb3bb83576f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.032366  5958 tablet_bootstrap.cc:492] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948: Bootstrap starting.
I20260709 12:26:51.034761  5960 tablet_bootstrap.cc:492] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f: Bootstrap starting.
I20260709 12:26:51.038501  5959 tablet_bootstrap.cc:492] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b: Bootstrap starting.
I20260709 12:26:51.039801  5958 tablet_bootstrap.cc:654] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.045938  5959 tablet_bootstrap.cc:654] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.046816  5960 tablet_bootstrap.cc:654] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.047290  5958 tablet_bootstrap.cc:492] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948: No bootstrap required, opened a new log
I20260709 12:26:51.050024  5958 ts_tablet_manager.cc:1403] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 12:26:51.051394  5959 tablet_bootstrap.cc:492] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b: No bootstrap required, opened a new log
I20260709 12:26:51.051904  5960 tablet_bootstrap.cc:492] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f: No bootstrap required, opened a new log
I20260709 12:26:51.051991  5959 ts_tablet_manager.cc:1403] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 12:26:51.052441  5960 ts_tablet_manager.cc:1403] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 12:26:51.053081  5958 raft_consensus.cc:359] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.053849  5958 raft_consensus.cc:385] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.054126  5958 raft_consensus.cc:740] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f466f0450a94fe4bf2b15d84c1d1948, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.054843  5958 consensus_queue.cc:260] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.055330  5960 raft_consensus.cc:359] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.056082  5960 raft_consensus.cc:385] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.056381  5960 raft_consensus.cc:740] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33a483799c2d4453bfbda41c243d1d2f, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.057106  5943 heartbeater.cc:499] Master 127.29.9.62:36821 was elected leader, sending a full tablet report...
I20260709 12:26:51.057607  5958 ts_tablet_manager.cc:1434] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:26:51.058611  5958 tablet_bootstrap.cc:492] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948: Bootstrap starting.
I20260709 12:26:51.059960  5959 raft_consensus.cc:359] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.061113  5959 raft_consensus.cc:385] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.061534  5959 raft_consensus.cc:740] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.062503  5959 consensus_queue.cc:260] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.065279  5958 tablet_bootstrap.cc:654] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.065627  5959 ts_tablet_manager.cc:1434] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 12:26:51.066289  5794 heartbeater.cc:499] Master 127.29.9.62:36821 was elected leader, sending a full tablet report...
I20260709 12:26:51.066815  5959 tablet_bootstrap.cc:492] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: Bootstrap starting.
I20260709 12:26:51.068848  5960 consensus_queue.cc:260] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.070552  5958 tablet_bootstrap.cc:492] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948: No bootstrap required, opened a new log
I20260709 12:26:51.071069  5958 ts_tablet_manager.cc:1403] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:26:51.073975  5958 raft_consensus.cc:359] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.074713  5958 raft_consensus.cc:385] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.074990  5958 raft_consensus.cc:740] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f466f0450a94fe4bf2b15d84c1d1948, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.075677  5958 consensus_queue.cc:260] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.079329  5958 ts_tablet_manager.cc:1434] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:26:51.084218  5869 heartbeater.cc:499] Master 127.29.9.62:36821 was elected leader, sending a full tablet report...
I20260709 12:26:51.084765  5960 ts_tablet_manager.cc:1434] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f: Time spent starting tablet: real 0.032s	user 0.015s	sys 0.005s
I20260709 12:26:51.085201  5959 tablet_bootstrap.cc:654] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.085757  5960 tablet_bootstrap.cc:492] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f: Bootstrap starting.
I20260709 12:26:51.092576  5960 tablet_bootstrap.cc:654] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.100227  5960 tablet_bootstrap.cc:492] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f: No bootstrap required, opened a new log
I20260709 12:26:51.100275  5959 tablet_bootstrap.cc:492] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: No bootstrap required, opened a new log
I20260709 12:26:51.100672  5960 ts_tablet_manager.cc:1403] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.006s
I20260709 12:26:51.100786  5959 ts_tablet_manager.cc:1403] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.012s
I20260709 12:26:51.102885  5960 raft_consensus.cc:359] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.103434  5960 raft_consensus.cc:385] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.103144  5959 raft_consensus.cc:359] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.103668  5960 raft_consensus.cc:740] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33a483799c2d4453bfbda41c243d1d2f, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.103809  5959 raft_consensus.cc:385] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.104115  5959 raft_consensus.cc:740] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.104395  5960 consensus_queue.cc:260] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.104734  5959 consensus_queue.cc:260] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.106374  5960 ts_tablet_manager.cc:1434] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:26:51.106700  5959 ts_tablet_manager.cc:1434] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:51.143913  5967 raft_consensus.cc:493] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.144397  5967 raft_consensus.cc:515] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.146380  5967 leader_election.cc:290] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781), 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637)
I20260709 12:26:51.153604  5967 raft_consensus.cc:493] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.154094  5967 raft_consensus.cc:515] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.154584  5918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" is_pre_election: true
I20260709 12:26:51.155287  5918 raft_consensus.cc:2468] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 0.
I20260709 12:26:51.155630  5769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7995cea5430443eba515ea3396f0c02b" is_pre_election: true
I20260709 12:26:51.156198  5967 leader_election.cc:290] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637), 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781)
I20260709 12:26:51.156327  5769 raft_consensus.cc:2468] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 0.
I20260709 12:26:51.157008  5768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc90347724c548f3b82cabb3bb83576f" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7995cea5430443eba515ea3396f0c02b" is_pre_election: true
I20260709 12:26:51.157083  5810 leader_election.cc:304] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33a483799c2d4453bfbda41c243d1d2f, 8f466f0450a94fe4bf2b15d84c1d1948; no voters: 
I20260709 12:26:51.157801  5768 raft_consensus.cc:2468] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 0.
I20260709 12:26:51.157836  5918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc90347724c548f3b82cabb3bb83576f" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" is_pre_election: true
I20260709 12:26:51.158339  5967 raft_consensus.cc:2804] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.158556  5918 raft_consensus.cc:2468] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 0.
I20260709 12:26:51.158746  5967 raft_consensus.cc:493] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.159144  5967 raft_consensus.cc:3060] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.158982  5808 leader_election.cc:304] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33a483799c2d4453bfbda41c243d1d2f, 7995cea5430443eba515ea3396f0c02b; no voters: 
I20260709 12:26:51.160672  5971 raft_consensus.cc:2804] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.161007  5971 raft_consensus.cc:493] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.161240  5971 raft_consensus.cc:3060] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.164703  5967 raft_consensus.cc:515] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.166172  5967 leader_election.cc:290] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 election: Requested vote from peers 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781), 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637)
I20260709 12:26:51.166244  5971 raft_consensus.cc:515] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.167013  5918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
I20260709 12:26:51.167119  5768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7995cea5430443eba515ea3396f0c02b"
I20260709 12:26:51.167434  5918 raft_consensus.cc:3060] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.167708  5768 raft_consensus.cc:3060] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.168303  5971 leader_election.cc:290] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 election: Requested vote from peers 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637), 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781)
I20260709 12:26:51.169071  5769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc90347724c548f3b82cabb3bb83576f" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7995cea5430443eba515ea3396f0c02b"
I20260709 12:26:51.169678  5769 raft_consensus.cc:3060] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.170534  5917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc90347724c548f3b82cabb3bb83576f" candidate_uuid: "33a483799c2d4453bfbda41c243d1d2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
I20260709 12:26:51.171177  5917 raft_consensus.cc:3060] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.174013  5768 raft_consensus.cc:2468] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 1.
I20260709 12:26:51.174713  5918 raft_consensus.cc:2468] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 1.
I20260709 12:26:51.175881  5810 leader_election.cc:304] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33a483799c2d4453bfbda41c243d1d2f, 8f466f0450a94fe4bf2b15d84c1d1948; no voters: 
I20260709 12:26:51.176720  5971 raft_consensus.cc:2804] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.178000  5971 raft_consensus.cc:697] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 LEADER]: Becoming Leader. State: Replica: 33a483799c2d4453bfbda41c243d1d2f, State: Running, Role: LEADER
I20260709 12:26:51.178174  5917 raft_consensus.cc:2468] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 1.
I20260709 12:26:51.179144  5810 leader_election.cc:304] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33a483799c2d4453bfbda41c243d1d2f, 8f466f0450a94fe4bf2b15d84c1d1948; no voters: 
I20260709 12:26:51.178913  5971 consensus_queue.cc:237] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.179833  5967 raft_consensus.cc:2804] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.181044  5967 raft_consensus.cc:697] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 1 LEADER]: Becoming Leader. State: Replica: 33a483799c2d4453bfbda41c243d1d2f, State: Running, Role: LEADER
I20260709 12:26:51.181466  5769 raft_consensus.cc:2468] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33a483799c2d4453bfbda41c243d1d2f in term 1.
I20260709 12:26:51.181790  5967 consensus_queue.cc:237] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.187654  5667 catalog_manager.cc:5697] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2). New cstate: current_term: 1 leader_uuid: "33a483799c2d4453bfbda41c243d1d2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.198400  5667 catalog_manager.cc:5697] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2). New cstate: current_term: 1 leader_uuid: "33a483799c2d4453bfbda41c243d1d2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.235419  5667 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39522:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:51.237322  5667 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:51.258072  5758 tablet_service.cc:1511] Processing CreateTablet for tablet 94f78ea4beeb4213b628937393e18059 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2462c01e2a304c97a3a5fe06f238239a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:51.259305  5758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f78ea4beeb4213b628937393e18059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.259471  5834 tablet_service.cc:1511] Processing CreateTablet for tablet 94f78ea4beeb4213b628937393e18059 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2462c01e2a304c97a3a5fe06f238239a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:51.260677  5834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f78ea4beeb4213b628937393e18059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.262806  5907 tablet_service.cc:1511] Processing CreateTablet for tablet 94f78ea4beeb4213b628937393e18059 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2462c01e2a304c97a3a5fe06f238239a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:26:51.263974  5833 tablet_service.cc:1511] Processing CreateTablet for tablet b091f04f343d406e81d118c45ebf7293 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2462c01e2a304c97a3a5fe06f238239a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:51.264923  5907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f78ea4beeb4213b628937393e18059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.262710  5759 tablet_service.cc:1511] Processing CreateTablet for tablet b091f04f343d406e81d118c45ebf7293 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2462c01e2a304c97a3a5fe06f238239a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:51.265069  5833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091f04f343d406e81d118c45ebf7293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.266942  5759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091f04f343d406e81d118c45ebf7293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.272709  5908 tablet_service.cc:1511] Processing CreateTablet for tablet b091f04f343d406e81d118c45ebf7293 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=2462c01e2a304c97a3a5fe06f238239a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:26:51.273958  5908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091f04f343d406e81d118c45ebf7293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:51.276921  5959 tablet_bootstrap.cc:492] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b: Bootstrap starting.
I20260709 12:26:51.282967  5959 tablet_bootstrap.cc:654] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.288880  5958 tablet_bootstrap.cc:492] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948: Bootstrap starting.
I20260709 12:26:51.295593  5958 tablet_bootstrap.cc:654] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.300385  5959 tablet_bootstrap.cc:492] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b: No bootstrap required, opened a new log
I20260709 12:26:51.300419  5960 tablet_bootstrap.cc:492] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f: Bootstrap starting.
I20260709 12:26:51.301126  5959 ts_tablet_manager.cc:1403] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 12:26:51.304418  5959 raft_consensus.cc:359] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.305199  5959 raft_consensus.cc:385] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.305490  5959 raft_consensus.cc:740] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.306283  5959 consensus_queue.cc:260] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.306821  5960 tablet_bootstrap.cc:654] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.308452  5959 ts_tablet_manager.cc:1434] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:51.309435  5959 tablet_bootstrap.cc:492] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: Bootstrap starting.
I20260709 12:26:51.310019  5958 tablet_bootstrap.cc:492] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948: No bootstrap required, opened a new log
I20260709 12:26:51.310586  5958 ts_tablet_manager.cc:1403] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:26:51.313593  5958 raft_consensus.cc:359] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.314390  5958 raft_consensus.cc:385] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.314740  5958 raft_consensus.cc:740] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f466f0450a94fe4bf2b15d84c1d1948, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.315858  5959 tablet_bootstrap.cc:654] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.315647  5958 consensus_queue.cc:260] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.318432  5958 ts_tablet_manager.cc:1434] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:51.319586  5958 tablet_bootstrap.cc:492] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: Bootstrap starting.
I20260709 12:26:51.326459  5958 tablet_bootstrap.cc:654] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.328001  5959 tablet_bootstrap.cc:492] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: No bootstrap required, opened a new log
I20260709 12:26:51.328586  5959 ts_tablet_manager.cc:1403] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 12:26:51.331811  5959 raft_consensus.cc:359] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.332518  5959 raft_consensus.cc:385] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.332805  5959 raft_consensus.cc:740] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.333521  5959 consensus_queue.cc:260] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.335629  5959 ts_tablet_manager.cc:1434] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:51.338997  5958 tablet_bootstrap.cc:492] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: No bootstrap required, opened a new log
I20260709 12:26:51.339483  5958 ts_tablet_manager.cc:1403] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:26:51.339847  5960 tablet_bootstrap.cc:492] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f: No bootstrap required, opened a new log
I20260709 12:26:51.340364  5960 ts_tablet_manager.cc:1403] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.025s
I20260709 12:26:51.341761  5958 raft_consensus.cc:359] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.342478  5958 raft_consensus.cc:385] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.342692  5958 raft_consensus.cc:740] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f466f0450a94fe4bf2b15d84c1d1948, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.343351  5958 consensus_queue.cc:260] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.343231  5960 raft_consensus.cc:359] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.344221  5960 raft_consensus.cc:385] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.344535  5960 raft_consensus.cc:740] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33a483799c2d4453bfbda41c243d1d2f, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.345645  5958 ts_tablet_manager.cc:1434] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:51.345280  5960 consensus_queue.cc:260] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.347886  5960 ts_tablet_manager.cc:1434] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:26:51.348088  5964 raft_consensus.cc:493] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.348574  5964 raft_consensus.cc:515] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.348860  5960 tablet_bootstrap.cc:492] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f: Bootstrap starting.
I20260709 12:26:51.350657  5964 leader_election.cc:290] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637), 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395)
I20260709 12:26:51.355785  5960 tablet_bootstrap.cc:654] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.365653  5769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293" candidate_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7995cea5430443eba515ea3396f0c02b" is_pre_election: true
I20260709 12:26:51.366395  5769 raft_consensus.cc:2468] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f466f0450a94fe4bf2b15d84c1d1948 in term 0.
I20260709 12:26:51.368487  5882 leader_election.cc:304] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7995cea5430443eba515ea3396f0c02b, 8f466f0450a94fe4bf2b15d84c1d1948; no voters: 
I20260709 12:26:51.368908  5960 tablet_bootstrap.cc:492] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f: No bootstrap required, opened a new log
I20260709 12:26:51.369450  5960 ts_tablet_manager.cc:1403] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:26:51.369472  5964 raft_consensus.cc:2804] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.369958  5964 raft_consensus.cc:493] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.370270  5964 raft_consensus.cc:3060] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.372509  5960 raft_consensus.cc:359] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.373255  5960 raft_consensus.cc:385] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.373508  5960 raft_consensus.cc:740] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33a483799c2d4453bfbda41c243d1d2f, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.374239  5960 consensus_queue.cc:260] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.375149  5844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293" candidate_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33a483799c2d4453bfbda41c243d1d2f" is_pre_election: true
I20260709 12:26:51.375864  5844 raft_consensus.cc:2468] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f466f0450a94fe4bf2b15d84c1d1948 in term 0.
I20260709 12:26:51.376358  5960 ts_tablet_manager.cc:1434] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:51.377456  5964 raft_consensus.cc:515] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.379791  5769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293" candidate_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7995cea5430443eba515ea3396f0c02b"
I20260709 12:26:51.380090  5964 leader_election.cc:290] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [CANDIDATE]: Term 1 election: Requested vote from peers 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637), 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395)
I20260709 12:26:51.380280  5769 raft_consensus.cc:3060] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.380303  5844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293" candidate_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33a483799c2d4453bfbda41c243d1d2f"
I20260709 12:26:51.381187  5844 raft_consensus.cc:3060] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.387988  5769 raft_consensus.cc:2468] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f466f0450a94fe4bf2b15d84c1d1948 in term 1.
I20260709 12:26:51.388532  5844 raft_consensus.cc:2468] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f466f0450a94fe4bf2b15d84c1d1948 in term 1.
I20260709 12:26:51.389473  5882 leader_election.cc:304] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7995cea5430443eba515ea3396f0c02b, 8f466f0450a94fe4bf2b15d84c1d1948; no voters: 
I20260709 12:26:51.390372  5964 raft_consensus.cc:2804] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.391559  5964 raft_consensus.cc:697] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 LEADER]: Becoming Leader. State: Replica: 8f466f0450a94fe4bf2b15d84c1d1948, State: Running, Role: LEADER
I20260709 12:26:51.392431  5964 consensus_queue.cc:237] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.399935  5666 catalog_manager.cc:5697] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.496920  5965 raft_consensus.cc:493] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.497516  5965 raft_consensus.cc:515] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.499698  5965 leader_election.cc:290] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395), 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781)
I20260709 12:26:51.508571  5844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f78ea4beeb4213b628937393e18059" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33a483799c2d4453bfbda41c243d1d2f" is_pre_election: true
I20260709 12:26:51.509194  5844 raft_consensus.cc:2468] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 0.
I20260709 12:26:51.509366  5917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f78ea4beeb4213b628937393e18059" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" is_pre_election: true
I20260709 12:26:51.509992  5917 raft_consensus.cc:2468] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 0.
I20260709 12:26:51.510274  5734 leader_election.cc:304] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33a483799c2d4453bfbda41c243d1d2f, 7995cea5430443eba515ea3396f0c02b; no voters: 
I20260709 12:26:51.511063  5965 raft_consensus.cc:2804] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.511355  5965 raft_consensus.cc:493] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.511569  5965 raft_consensus.cc:3060] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.516505  5965 raft_consensus.cc:515] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.517989  5965 leader_election.cc:290] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 1 election: Requested vote from peers 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395), 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781)
I20260709 12:26:51.518718  5844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f78ea4beeb4213b628937393e18059" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33a483799c2d4453bfbda41c243d1d2f"
I20260709 12:26:51.519016  5917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f78ea4beeb4213b628937393e18059" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
I20260709 12:26:51.519333  5844 raft_consensus.cc:3060] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.519562  5917 raft_consensus.cc:3060] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.526137  5917 raft_consensus.cc:2468] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 1.
I20260709 12:26:51.526145  5844 raft_consensus.cc:2468] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 1.
I20260709 12:26:51.527323  5735 leader_election.cc:304] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7995cea5430443eba515ea3396f0c02b, 8f466f0450a94fe4bf2b15d84c1d1948; no voters: 
I20260709 12:26:51.528005  5965 raft_consensus.cc:2804] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.528898  5965 raft_consensus.cc:697] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 LEADER]: Becoming Leader. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Running, Role: LEADER
I20260709 12:26:51.529625  5965 consensus_queue.cc:237] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
W20260709 12:26:51.534441  5715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:51.536300  5666 catalog_manager.cc:5697] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7995cea5430443eba515ea3396f0c02b (127.29.9.1). New cstate: current_term: 1 leader_uuid: "7995cea5430443eba515ea3396f0c02b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.559559  5844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea"
dest_uuid: "33a483799c2d4453bfbda41c243d1d2f"
mode: GRACEFUL
new_leader_uuid: "7995cea5430443eba515ea3396f0c02b"
 from {username='slave'} at 127.0.0.1:53760
I20260709 12:26:51.560113  5844 raft_consensus.cc:606] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 LEADER]: Received request to transfer leadership to TS 7995cea5430443eba515ea3396f0c02b
I20260709 12:26:51.579334  5917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293"
dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
mode: GRACEFUL
new_leader_uuid: "7995cea5430443eba515ea3396f0c02b"
 from {username='slave'} at 127.0.0.1:37662
I20260709 12:26:51.579936  5917 raft_consensus.cc:606] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 LEADER]: Received request to transfer leadership to TS 7995cea5430443eba515ea3396f0c02b
I20260709 12:26:51.656813  5967 consensus_queue.cc:1048] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.668079  5971 consensus_queue.cc:1048] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.676748  5967 raft_consensus.cc:993] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f: : Instructing follower 7995cea5430443eba515ea3396f0c02b to start an election
I20260709 12:26:51.677265  5972 raft_consensus.cc:1081] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 LEADER]: Signalling peer 7995cea5430443eba515ea3396f0c02b to start an election
I20260709 12:26:51.678944  5769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea"
dest_uuid: "7995cea5430443eba515ea3396f0c02b"
 from {username='slave'} at 127.0.0.1:57452
I20260709 12:26:51.679478  5769 raft_consensus.cc:493] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:51.679782  5769 raft_consensus.cc:3060] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.684764  5972 consensus_queue.cc:1048] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:51.686401  5769 raft_consensus.cc:515] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.689038  5917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
I20260709 12:26:51.689466  5844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f6f2ae1b1064e64ac79ecd32b4582ea" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33a483799c2d4453bfbda41c243d1d2f"
I20260709 12:26:51.690167  5844 raft_consensus.cc:3055] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:51.690440  5844 raft_consensus.cc:740] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 33a483799c2d4453bfbda41c243d1d2f, State: Running, Role: LEADER
I20260709 12:26:51.691179  5844 consensus_queue.cc:260] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.692313  5844 raft_consensus.cc:3060] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.689617  5917 raft_consensus.cc:3060] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.701150  5972 consensus_queue.cc:1048] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.707991  5844 raft_consensus.cc:2468] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 2.
I20260709 12:26:51.711709  5734 leader_election.cc:304] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33a483799c2d4453bfbda41c243d1d2f, 7995cea5430443eba515ea3396f0c02b; no voters: 
I20260709 12:26:51.712582  5965 raft_consensus.cc:2804] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:51.713037  5965 raft_consensus.cc:697] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 2 LEADER]: Becoming Leader. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Running, Role: LEADER
I20260709 12:26:51.713836  5965 consensus_queue.cc:237] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } }
I20260709 12:26:51.710321  5917 raft_consensus.cc:2468] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 2.
I20260709 12:26:51.710409  5769 leader_election.cc:290] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 2 election: Requested vote from peers 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781), 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395)
I20260709 12:26:51.720851  5665 catalog_manager.cc:5697] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b reported cstate change: term changed from 1 to 2, leader changed from 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2) to 7995cea5430443eba515ea3396f0c02b (127.29.9.1). New cstate: current_term: 2 leader_uuid: "7995cea5430443eba515ea3396f0c02b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.824193  5964 consensus_queue.cc:1048] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.830504  5987 raft_consensus.cc:993] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948: : Instructing follower 7995cea5430443eba515ea3396f0c02b to start an election
I20260709 12:26:51.831146  5964 raft_consensus.cc:1081] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 LEADER]: Signalling peer 7995cea5430443eba515ea3396f0c02b to start an election
I20260709 12:26:51.832906  5768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293"
dest_uuid: "7995cea5430443eba515ea3396f0c02b"
 from {username='slave'} at 127.0.0.1:57468
I20260709 12:26:51.834091  5768 raft_consensus.cc:493] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:51.834489  5768 raft_consensus.cc:3060] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.837656  5987 consensus_queue.cc:1048] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.841500  5768 raft_consensus.cc:515] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.845466  5843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33a483799c2d4453bfbda41c243d1d2f"
I20260709 12:26:51.845953  5917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091f04f343d406e81d118c45ebf7293" candidate_uuid: "7995cea5430443eba515ea3396f0c02b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
I20260709 12:26:51.846046  5843 raft_consensus.cc:3060] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.846100  5768 leader_election.cc:290] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 2 election: Requested vote from peers 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395), 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3:41781)
I20260709 12:26:51.847085  5917 raft_consensus.cc:3055] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:51.847409  5917 raft_consensus.cc:740] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f466f0450a94fe4bf2b15d84c1d1948, State: Running, Role: LEADER
I20260709 12:26:51.848217  5917 consensus_queue.cc:260] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.849431  5917 raft_consensus.cc:3060] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.853286  5843 raft_consensus.cc:2468] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 2.
I20260709 12:26:51.854247  5734 leader_election.cc:304] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33a483799c2d4453bfbda41c243d1d2f, 7995cea5430443eba515ea3396f0c02b; no voters: 
I20260709 12:26:51.854553  5917 raft_consensus.cc:2468] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7995cea5430443eba515ea3396f0c02b in term 2.
I20260709 12:26:51.854903  5991 raft_consensus.cc:2804] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:51.855396  5991 raft_consensus.cc:697] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 2 LEADER]: Becoming Leader. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Running, Role: LEADER
I20260709 12:26:51.856145  5991 consensus_queue.cc:237] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.862382  5665 catalog_manager.cc:5697] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b reported cstate change: term changed from 1 to 2, leader changed from 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3) to 7995cea5430443eba515ea3396f0c02b (127.29.9.1). New cstate: current_term: 2 leader_uuid: "7995cea5430443eba515ea3396f0c02b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.878576 29732 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:26:51.880160 29732 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:26:51.880505 29732 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:26:51.891942  5768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94f78ea4beeb4213b628937393e18059"
dest_uuid: "7995cea5430443eba515ea3396f0c02b"
mode: GRACEFUL
new_leader_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
 from {username='slave'} at 127.0.0.1:57484
I20260709 12:26:51.892462  5768 raft_consensus.cc:606] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 LEADER]: Received request to transfer leadership to TS 8f466f0450a94fe4bf2b15d84c1d1948
I20260709 12:26:51.893559 29732 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:26:51.954351  5991 consensus_queue.cc:1048] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.960381  5965 raft_consensus.cc:993] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b: : Instructing follower 8f466f0450a94fe4bf2b15d84c1d1948 to start an election
I20260709 12:26:51.960973  5991 raft_consensus.cc:1081] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 LEADER]: Signalling peer 8f466f0450a94fe4bf2b15d84c1d1948 to start an election
I20260709 12:26:51.962472  5918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94f78ea4beeb4213b628937393e18059"
dest_uuid: "8f466f0450a94fe4bf2b15d84c1d1948"
 from {username='slave'} at 127.0.0.1:37646
I20260709 12:26:51.963022  5918 raft_consensus.cc:493] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:51.963335  5918 raft_consensus.cc:3060] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.966394  6007 consensus_queue.cc:1048] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [LEADER]: Connected to new peer: Peer: permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.969484  5918 raft_consensus.cc:515] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.970559  5917 raft_consensus.cc:1240] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Rejecting Update request from peer 7995cea5430443eba515ea3396f0c02b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:51.971793  5918 leader_election.cc:290] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [CANDIDATE]: Term 2 election: Requested vote from peers 7995cea5430443eba515ea3396f0c02b (127.29.9.1:41637), 33a483799c2d4453bfbda41c243d1d2f (127.29.9.2:46395)
I20260709 12:26:51.972633  5768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f78ea4beeb4213b628937393e18059" candidate_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7995cea5430443eba515ea3396f0c02b"
I20260709 12:26:51.974303  5768 raft_consensus.cc:3055] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:51.974599  5768 raft_consensus.cc:740] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7995cea5430443eba515ea3396f0c02b, State: Running, Role: LEADER
I20260709 12:26:51.975039  6007 consensus_queue.cc:1059] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.975688  5844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f78ea4beeb4213b628937393e18059" candidate_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "33a483799c2d4453bfbda41c243d1d2f"
I20260709 12:26:51.977882  5768 consensus_queue.cc:260] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.978842  5768 raft_consensus.cc:3060] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.985677  5768 raft_consensus.cc:2468] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f466f0450a94fe4bf2b15d84c1d1948 in term 2.
W20260709 12:26:51.986107  6007 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:26:51.986702  5882 leader_election.cc:304] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7995cea5430443eba515ea3396f0c02b, 8f466f0450a94fe4bf2b15d84c1d1948; no voters: 33a483799c2d4453bfbda41c243d1d2f
I20260709 12:26:51.987950  5987 raft_consensus.cc:2804] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:51.988433  5987 raft_consensus.cc:697] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 LEADER]: Becoming Leader. State: Replica: 8f466f0450a94fe4bf2b15d84c1d1948, State: Running, Role: LEADER
I20260709 12:26:51.989213  5987 consensus_queue.cc:237] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } }
I20260709 12:26:51.994628  5666 catalog_manager.cc:5697] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 reported cstate change: term changed from 1 to 2, leader changed from 7995cea5430443eba515ea3396f0c02b (127.29.9.1) to 8f466f0450a94fe4bf2b15d84c1d1948 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7995cea5430443eba515ea3396f0c02b" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33a483799c2d4453bfbda41c243d1d2f" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 46395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f466f0450a94fe4bf2b15d84c1d1948" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 41781 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.026432 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
I20260709 12:26:52.048935 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:52.049592 29732 tablet_replica.cc:333] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: stopping tablet replica
I20260709 12:26:52.050175 29732 raft_consensus.cc:2243] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.050788 29732 pending_rounds.cc:70] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: Trying to abort 1 pending ops.
I20260709 12:26:52.050957 29732 pending_rounds.cc:77] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625647988625408 op_type: NO_OP noop_request { }
I20260709 12:26:52.051246 29732 raft_consensus.cc:2889] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:52.051510 29732 raft_consensus.cc:2272] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.053761 29732 tablet_replica.cc:333] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: stopping tablet replica
I20260709 12:26:52.054317 29732 raft_consensus.cc:2243] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.054935 29732 pending_rounds.cc:70] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: Trying to abort 1 pending ops.
I20260709 12:26:52.055094 29732 pending_rounds.cc:77] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625648570032128 op_type: NO_OP noop_request { }
I20260709 12:26:52.055344 29732 raft_consensus.cc:2889] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:52.055617 29732 raft_consensus.cc:2272] T b091f04f343d406e81d118c45ebf7293 P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.058092 29732 tablet_replica.cc:333] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b: stopping tablet replica
I20260709 12:26:52.058578 29732 raft_consensus.cc:2243] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.058974 29732 raft_consensus.cc:2272] T 94f78ea4beeb4213b628937393e18059 P 7995cea5430443eba515ea3396f0c02b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.060982 29732 tablet_replica.cc:333] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b: stopping tablet replica
I20260709 12:26:52.061440 29732 raft_consensus.cc:2243] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.061828 29732 raft_consensus.cc:2272] T fc90347724c548f3b82cabb3bb83576f P 7995cea5430443eba515ea3396f0c02b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.084236 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
I20260709 12:26:52.095593 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
I20260709 12:26:52.111797 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:52.112428 29732 tablet_replica.cc:333] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f: stopping tablet replica
I20260709 12:26:52.112955 29732 raft_consensus.cc:2243] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.113396 29732 raft_consensus.cc:2272] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 33a483799c2d4453bfbda41c243d1d2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.115388 29732 tablet_replica.cc:333] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f: stopping tablet replica
I20260709 12:26:52.115934 29732 raft_consensus.cc:2243] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.116324 29732 raft_consensus.cc:2272] T b091f04f343d406e81d118c45ebf7293 P 33a483799c2d4453bfbda41c243d1d2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.118513 29732 tablet_replica.cc:333] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f: stopping tablet replica
I20260709 12:26:52.118980 29732 raft_consensus.cc:2243] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.119357 29732 raft_consensus.cc:2272] T 94f78ea4beeb4213b628937393e18059 P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.121397 29732 tablet_replica.cc:333] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f: stopping tablet replica
I20260709 12:26:52.121833 29732 raft_consensus.cc:2243] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.122570 29732 raft_consensus.cc:2272] T fc90347724c548f3b82cabb3bb83576f P 33a483799c2d4453bfbda41c243d1d2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.133934 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
I20260709 12:26:52.145319 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
I20260709 12:26:52.161010 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:52.161693 29732 tablet_replica.cc:333] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: stopping tablet replica
I20260709 12:26:52.162245 29732 raft_consensus.cc:2243] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.162845 29732 pending_rounds.cc:70] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: Trying to abort 2 pending ops.
I20260709 12:26:52.163028 29732 pending_rounds.cc:77] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625649115701248 op_type: NO_OP noop_request { }
I20260709 12:26:52.163273 29732 raft_consensus.cc:2889] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:52.163482 29732 pending_rounds.cc:77] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625647232315392 op_type: NO_OP noop_request { }
I20260709 12:26:52.163700 29732 raft_consensus.cc:2889] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:52.164017 29732 raft_consensus.cc:2272] T 94f78ea4beeb4213b628937393e18059 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.166137 29732 tablet_replica.cc:333] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948: stopping tablet replica
I20260709 12:26:52.166648 29732 raft_consensus.cc:2243] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.167044 29732 raft_consensus.cc:2272] T b091f04f343d406e81d118c45ebf7293 P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.169152 29732 tablet_replica.cc:333] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948: stopping tablet replica
I20260709 12:26:52.169641 29732 raft_consensus.cc:2243] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.170028 29732 raft_consensus.cc:2272] T fc90347724c548f3b82cabb3bb83576f P 8f466f0450a94fe4bf2b15d84c1d1948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.172138 29732 tablet_replica.cc:333] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948: stopping tablet replica
I20260709 12:26:52.172585 29732 raft_consensus.cc:2243] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.172947 29732 raft_consensus.cc:2272] T 9f6f2ae1b1064e64ac79ecd32b4582ea P 8f466f0450a94fe4bf2b15d84c1d1948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.184348 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
I20260709 12:26:52.195482 29732 master.cc:562] Master@127.29.9.62:36821 shutting down...
I20260709 12:26:52.208632 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.209157 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.209455 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P a9ccf77cc40e40e29d91a6266cee5b9a: stopping tablet replica
I20260709 12:26:52.226977 29732 master.cc:584] Master@127.29.9.62:36821 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (1835 ms)
[----------] 6 tests from LeaderRebalancerTest (271030 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:26:52.252219 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:36679
I20260709 12:26:52.253242 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:52.257598  6009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:52.258971  6010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:52.259445 29732 server_base.cc:1061] running on GCE node
W20260709 12:26:52.259483  6012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:52.260509 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:52.260697 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:52.260852 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600012260834 us; error 0 us; skew 500 ppm
I20260709 12:26:52.261356 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:52.263453 29732 webserver.cc:533] Webserver started at http://127.29.9.62:33257/ using document root <none> and password file <none>
I20260709 12:26:52.264065 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:52.264240 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:52.264482 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:52.265481 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "fa3a3d07739d42fdbdf24a7817e49a97"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.269582 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:26:52.272822  6017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.273478 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:52.273737 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "fa3a3d07739d42fdbdf24a7817e49a97"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.274014 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:52.313640 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:52.314633 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:52.347321 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:36679
I20260709 12:26:52.347424  6068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:36679 every 8 connection(s)
I20260709 12:26:52.351183  6069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.361445  6069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97: Bootstrap starting.
I20260709 12:26:52.365712  6069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.369741  6069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97: No bootstrap required, opened a new log
I20260709 12:26:52.371798  6069 raft_consensus.cc:359] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" member_type: VOTER }
I20260709 12:26:52.372161  6069 raft_consensus.cc:385] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.372370  6069 raft_consensus.cc:740] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa3a3d07739d42fdbdf24a7817e49a97, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.372913  6069 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" member_type: VOTER }
I20260709 12:26:52.373343  6069 raft_consensus.cc:399] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:52.373561  6069 raft_consensus.cc:493] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:52.373829  6069 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.378430  6069 raft_consensus.cc:515] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" member_type: VOTER }
I20260709 12:26:52.378952  6069 leader_election.cc:304] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa3a3d07739d42fdbdf24a7817e49a97; no voters: 
I20260709 12:26:52.380050  6069 leader_election.cc:290] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:52.380347  6072 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.381636  6072 raft_consensus.cc:697] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 1 LEADER]: Becoming Leader. State: Replica: fa3a3d07739d42fdbdf24a7817e49a97, State: Running, Role: LEADER
I20260709 12:26:52.382280  6072 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" member_type: VOTER }
I20260709 12:26:52.382722  6069 sys_catalog.cc:565] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:52.386509  6073 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" member_type: VOTER } }
I20260709 12:26:52.386670  6074 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa3a3d07739d42fdbdf24a7817e49a97. Latest consensus state: current_term: 1 leader_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa3a3d07739d42fdbdf24a7817e49a97" member_type: VOTER } }
I20260709 12:26:52.387032  6073 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:52.387292  6074 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:52.389277  6078 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:52.396052  6078 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:52.397019 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:52.404428  6078 catalog_manager.cc:1383] Generated new cluster ID: ef3dde43328f40c7a9c893330c54eb2f
I20260709 12:26:52.404729  6078 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:52.421290  6078 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:52.422536  6078 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:52.438870  6078 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97: Generated new TSK 0
I20260709 12:26:52.439451  6078 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:52.463605 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:52.469614  6090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:52.470052  6091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:52.472280  6093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:52.472440 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:52.473416 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:52.473609 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:52.473768 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600012473743 us; error 0 us; skew 500 ppm
I20260709 12:26:52.474303 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:52.476613 29732 webserver.cc:533] Webserver started at http://127.29.9.1:42923/ using document root <none> and password file <none>
I20260709 12:26:52.477083 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:52.477265 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:52.477510 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:52.478567 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "39e3ddb0597d49f28bf869098c62c595"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.483012 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:26:52.486389  6098 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.487152 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:52.487426 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "39e3ddb0597d49f28bf869098c62c595"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.487695 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:52.498631 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:52.499698 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:52.501080 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:52.503185 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:52.503378 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.503594 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:52.503772 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:26:52.539651 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:36341
I20260709 12:26:52.539778  6160 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:36341 every 8 connection(s)
I20260709 12:26:52.544334 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:52.551466  6165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:52.553422  6166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:52.556864  6161 heartbeater.cc:344] Connected to a master server at 127.29.9.62:36679
W20260709 12:26:52.556934  6168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:52.557379  6161 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:52.557466 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:52.558525  6161 heartbeater.cc:507] Master 127.29.9.62:36679 requested a full tablet report, sending...
I20260709 12:26:52.558586 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:52.558952 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:52.559152 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600012559135 us; error 0 us; skew 500 ppm
I20260709 12:26:52.559852 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:52.560935  6034 ts_manager.cc:194] Registered new tserver with Master: 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341)
I20260709 12:26:52.562348 29732 webserver.cc:533] Webserver started at http://127.29.9.2:35693/ using document root <none> and password file <none>
I20260709 12:26:52.562845 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:52.562880  6034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56396
I20260709 12:26:52.563024 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:52.563380 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:52.564531 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "21d35f94d504429f9484bf24dc6028d4"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.568807 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:26:52.571951  6173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.572628 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:52.572896 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "21d35f94d504429f9484bf24dc6028d4"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.573158 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:52.592789 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:52.593833 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:52.595196 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:52.597332 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:52.597520 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.597728 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:52.597884 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.633073 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:39923
I20260709 12:26:52.633191  6235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:39923 every 8 connection(s)
I20260709 12:26:52.637542 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:52.644071  6239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:52.646166  6240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:52.647251  6242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:52.648933 29732 server_base.cc:1061] running on GCE node
I20260709 12:26:52.650017 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:52.650036  6236 heartbeater.cc:344] Connected to a master server at 127.29.9.62:36679
W20260709 12:26:52.650291 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:52.650512 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600012650496 us; error 0 us; skew 500 ppm
I20260709 12:26:52.650560  6236 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:52.651125 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:52.651419  6236 heartbeater.cc:507] Master 127.29.9.62:36679 requested a full tablet report, sending...
I20260709 12:26:52.653714  6034 ts_manager.cc:194] Registered new tserver with Master: 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:52.653770 29732 webserver.cc:533] Webserver started at http://127.29.9.3:41095/ using document root <none> and password file <none>
I20260709 12:26:52.654534 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:52.654784 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:52.655094 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:52.655591  6034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56402
I20260709 12:26:52.656533 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "a07d9332cd9249b589722f82c519da03"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.660859 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:52.664001  6247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.664711 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:52.664990 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "a07d9332cd9249b589722f82c519da03"
format_stamp: "Formatted at 2026-07-09 12:26:52 on dist-test-slave-ftzc"
I20260709 12:26:52.665233 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:52.675832 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:52.676807 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:52.678153 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:52.680327 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:52.680519 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.680728 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:52.680876 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:52.719239 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:43473
I20260709 12:26:52.719344  6309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:43473 every 8 connection(s)
I20260709 12:26:52.731614  6310 heartbeater.cc:344] Connected to a master server at 127.29.9.62:36679
I20260709 12:26:52.732069  6310 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:52.732687  6310 heartbeater.cc:507] Master 127.29.9.62:36679 requested a full tablet report, sending...
I20260709 12:26:52.734599  6034 ts_manager.cc:194] Registered new tserver with Master: a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:52.735389 29732 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013243685s
I20260709 12:26:52.735963  6034 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56406
I20260709 12:26:52.759341  6034 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56418:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:52.761799  6034 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:52.839772  6125 tablet_service.cc:1511] Processing CreateTablet for tablet 23ad41becb2240f68d83a0c087cccf2d (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:52.840054  6126 tablet_service.cc:1511] Processing CreateTablet for tablet 2db3860758a24ac1bda104782d6e511a (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:52.841236  6125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ad41becb2240f68d83a0c087cccf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.841804  6123 tablet_service.cc:1511] Processing CreateTablet for tablet 303b6baaedf745aebea0c25ce41602b6 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:52.843852  6124 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5209be04f74c64bbc4bdd79054fc58 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:52.845448  6123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 303b6baaedf745aebea0c25ce41602b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.846809  6124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5209be04f74c64bbc4bdd79054fc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.847685  6122 tablet_service.cc:1511] Processing CreateTablet for tablet 6598421c7f9a4ecc96b7edc75ece5861 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:52.849156  6122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6598421c7f9a4ecc96b7edc75ece5861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.852473  6126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db3860758a24ac1bda104782d6e511a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.853308  6121 tablet_service.cc:1511] Processing CreateTablet for tablet 8fafa1d27b9d462d9eb54af14d49a46a (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:52.854784  6121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fafa1d27b9d462d9eb54af14d49a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.858698  6119 tablet_service.cc:1511] Processing CreateTablet for tablet d3415d2429cd4be699177d750bbf0d16 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:52.859602  6275 tablet_service.cc:1511] Processing CreateTablet for tablet 2db3860758a24ac1bda104782d6e511a (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:52.860960  6275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db3860758a24ac1bda104782d6e511a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.861292  6120 tablet_service.cc:1511] Processing CreateTablet for tablet aff7c2533db74ba69cb3799babb85d2f (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:52.860145  6119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3415d2429cd4be699177d750bbf0d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.864120  6271 tablet_service.cc:1511] Processing CreateTablet for tablet 6598421c7f9a4ecc96b7edc75ece5861 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:52.865478  6271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6598421c7f9a4ecc96b7edc75ece5861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.868072  6120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff7c2533db74ba69cb3799babb85d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.868789  6272 tablet_service.cc:1511] Processing CreateTablet for tablet 303b6baaedf745aebea0c25ce41602b6 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:52.870141  6272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 303b6baaedf745aebea0c25ce41602b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.872575  6273 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5209be04f74c64bbc4bdd79054fc58 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:52.873919  6273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5209be04f74c64bbc4bdd79054fc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.875810  6274 tablet_service.cc:1511] Processing CreateTablet for tablet 23ad41becb2240f68d83a0c087cccf2d (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:52.877143  6274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ad41becb2240f68d83a0c087cccf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.876904  6200 tablet_service.cc:1511] Processing CreateTablet for tablet 23ad41becb2240f68d83a0c087cccf2d (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:52.877753  6197 tablet_service.cc:1511] Processing CreateTablet for tablet 6598421c7f9a4ecc96b7edc75ece5861 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:52.878315  6200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ad41becb2240f68d83a0c087cccf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.879033  6197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6598421c7f9a4ecc96b7edc75ece5861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.880244  6199 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5209be04f74c64bbc4bdd79054fc58 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:52.861799  6269 tablet_service.cc:1511] Processing CreateTablet for tablet aff7c2533db74ba69cb3799babb85d2f (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:52.882165  6269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff7c2533db74ba69cb3799babb85d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.882040  6195 tablet_service.cc:1511] Processing CreateTablet for tablet aff7c2533db74ba69cb3799babb85d2f (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:52.875715  6201 tablet_service.cc:1511] Processing CreateTablet for tablet 2db3860758a24ac1bda104782d6e511a (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:52.883396  6195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff7c2533db74ba69cb3799babb85d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.862920  6270 tablet_service.cc:1511] Processing CreateTablet for tablet 8fafa1d27b9d462d9eb54af14d49a46a (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:52.885033  6270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fafa1d27b9d462d9eb54af14d49a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.885454  6194 tablet_service.cc:1511] Processing CreateTablet for tablet d3415d2429cd4be699177d750bbf0d16 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:52.882040  6198 tablet_service.cc:1511] Processing CreateTablet for tablet 303b6baaedf745aebea0c25ce41602b6 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:52.880771  6196 tablet_service.cc:1511] Processing CreateTablet for tablet 8fafa1d27b9d462d9eb54af14d49a46a (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:52.895328  6198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 303b6baaedf745aebea0c25ce41602b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.896015  6196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fafa1d27b9d462d9eb54af14d49a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.897234  6194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3415d2429cd4be699177d750bbf0d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.904017  6199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5209be04f74c64bbc4bdd79054fc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.916169  6201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db3860758a24ac1bda104782d6e511a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.919514  6268 tablet_service.cc:1511] Processing CreateTablet for tablet d3415d2429cd4be699177d750bbf0d16 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:52.921002  6268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3415d2429cd4be699177d750bbf0d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.923094  6118 tablet_service.cc:1511] Processing CreateTablet for tablet b5e0a61375ed485bb71eaf0923c495a4 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:52.924453  6118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e0a61375ed485bb71eaf0923c495a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.931202  6193 tablet_service.cc:1511] Processing CreateTablet for tablet b5e0a61375ed485bb71eaf0923c495a4 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:52.932696  6193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e0a61375ed485bb71eaf0923c495a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.935945  6325 tablet_bootstrap.cc:492] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:52.967105  6267 tablet_service.cc:1511] Processing CreateTablet for tablet b5e0a61375ed485bb71eaf0923c495a4 (DEFAULT_TABLE table=test-workload [id=fb1b0f0ef83d438581aed05a2e6bf228]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:52.969166  6267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e0a61375ed485bb71eaf0923c495a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.982015  6325 tablet_bootstrap.cc:654] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.049871  6327 tablet_bootstrap.cc:492] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.049873  6326 tablet_bootstrap.cc:492] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.069702  6325 tablet_bootstrap.cc:492] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.070343  6325 ts_tablet_manager.cc:1403] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.043s
I20260709 12:26:53.071683  6327 tablet_bootstrap.cc:654] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.072729  6325 raft_consensus.cc:359] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.073307  6325 raft_consensus.cc:385] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.073526  6325 raft_consensus.cc:740] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.074119  6325 consensus_queue.cc:260] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.076174  6310 heartbeater.cc:499] Master 127.29.9.62:36679 was elected leader, sending a full tablet report...
I20260709 12:26:53.076620  6326 tablet_bootstrap.cc:654] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.076650  6325 ts_tablet_manager.cc:1434] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:26:53.078024  6325 tablet_bootstrap.cc:492] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.082417  6327 tablet_bootstrap.cc:492] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.082942  6327 ts_tablet_manager.cc:1403] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.012s
I20260709 12:26:53.083752  6325 tablet_bootstrap.cc:654] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.085445  6327 raft_consensus.cc:359] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.086022  6327 raft_consensus.cc:385] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.086306  6327 raft_consensus.cc:740] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.087260  6327 consensus_queue.cc:260] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.088476  6326 tablet_bootstrap.cc:492] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.089028  6326 ts_tablet_manager.cc:1403] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.005s
I20260709 12:26:53.089321  6236 heartbeater.cc:499] Master 127.29.9.62:36679 was elected leader, sending a full tablet report...
I20260709 12:26:53.089838  6327 ts_tablet_manager.cc:1434] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:53.090786  6327 tablet_bootstrap.cc:492] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.092198  6326 raft_consensus.cc:359] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.092971  6326 raft_consensus.cc:385] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.093286  6326 raft_consensus.cc:740] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.094214  6326 consensus_queue.cc:260] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.096889  6327 tablet_bootstrap.cc:654] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.097142  6325 tablet_bootstrap.cc:492] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.097697  6325 ts_tablet_manager.cc:1403] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:26:53.100214  6325 raft_consensus.cc:359] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.100829  6161 heartbeater.cc:499] Master 127.29.9.62:36679 was elected leader, sending a full tablet report...
I20260709 12:26:53.102115  6326 ts_tablet_manager.cc:1434] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:53.103317  6326 tablet_bootstrap.cc:492] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.106218  6327 tablet_bootstrap.cc:492] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.106782  6327 ts_tablet_manager.cc:1403] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 12:26:53.109421  6326 tablet_bootstrap.cc:654] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.102412  6325 raft_consensus.cc:385] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.109560  6327 raft_consensus.cc:359] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.111483  6325 raft_consensus.cc:740] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.111644  6327 raft_consensus.cc:385] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.112154  6327 raft_consensus.cc:740] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.112426  6325 consensus_queue.cc:260] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.113045  6327 consensus_queue.cc:260] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.114981  6325 ts_tablet_manager.cc:1434] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:26:53.115605  6327 ts_tablet_manager.cc:1434] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:53.116027  6325 tablet_bootstrap.cc:492] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.116747  6327 tablet_bootstrap.cc:492] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.123107  6327 tablet_bootstrap.cc:654] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.124047  6326 tablet_bootstrap.cc:492] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.124573  6326 ts_tablet_manager.cc:1403] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:26:53.127384  6326 raft_consensus.cc:359] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.128126  6326 raft_consensus.cc:385] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.128436  6326 raft_consensus.cc:740] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.129143  6326 consensus_queue.cc:260] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.131177  6326 ts_tablet_manager.cc:1434] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:26:53.132084  6326 tablet_bootstrap.cc:492] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.132671  6325 tablet_bootstrap.cc:654] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.133221  6334 raft_consensus.cc:493] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.133710  6334 raft_consensus.cc:515] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.137671  6326 tablet_bootstrap.cc:654] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.155565  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:53.155817  6334 leader_election.cc:290] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.156392  6211 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:53.157882  6100 leader_election.cc:304] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:53.158746  6334 raft_consensus.cc:2804] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.159581  6334 raft_consensus.cc:493] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.160014  6334 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.162261  6325 tablet_bootstrap.cc:492] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.162950  6325 ts_tablet_manager.cc:1403] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.005s
I20260709 12:26:53.168270  6325 raft_consensus.cc:359] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.172314  6325 raft_consensus.cc:385] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.172694  6325 raft_consensus.cc:740] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.173612  6325 consensus_queue.cc:260] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.174535  6327 tablet_bootstrap.cc:492] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.175145  6327 ts_tablet_manager.cc:1403] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.026s
I20260709 12:26:53.178752  6325 ts_tablet_manager.cc:1434] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:26:53.179942  6325 tablet_bootstrap.cc:492] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.171451  6334 raft_consensus.cc:515] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.182438  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:53.183000  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.183169  6285 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:53.183589  6211 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.186121  6327 raft_consensus.cc:359] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.189823  6327 raft_consensus.cc:385] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.190222  6327 raft_consensus.cc:740] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.187491  6334 leader_election.cc:290] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.188957  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:53.191457  6285 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.191394  6211 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:53.192775  6100 leader_election.cc:304] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:53.193195  6325 tablet_bootstrap.cc:654] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.199599  6285 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:53.201501  6334 raft_consensus.cc:2804] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.203089  6334 raft_consensus.cc:697] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:53.204087  6334 consensus_queue.cc:237] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.202051  6327 consensus_queue.cc:260] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.207368  6326 tablet_bootstrap.cc:492] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.208012  6326 ts_tablet_manager.cc:1403] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.076s	user 0.043s	sys 0.031s
I20260709 12:26:53.209153  6327 ts_tablet_manager.cc:1434] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:26:53.210139  6327 tablet_bootstrap.cc:492] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.211058  6326 raft_consensus.cc:359] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.211882  6326 raft_consensus.cc:385] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.212208  6326 raft_consensus.cc:740] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.213119  6326 consensus_queue.cc:260] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.215265  6326 ts_tablet_manager.cc:1434] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:26:53.216285  6326 tablet_bootstrap.cc:492] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.217514  6325 tablet_bootstrap.cc:492] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.218079  6325 ts_tablet_manager.cc:1403] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.022s
I20260709 12:26:53.216449  6327 tablet_bootstrap.cc:654] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.220968  6325 raft_consensus.cc:359] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.221793  6325 raft_consensus.cc:385] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.222119  6325 raft_consensus.cc:740] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.223171  6326 tablet_bootstrap.cc:654] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.222965  6325 consensus_queue.cc:260] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.225271  6325 ts_tablet_manager.cc:1434] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:26:53.226253  6325 tablet_bootstrap.cc:492] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.231387  6327 tablet_bootstrap.cc:492] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.232053  6327 ts_tablet_manager.cc:1403] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:26:53.232210  6325 tablet_bootstrap.cc:654] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.235255  6327 raft_consensus.cc:359] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.236088  6327 raft_consensus.cc:385] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.236515  6327 raft_consensus.cc:740] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.238376  6327 consensus_queue.cc:260] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.239316  6326 tablet_bootstrap.cc:492] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.239948  6326 ts_tablet_manager.cc:1403] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 12:26:53.242648  6327 ts_tablet_manager.cc:1434] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:53.242756  6326 raft_consensus.cc:359] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.243541  6326 raft_consensus.cc:385] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.243880  6326 raft_consensus.cc:740] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.244624  6326 consensus_queue.cc:260] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.247040  6326 ts_tablet_manager.cc:1434] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:53.246479  6032 catalog_manager.cc:5697] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.248150  6326 tablet_bootstrap.cc:492] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.256240  6326 tablet_bootstrap.cc:654] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.252321  6327 tablet_bootstrap.cc:492] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.258893  6325 tablet_bootstrap.cc:492] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.259505  6325 ts_tablet_manager.cc:1403] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.010s
I20260709 12:26:53.262729  6325 raft_consensus.cc:359] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.263290  6327 tablet_bootstrap.cc:654] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.263593  6325 raft_consensus.cc:385] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.264046  6325 raft_consensus.cc:740] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.265031  6325 consensus_queue.cc:260] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.268436  6325 ts_tablet_manager.cc:1434] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:26:53.269405  6326 tablet_bootstrap.cc:492] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.269945  6326 ts_tablet_manager.cc:1403] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 12:26:53.269423  6325 tablet_bootstrap.cc:492] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.271754  6327 tablet_bootstrap.cc:492] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.272271  6327 ts_tablet_manager.cc:1403] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 12:26:53.272672  6326 raft_consensus.cc:359] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.273443  6326 raft_consensus.cc:385] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.273769  6326 raft_consensus.cc:740] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.274577  6326 consensus_queue.cc:260] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.276962  6325 tablet_bootstrap.cc:654] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.277005  6326 ts_tablet_manager.cc:1434] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:53.278234  6326 tablet_bootstrap.cc:492] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.275197  6327 raft_consensus.cc:359] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.279630  6327 raft_consensus.cc:385] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.280026  6327 raft_consensus.cc:740] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.280889  6327 consensus_queue.cc:260] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.285054  6326 tablet_bootstrap.cc:654] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.288370  6327 ts_tablet_manager.cc:1434] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:53.289515  6327 tablet_bootstrap.cc:492] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.294610  6325 tablet_bootstrap.cc:492] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.295169  6325 ts_tablet_manager.cc:1403] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.006s
I20260709 12:26:53.298827  6327 tablet_bootstrap.cc:654] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.299192  6326 tablet_bootstrap.cc:492] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.299022  6325 raft_consensus.cc:359] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.299749  6326 ts_tablet_manager.cc:1403] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:26:53.299860  6325 raft_consensus.cc:385] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.300230  6325 raft_consensus.cc:740] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.301193  6325 consensus_queue.cc:260] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.302738  6326 raft_consensus.cc:359] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.303377  6325 ts_tablet_manager.cc:1434] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:26:53.303476  6326 raft_consensus.cc:385] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.303912  6326 raft_consensus.cc:740] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.304497  6325 tablet_bootstrap.cc:492] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.304661  6326 consensus_queue.cc:260] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.305840  6327 tablet_bootstrap.cc:492] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.306377  6327 ts_tablet_manager.cc:1403] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 12:26:53.309599  6326 ts_tablet_manager.cc:1434] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:53.310680  6326 tablet_bootstrap.cc:492] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.311013  6325 tablet_bootstrap.cc:654] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.315925  6327 raft_consensus.cc:359] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.316776  6327 raft_consensus.cc:385] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.316929  6326 tablet_bootstrap.cc:654] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.317350  6330 raft_consensus.cc:493] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.317842  6330 raft_consensus.cc:515] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.318899  6327 raft_consensus.cc:740] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.319823  6327 consensus_queue.cc:260] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.321831  6325 tablet_bootstrap.cc:492] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.322402  6325 ts_tablet_manager.cc:1403] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:26:53.325574  6325 raft_consensus.cc:359] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.326382  6325 raft_consensus.cc:385] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.326741  6325 raft_consensus.cc:740] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.327569  6325 consensus_queue.cc:260] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.329126  6330 leader_election.cc:290] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.330420  6327 ts_tablet_manager.cc:1434] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:26:53.331013  6325 ts_tablet_manager.cc:1434] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:53.332136  6325 tablet_bootstrap.cc:492] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.333117  6327 tablet_bootstrap.cc:492] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.329046  6326 tablet_bootstrap.cc:492] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.337077  6326 ts_tablet_manager.cc:1403] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.002s
I20260709 12:26:53.338797  6325 tablet_bootstrap.cc:654] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.340865  6326 raft_consensus.cc:359] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.341701  6326 raft_consensus.cc:385] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.342010  6326 raft_consensus.cc:740] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.342935  6326 consensus_queue.cc:260] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.345431  6326 ts_tablet_manager.cc:1434] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:26:53.346530  6326 tablet_bootstrap.cc:492] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.349905  6357 raft_consensus.cc:493] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.350487  6357 raft_consensus.cc:515] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.353264  6326 tablet_bootstrap.cc:654] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.355818  6333 raft_consensus.cc:493] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.356186  6357 leader_election.cc:290] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.356369  6333 raft_consensus.cc:515] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.359247  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:53.360031  6136 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.361042  6333 leader_election.cc:290] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.361299  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:53.346668  6327 tablet_bootstrap.cc:654] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.362066  6135 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.368913  6325 tablet_bootstrap.cc:492] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.369481  6325 ts_tablet_manager.cc:1403] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.011s
I20260709 12:26:53.369760  6251 leader_election.cc:304] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.370744  6251 leader_election.cc:304] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.371605  6357 raft_consensus.cc:2804] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.372049  6357 raft_consensus.cc:493] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.371953  6325 raft_consensus.cc:359] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.371773  6330 raft_consensus.cc:2804] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.372687  6325 raft_consensus.cc:385] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.372915  6330 raft_consensus.cc:493] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.373104  6325 raft_consensus.cc:740] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.373323  6330 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.373946  6325 consensus_queue.cc:260] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.372512  6357 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.375123  6327 tablet_bootstrap.cc:492] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.376852  6327 ts_tablet_manager.cc:1403] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.004s
I20260709 12:26:53.379912  6327 raft_consensus.cc:359] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.380702  6327 raft_consensus.cc:385] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.381042  6327 raft_consensus.cc:740] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.381779  6327 consensus_queue.cc:260] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.383876  6333 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.384338  6333 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.385241  6325 ts_tablet_manager.cc:1434] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.007s
I20260709 12:26:53.386209  6325 tablet_bootstrap.cc:492] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:53.386287  6333 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.391599  6325 tablet_bootstrap.cc:654] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.393362  6357 raft_consensus.cc:515] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.398689  6327 ts_tablet_manager.cc:1434] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:26:53.400195  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:53.400949  6135 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.403890  6334 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.404400  6334 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.406457  6334 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.406786  6327 tablet_bootstrap.cc:492] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.391176  6330 raft_consensus.cc:515] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.408470  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:53.410177  6211 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:53.410259  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:53.410956  6136 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.411440  6100 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:53.412405  6334 raft_consensus.cc:2804] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.412806  6334 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.413200  6334 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.415478  6327 tablet_bootstrap.cc:654] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.418270  6325 tablet_bootstrap.cc:492] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:53.382048  6364 raft_consensus.cc:493] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:53.396677  6082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:53.418860  6325 ts_tablet_manager.cc:1403] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.012s
I20260709 12:26:53.422113  6327 tablet_bootstrap.cc:492] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.422636  6327 ts_tablet_manager.cc:1403] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:26:53.418965  6364 raft_consensus.cc:515] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.424503  6325 raft_consensus.cc:359] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.418653  6136 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.420457  6334 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.425254  6325 raft_consensus.cc:385] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.427543  6325 raft_consensus.cc:740] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.428167  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:53.428521  6325 consensus_queue.cc:260] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.429049  6364 leader_election.cc:290] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.430349  6357 leader_election.cc:290] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.421341  6330 leader_election.cc:290] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.425209  6327 raft_consensus.cc:359] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.432422  6327 raft_consensus.cc:385] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.432708  6327 raft_consensus.cc:740] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.420125  6135 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.435155  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598421c7f9a4ecc96b7edc75ece5861" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:53.435896  6285 raft_consensus.cc:2468] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 0.
I20260709 12:26:53.436556  6327 consensus_queue.cc:260] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.437628  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.437719  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:53.438215  6211 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.427460  6251 leader_election.cc:304] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.438374  6285 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 0.
I20260709 12:26:53.441146  6134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:53.442224  6134 raft_consensus.cc:2393] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21d35f94d504429f9484bf24dc6028d4 in current term 1: Already voted for candidate 39e3ddb0597d49f28bf869098c62c595 in this term.
I20260709 12:26:53.444211  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:53.444976  6210 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.446509  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:53.447134  6210 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.431578  6136 raft_consensus.cc:2468] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.435320  6334 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.438694  6327 ts_tablet_manager.cc:1434] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:26:53.448599  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.449489  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:53.451457  6177 leader_election.cc:304] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.452503  6251 leader_election.cc:304] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.450407  6208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.462924  6333 raft_consensus.cc:2804] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.460983  6210 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.463119  6325 ts_tablet_manager.cc:1434] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.021s
I20260709 12:26:53.463174  6251 leader_election.cc:304] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.455969  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:53.463420  6333 raft_consensus.cc:493] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.464186  6177 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.464438  6333 raft_consensus.cc:3060] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.451864  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598421c7f9a4ecc96b7edc75ece5861" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:53.471160  6210 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.456789  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:53.464432  6285 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:53.461035  6209 raft_consensus.cc:2468] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.463313  6208 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.472515  6333 raft_consensus.cc:515] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.474694  6333 leader_election.cc:290] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.459625  6326 tablet_bootstrap.cc:492] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.476155  6326 ts_tablet_manager.cc:1403] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.004s
I20260709 12:26:53.454763  6327 tablet_bootstrap.cc:492] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:53.478531  6326 raft_consensus.cc:359] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.479246  6326 raft_consensus.cc:385] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.452378  6357 raft_consensus.cc:2804] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.484553  6357 raft_consensus.cc:697] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:53.484824  6363 raft_consensus.cc:2804] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.485363  6363 raft_consensus.cc:493] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.485687  6363 raft_consensus.cc:3060] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.447636  6211 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:53.485790  6357 consensus_queue.cc:237] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.487229  6333 raft_consensus.cc:2764] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:53.484553  6364 raft_consensus.cc:2804] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.479527  6326 raft_consensus.cc:740] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.495481  6364 raft_consensus.cc:697] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:53.496556  6364 consensus_queue.cc:237] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.498046  6208 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.491690  6333 raft_consensus.cc:493] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.499078  6333 raft_consensus.cc:515] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.487672  6327 tablet_bootstrap.cc:654] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.502609  6363 raft_consensus.cc:515] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.496665  6326 consensus_queue.cc:260] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.505492  6333 leader_election.cc:290] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.505679  6100 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: a07d9332cd9249b589722f82c519da03
I20260709 12:26:53.506769  6334 raft_consensus.cc:2804] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.507244  6334 raft_consensus.cc:697] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:53.508159  6334 consensus_queue.cc:237] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.510179  6326 ts_tablet_manager.cc:1434] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:26:53.511157  6326 tablet_bootstrap.cc:492] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:53.516024  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:53.516786  6135 raft_consensus.cc:3060] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.517186  6363 leader_election.cc:290] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.516379  6033 catalog_manager.cc:5697] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.518482  6033 catalog_manager.cc:5697] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.519491  6326 tablet_bootstrap.cc:654] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.534922  6135 raft_consensus.cc:2468] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.536306  6251 leader_election.cc:304] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.537197  6363 raft_consensus.cc:2804] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.537953  6363 raft_consensus.cc:697] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:53.538975  6363 consensus_queue.cc:237] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.539513  6031 catalog_manager.cc:5697] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:53.540246  6177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.3:43473, user_credentials={real_user=slave}} blocked reactor thread for 76133.4us
I20260709 12:26:53.542798  6327 tablet_bootstrap.cc:492] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:53.543282  6327 ts_tablet_manager.cc:1403] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.002s
W20260709 12:26:53.543423  6177 leader_election.cc:343] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.546156  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598421c7f9a4ecc96b7edc75ece5861" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:53.546736  6285 raft_consensus.cc:3060] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.546818  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:53.547897  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598421c7f9a4ecc96b7edc75ece5861" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:53.548475  6135 raft_consensus.cc:3060] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.550663  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:53.551450  6284 raft_consensus.cc:2468] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 0.
W20260709 12:26:53.551554  6177 leader_election.cc:343] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.550735  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.552798  6211 raft_consensus.cc:3060] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.555248  6135 raft_consensus.cc:2468] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:53.545956  6327 raft_consensus.cc:359] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.557076  6327 raft_consensus.cc:385] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.557343  6327 raft_consensus.cc:740] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.557996  6327 consensus_queue.cc:260] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.558504  6285 raft_consensus.cc:2468] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:53.560770  6327 ts_tablet_manager.cc:1434] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:26:53.562758  6211 raft_consensus.cc:2468] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.563302  6033 catalog_manager.cc:5697] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.564633  6177 leader_election.cc:304] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:53.565435  6333 raft_consensus.cc:2804] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.565891  6333 raft_consensus.cc:697] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:53.566205  6177 leader_election.cc:304] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:53.566824  6333 consensus_queue.cc:237] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.567361  6369 raft_consensus.cc:2804] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.565840  6326 tablet_bootstrap.cc:492] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:53.567791  6369 raft_consensus.cc:493] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.568169  6369 raft_consensus.cc:3060] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.570516  6326 ts_tablet_manager.cc:1403] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.008s
I20260709 12:26:53.573345  6326 raft_consensus.cc:359] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.573940  6326 raft_consensus.cc:385] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.574182  6326 raft_consensus.cc:740] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.574937  6326 consensus_queue.cc:260] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.575294  6369 raft_consensus.cc:515] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.578387  6369 leader_election.cc:290] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.579147  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:53.579780  6135 raft_consensus.cc:3060] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.579804  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:53.579298  6032 catalog_manager.cc:5697] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.580463  6285 raft_consensus.cc:3060] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.582440  6334 raft_consensus.cc:493] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.582937  6334 raft_consensus.cc:515] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.585099  6334 leader_election.cc:290] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.586753  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:53.586880  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:53.587527  6211 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:53.587528  6284 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:53.589560  6326 ts_tablet_manager.cc:1434] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:53.589170  6100 leader_election.cc:304] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:53.589627  6285 raft_consensus.cc:2468] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:53.591651  6334 raft_consensus.cc:2804] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.592044  6334 raft_consensus.cc:493] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.592110  6177 leader_election.cc:304] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.592413  6334 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.593261  6369 raft_consensus.cc:2804] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.593719  6369 raft_consensus.cc:697] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:53.594503  6369 consensus_queue.cc:237] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.596632  6135 raft_consensus.cc:2468] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:53.598292  6334 raft_consensus.cc:515] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.601212  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:53.601770  6285 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.602612  6334 leader_election.cc:290] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.604303  6033 catalog_manager.cc:5697] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.605623  6334 consensus_queue.cc:1048] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:53.606041  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.606751  6211 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.608377  6285 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:53.609736  6102 leader_election.cc:304] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.610726  6334 raft_consensus.cc:2804] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.611195  6334 raft_consensus.cc:697] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:53.612020  6334 consensus_queue.cc:237] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.614535  6211 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:53.620596  6033 catalog_manager.cc:5697] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.621683  6363 raft_consensus.cc:493] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.622226  6363 raft_consensus.cc:515] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.624403  6363 leader_election.cc:290] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.627252  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:53.628060  6135 raft_consensus.cc:2468] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.629484  6251 leader_election.cc:304] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.630764  6363 raft_consensus.cc:2804] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:53.631163  6363 raft_consensus.cc:493] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.631470  6363 raft_consensus.cc:3060] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.631657  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:53.632340  6209 raft_consensus.cc:2468] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:53.635512  6334 consensus_queue.cc:1048] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.640475  6363 raft_consensus.cc:515] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.643194  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:53.643774  6135 raft_consensus.cc:3060] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.645486  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.646253  6211 raft_consensus.cc:3060] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.647168  6363 leader_election.cc:290] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.650977  6135 raft_consensus.cc:2468] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.652037  6251 leader_election.cc:304] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.652817  6363 raft_consensus.cc:2804] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:53.652716  6211 raft_consensus.cc:2468] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:53.653400  6363 raft_consensus.cc:697] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:53.654206  6363 consensus_queue.cc:237] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.662133  6032 catalog_manager.cc:5697] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.742475  6285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:35974
I20260709 12:26:53.742977  6285 raft_consensus.cc:606] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:53.748127  6285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:35974
I20260709 12:26:53.748617  6285 raft_consensus.cc:606] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:53.767259  6135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
mode: GRACEFUL
new_leader_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:55472
I20260709 12:26:53.767789  6135 raft_consensus.cc:606] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Received request to transfer leadership to TS 21d35f94d504429f9484bf24dc6028d4
I20260709 12:26:53.772682  6285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:35974
I20260709 12:26:53.773156  6285 raft_consensus.cc:606] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Received request to transfer leadership to TS 21d35f94d504429f9484bf24dc6028d4
I20260709 12:26:53.777848  6285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:35974
I20260709 12:26:53.778319  6285 raft_consensus.cc:606] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Received request to transfer leadership to TS 21d35f94d504429f9484bf24dc6028d4
I20260709 12:26:53.790205  6211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
mode: GRACEFUL
new_leader_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:38680
I20260709 12:26:53.790737  6211 raft_consensus.cc:606] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Received request to transfer leadership to TS a07d9332cd9249b589722f82c519da03
I20260709 12:26:53.880189  6363 consensus_queue.cc:1048] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.886863  6367 raft_consensus.cc:993] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03: : Instructing follower 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:53.887284  6367 raft_consensus.cc:1081] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Signalling peer 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:53.889267  6209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:38672
I20260709 12:26:53.891338  6209 raft_consensus.cc:493] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.891752  6209 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.891882  6357 consensus_queue.cc:1048] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.896396  6363 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.903311  6209 raft_consensus.cc:515] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.907879  6367 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.918022  6357 raft_consensus.cc:993] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03: : Instructing follower 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:53.918555  6367 raft_consensus.cc:1081] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Signalling peer 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:53.919104  6209 leader_election.cc:290] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:53.921000  6136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:55454
I20260709 12:26:53.921132  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:53.921268  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:53.921613  6136 raft_consensus.cc:493] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.921743  6285 raft_consensus.cc:3055] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.921960  6135 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.922021  6136 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.922134  6285 raft_consensus.cc:740] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:53.923346  6285 consensus_queue.cc:260] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.927057  6285 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.928776  6135 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:53.929361  6136 raft_consensus.cc:515] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.930058  6177 leader_election.cc:304] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:53.930989  6369 raft_consensus.cc:2804] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.931440  6369 raft_consensus.cc:697] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:53.932195  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:53.932837  6284 raft_consensus.cc:3055] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:53.932200  6369 consensus_queue.cc:237] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:53.933135  6284 raft_consensus.cc:740] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:53.934011  6284 consensus_queue.cc:260] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.934648  6285 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:53.935158  6284 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.936585  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:53.937232  6209 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.939570  6032 catalog_manager.cc:5697] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 1 to 2, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.942431  6284 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:53.933140  6136 leader_election.cc:290] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Requested vote from peers a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:53.943789  6102 leader_election.cc:304] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:53.944077  6209 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:53.944980  6334 raft_consensus.cc:2804] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.945407  6334 raft_consensus.cc:697] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:53.946075  6334 consensus_queue.cc:237] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:26:53.950704  6285 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.952553  6032 catalog_manager.cc:5697] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 1 to 2, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.957033  6334 consensus_queue.cc:1048] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.968868  6334 consensus_queue.cc:1048] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.984668  6357 consensus_queue.cc:1048] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.990486  6357 consensus_queue.cc:1048] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.991400  6363 raft_consensus.cc:993] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03: : Instructing follower 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:53.992173  6357 raft_consensus.cc:1081] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Signalling peer 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:53.993912  6135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:55454
I20260709 12:26:53.994449  6135 raft_consensus.cc:493] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:53.994822  6135 raft_consensus.cc:3060] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.005358  6135 raft_consensus.cc:515] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.007872  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:54.008114  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:54.008683  6135 leader_election.cc:290] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:54.009514  6285 raft_consensus.cc:3055] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.008527  6209 raft_consensus.cc:3060] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.009883  6285 raft_consensus.cc:740] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:54.010969  6285 consensus_queue.cc:260] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.012305  6285 raft_consensus.cc:3060] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.017215  6209 raft_consensus.cc:2468] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:54.018555  6100 leader_election.cc:304] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:54.019238  6391 raft_consensus.cc:2804] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.019309  6285 raft_consensus.cc:2468] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:54.019680  6391 raft_consensus.cc:697] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:54.020567  6391 consensus_queue.cc:237] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.026870  6031 catalog_manager.cc:5697] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 1 to 2, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.032354  6369 consensus_queue.cc:1048] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.039188  6333 raft_consensus.cc:993] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4: : Instructing follower a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:26:54.039664  6369 raft_consensus.cc:1081] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Signalling peer a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:26:54.044077  6285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:26:54.044701  6285 raft_consensus.cc:493] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:54.045117  6285 raft_consensus.cc:3060] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.044996  6368 consensus_queue.cc:1048] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:54.051064  6369 consensus_queue.cc:1048] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.052831  6285 raft_consensus.cc:515] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.056020  6134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:54.056299  6285 leader_election.cc:290] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:54.056875  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e0a61375ed485bb71eaf0923c495a4" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:54.057574  6209 raft_consensus.cc:3055] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.057879  6209 raft_consensus.cc:740] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:54.058712  6209 consensus_queue.cc:260] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.061249  6209 raft_consensus.cc:3060] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.069449  6209 raft_consensus.cc:2468] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 2.
I20260709 12:26:54.070493  6249 leader_election.cc:304] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:54.072041  6357 raft_consensus.cc:2804] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.072515  6357 raft_consensus.cc:697] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:54.073300  6357 consensus_queue.cc:237] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.075327  6333 consensus_queue.cc:1048] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.081457  6391 consensus_queue.cc:1048] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.082863  6032 catalog_manager.cc:5697] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 1 to 2, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:54.092775  6391 consensus_queue.cc:1048] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.101320  6342 raft_consensus.cc:993] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595: : Instructing follower 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:54.101809  6391 raft_consensus.cc:1081] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Signalling peer 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:54.103261  6209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:38662
I20260709 12:26:54.103750  6209 raft_consensus.cc:493] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:54.104077  6209 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.109124  6209 raft_consensus.cc:515] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.110566  6209 leader_election.cc:290] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:54.111339  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:54.111544  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:54.111979  6135 raft_consensus.cc:3055] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.112174  6285 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.112304  6135 raft_consensus.cc:740] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:54.113076  6135 consensus_queue.cc:260] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.113984  6135 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.117525  6285 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:54.118566  6177 leader_election.cc:304] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:54.118719  6135 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:54.119313  6333 raft_consensus.cc:2804] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.119803  6333 raft_consensus.cc:697] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:54.120541  6333 consensus_queue.cc:237] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.126544  6033 catalog_manager.cc:5697] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 1 to 2, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.147568  6357 consensus_queue.cc:1048] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.154243  6363 raft_consensus.cc:993] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03: : Instructing follower 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:54.154731  6330 raft_consensus.cc:1081] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Signalling peer 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:54.156308  6209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:38672
I20260709 12:26:54.157033  6209 raft_consensus.cc:493] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:54.157404  6209 raft_consensus.cc:3060] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.160370  6357 consensus_queue.cc:1048] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.163797  6209 raft_consensus.cc:515] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.166774  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:54.169695  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3415d2429cd4be699177d750bbf0d16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:54.170128  6285 raft_consensus.cc:3055] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.170396  6285 raft_consensus.cc:740] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:54.171120  6285 consensus_queue.cc:260] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.171972  6285 raft_consensus.cc:3060] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.173866  6209 leader_election.cc:290] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:54.178411  6285 raft_consensus.cc:2468] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:54.179482  6177 leader_election.cc:304] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:54.180157  6333 raft_consensus.cc:2804] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.180552  6333 raft_consensus.cc:697] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:54.181281  6333 consensus_queue.cc:237] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:54.187297  6031 catalog_manager.cc:5697] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 1 to 2, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.329044  6135 raft_consensus.cc:1275] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.330401  6333 consensus_queue.cc:1048] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.338037  6285 raft_consensus.cc:1275] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.340586  6369 consensus_queue.cc:1048] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.405220  6209 raft_consensus.cc:1275] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.406498  6391 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.408651  6285 raft_consensus.cc:1275] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.410173  6391 consensus_queue.cc:1048] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.414889  6284 raft_consensus.cc:1275] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.425798  6342 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.428876  6209 raft_consensus.cc:1275] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.431376  6391 consensus_queue.cc:1048] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.529733  6284 raft_consensus.cc:1275] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.530959  6369 consensus_queue.cc:1048] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.538206  6135 raft_consensus.cc:1275] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.539835  6368 consensus_queue.cc:1048] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.564947  6209 raft_consensus.cc:1275] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.566097  6357 consensus_queue.cc:1048] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.573030  6135 raft_consensus.cc:3060] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.579775  6135 raft_consensus.cc:1275] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.580917  6363 consensus_queue.cc:1048] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.633692  6135 raft_consensus.cc:3060] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.639230  6135 raft_consensus.cc:1275] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.640749  6368 consensus_queue.cc:1048] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.648756  6284 raft_consensus.cc:1275] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.650532  6369 consensus_queue.cc:1048] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.821321  6031 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38378:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:56.823689  6031 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:56.872707  6125 tablet_service.cc:1511] Processing CreateTablet for tablet 822bdf7349cd4f258b3c06951a801696 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:56.874042  6125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822bdf7349cd4f258b3c06951a801696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.873852  6196 tablet_service.cc:1511] Processing CreateTablet for tablet 822bdf7349cd4f258b3c06951a801696 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:56.875088  6196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822bdf7349cd4f258b3c06951a801696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.874907  6267 tablet_service.cc:1511] Processing CreateTablet for tablet 822bdf7349cd4f258b3c06951a801696 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:26:56.876195  6267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822bdf7349cd4f258b3c06951a801696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.878554  6126 tablet_service.cc:1511] Processing CreateTablet for tablet 2c366c05985c4c3f9f32b98da4714a16 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:56.879819  6126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c366c05985c4c3f9f32b98da4714a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.882404  6272 tablet_service.cc:1511] Processing CreateTablet for tablet 2c366c05985c4c3f9f32b98da4714a16 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:56.884475  6118 tablet_service.cc:1511] Processing CreateTablet for tablet d8cda126fbf641e7aec5e1af3faf6bed (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:56.884690  6194 tablet_service.cc:1511] Processing CreateTablet for tablet 2c366c05985c4c3f9f32b98da4714a16 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:26:56.885975  6118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8cda126fbf641e7aec5e1af3faf6bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.886221  6194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c366c05985c4c3f9f32b98da4714a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.887878  6272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c366c05985c4c3f9f32b98da4714a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.888675  6199 tablet_service.cc:1511] Processing CreateTablet for tablet d8cda126fbf641e7aec5e1af3faf6bed (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:56.889959  6199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8cda126fbf641e7aec5e1af3faf6bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.892565  6122 tablet_service.cc:1511] Processing CreateTablet for tablet 43bf9ca8a07e4e59872a5c6980610544 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:56.893841  6122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43bf9ca8a07e4e59872a5c6980610544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.895337  6271 tablet_service.cc:1511] Processing CreateTablet for tablet 43bf9ca8a07e4e59872a5c6980610544 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:56.896626  6271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43bf9ca8a07e4e59872a5c6980610544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.897992  6124 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4628176c63472cb5232cbda1bf5a6c (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:56.899232  6124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4628176c63472cb5232cbda1bf5a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.888693  6270 tablet_service.cc:1511] Processing CreateTablet for tablet d8cda126fbf641e7aec5e1af3faf6bed (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:26:56.901171  6270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8cda126fbf641e7aec5e1af3faf6bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.901499  6201 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4628176c63472cb5232cbda1bf5a6c (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:56.902734  6201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4628176c63472cb5232cbda1bf5a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.903847  6268 tablet_service.cc:1511] Processing CreateTablet for tablet 2c4628176c63472cb5232cbda1bf5a6c (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:26:56.905315  6268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4628176c63472cb5232cbda1bf5a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.907413  6120 tablet_service.cc:1511] Processing CreateTablet for tablet 6e865bca75e14278a31e10460f861e2f (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:56.896689  6200 tablet_service.cc:1511] Processing CreateTablet for tablet 43bf9ca8a07e4e59872a5c6980610544 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:26:56.910465  6120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e865bca75e14278a31e10460f861e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.910610  6269 tablet_service.cc:1511] Processing CreateTablet for tablet 6e865bca75e14278a31e10460f861e2f (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:56.908069  6195 tablet_service.cc:1511] Processing CreateTablet for tablet 6e865bca75e14278a31e10460f861e2f (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:26:56.911873  6269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e865bca75e14278a31e10460f861e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.912195  6195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e865bca75e14278a31e10460f861e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.914070  6119 tablet_service.cc:1511] Processing CreateTablet for tablet 92297cd05e7b4b4b8d8b4514fb502841 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:56.914212  6197 tablet_service.cc:1511] Processing CreateTablet for tablet 92297cd05e7b4b4b8d8b4514fb502841 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:56.915287  6119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92297cd05e7b4b4b8d8b4514fb502841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.915433  6197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92297cd05e7b4b4b8d8b4514fb502841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.916385  6274 tablet_service.cc:1511] Processing CreateTablet for tablet 92297cd05e7b4b4b8d8b4514fb502841 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:26:56.917616  6274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92297cd05e7b4b4b8d8b4514fb502841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.920066  6200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43bf9ca8a07e4e59872a5c6980610544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.927632  6123 tablet_service.cc:1511] Processing CreateTablet for tablet 55007ce213534b4fb5de84c6b8902bfd (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:56.928984  6123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55007ce213534b4fb5de84c6b8902bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.929610  6198 tablet_service.cc:1511] Processing CreateTablet for tablet 55007ce213534b4fb5de84c6b8902bfd (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:56.930907  6198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55007ce213534b4fb5de84c6b8902bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.931699  6273 tablet_service.cc:1511] Processing CreateTablet for tablet 55007ce213534b4fb5de84c6b8902bfd (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:26:56.932981  6273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55007ce213534b4fb5de84c6b8902bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.937412  6121 tablet_service.cc:1511] Processing CreateTablet for tablet 4d511cc59ba840c5ab6b44db1889c689 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:56.938673  6121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d511cc59ba840c5ab6b44db1889c689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.939353  6193 tablet_service.cc:1511] Processing CreateTablet for tablet 4d511cc59ba840c5ab6b44db1889c689 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:56.940559  6193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d511cc59ba840c5ab6b44db1889c689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.941510  6275 tablet_service.cc:1511] Processing CreateTablet for tablet 4d511cc59ba840c5ab6b44db1889c689 (DEFAULT_TABLE table=soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:26:56.942724  6275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d511cc59ba840c5ab6b44db1889c689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.052723  6418 tablet_bootstrap.cc:492] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.072077  6419 tablet_bootstrap.cc:492] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.079377  6418 tablet_bootstrap.cc:654] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.079541  6419 tablet_bootstrap.cc:654] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.095491  6421 tablet_bootstrap.cc:492] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.096923  6418 tablet_bootstrap.cc:492] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.097411  6418 ts_tablet_manager.cc:1403] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 12:26:57.099601  6418 raft_consensus.cc:359] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.100188  6418 raft_consensus.cc:385] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.100411  6418 raft_consensus.cc:740] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.101189  6418 consensus_queue.cc:260] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.103267  6418 ts_tablet_manager.cc:1434] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:57.103374  6421 tablet_bootstrap.cc:654] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.104437  6418 tablet_bootstrap.cc:492] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.109244  6419 tablet_bootstrap.cc:492] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.109526  6421 tablet_bootstrap.cc:492] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.109820  6419 ts_tablet_manager.cc:1403] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.007s
I20260709 12:26:57.109989  6421 ts_tablet_manager.cc:1403] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:26:57.111099  6418 tablet_bootstrap.cc:654] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.112869  6419 raft_consensus.cc:359] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.113509  6419 raft_consensus.cc:385] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.113787  6419 raft_consensus.cc:740] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.114055  6421 raft_consensus.cc:359] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.114764  6421 raft_consensus.cc:385] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.115108  6421 raft_consensus.cc:740] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.114493  6419 consensus_queue.cc:260] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.117117  6419 ts_tablet_manager.cc:1434] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:57.118101  6419 tablet_bootstrap.cc:492] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.118224  6421 consensus_queue.cc:260] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.120803  6421 ts_tablet_manager.cc:1434] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:26:57.121784  6421 tablet_bootstrap.cc:492] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.128027  6421 tablet_bootstrap.cc:654] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.136623  6419 tablet_bootstrap.cc:654] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.136639  6418 tablet_bootstrap.cc:492] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.137410  6418 ts_tablet_manager.cc:1403] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.021s
I20260709 12:26:57.140489  6418 raft_consensus.cc:359] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.141057  6418 raft_consensus.cc:385] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.141350  6418 raft_consensus.cc:740] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.142010  6418 consensus_queue.cc:260] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.142556  6421 tablet_bootstrap.cc:492] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.143146  6421 ts_tablet_manager.cc:1403] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 12:26:57.144343  6418 ts_tablet_manager.cc:1434] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:57.145655  6418 tablet_bootstrap.cc:492] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.146170  6421 raft_consensus.cc:359] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.146899  6421 raft_consensus.cc:385] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.147166  6421 raft_consensus.cc:740] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.147969  6421 consensus_queue.cc:260] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.150485  6421 ts_tablet_manager.cc:1434] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:57.151400  6421 tablet_bootstrap.cc:492] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.152479  6418 tablet_bootstrap.cc:654] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.157610  6419 tablet_bootstrap.cc:492] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.158064  6419 ts_tablet_manager.cc:1403] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.007s
I20260709 12:26:57.161994  6419 raft_consensus.cc:359] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.162670  6419 raft_consensus.cc:385] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.162827  6418 tablet_bootstrap.cc:492] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.162988  6419 raft_consensus.cc:740] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.163425  6418 ts_tablet_manager.cc:1403] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:26:57.163931  6421 tablet_bootstrap.cc:654] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.163826  6419 consensus_queue.cc:260] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.166380  6418 raft_consensus.cc:359] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.167099  6418 raft_consensus.cc:385] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.167393  6418 raft_consensus.cc:740] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.168126  6418 consensus_queue.cc:260] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.170413  6418 ts_tablet_manager.cc:1434] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:57.170629  6421 tablet_bootstrap.cc:492] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.171316  6418 tablet_bootstrap.cc:492] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.171345  6421 ts_tablet_manager.cc:1403] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 12:26:57.168141  6419 ts_tablet_manager.cc:1434] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:26:57.171368  6333 raft_consensus.cc:493] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.172401  6333 raft_consensus.cc:515] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.172922  6419 tablet_bootstrap.cc:492] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.174840  6421 raft_consensus.cc:359] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.175654  6421 raft_consensus.cc:385] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.176115  6421 raft_consensus.cc:740] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.176535  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.176644  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.176987  6421 consensus_queue.cc:260] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
W20260709 12:26:57.178099  6177 leader_election.cc:343] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:57.178959  6177 leader_election.cc:343] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.179354  6177 leader_election.cc:304] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4; no voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03
I20260709 12:26:57.174923  6333 leader_election.cc:290] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.183079  6333 raft_consensus.cc:2749] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.179965  6419 tablet_bootstrap.cc:654] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.192337  6418 tablet_bootstrap.cc:654] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.192536  6421 ts_tablet_manager.cc:1434] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:26:57.193835  6421 tablet_bootstrap.cc:492] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.209885  6421 tablet_bootstrap.cc:654] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.213891  6418 tablet_bootstrap.cc:492] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.214148  6419 tablet_bootstrap.cc:492] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.214305  6418 ts_tablet_manager.cc:1403] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.004s
I20260709 12:26:57.214618  6421 tablet_bootstrap.cc:492] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.214720  6419 ts_tablet_manager.cc:1403] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.013s
I20260709 12:26:57.215171  6421 ts_tablet_manager.cc:1403] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 12:26:57.216825  6418 raft_consensus.cc:359] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.217571  6418 raft_consensus.cc:385] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.217849  6418 raft_consensus.cc:740] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.217967  6419 raft_consensus.cc:359] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.218098  6421 raft_consensus.cc:359] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.218509  6418 consensus_queue.cc:260] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.218816  6419 raft_consensus.cc:385] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.218917  6421 raft_consensus.cc:385] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.219239  6419 raft_consensus.cc:740] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.219288  6421 raft_consensus.cc:740] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.220137  6421 consensus_queue.cc:260] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.220137  6419 consensus_queue.cc:260] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.220997  6418 ts_tablet_manager.cc:1434] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:57.221540  6430 raft_consensus.cc:493] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.222049  6418 tablet_bootstrap.cc:492] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.221956  6430 raft_consensus.cc:515] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.224109  6430 leader_election.cc:290] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.224647  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.225782  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
W20260709 12:26:57.225924  6177 leader_election.cc:343] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.226413  6284 raft_consensus.cc:2468] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 0.
I20260709 12:26:57.229034  6419 ts_tablet_manager.cc:1434] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:57.230087  6419 tablet_bootstrap.cc:492] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.231537  6418 tablet_bootstrap.cc:654] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.233052  6421 ts_tablet_manager.cc:1434] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:57.236711  6419 tablet_bootstrap.cc:654] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.243347  6418 tablet_bootstrap.cc:492] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.243623  6421 tablet_bootstrap.cc:492] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.243918  6418 ts_tablet_manager.cc:1403] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:26:57.244535  6177 leader_election.cc:304] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.246095  6429 raft_consensus.cc:2804] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.246467  6429 raft_consensus.cc:493] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.246785  6429 raft_consensus.cc:3060] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.247107  6418 raft_consensus.cc:359] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.247921  6418 raft_consensus.cc:385] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.248193  6418 raft_consensus.cc:740] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.248975  6418 consensus_queue.cc:260] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.250710  6418 ts_tablet_manager.cc:1434] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:26:57.251521  6418 tablet_bootstrap.cc:492] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.254515  6421 tablet_bootstrap.cc:654] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.254235  6429 raft_consensus.cc:515] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.256407  6429 leader_election.cc:290] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.257714  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:57.258989  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.259366  6418 tablet_bootstrap.cc:654] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.259661  6284 raft_consensus.cc:3060] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.260520  6419 tablet_bootstrap.cc:492] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.261137  6419 ts_tablet_manager.cc:1403] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.004s
I20260709 12:26:57.264137  6419 raft_consensus.cc:359] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.264724  6419 raft_consensus.cc:385] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.266304  6421 tablet_bootstrap.cc:492] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.265014  6419 raft_consensus.cc:740] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.267009  6421 ts_tablet_manager.cc:1403] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.009s
I20260709 12:26:57.267342  6419 consensus_queue.cc:260] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.269011  6418 tablet_bootstrap.cc:492] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.269510  6418 ts_tablet_manager.cc:1403] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 12:26:57.269946  6419 ts_tablet_manager.cc:1434] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:26:57.270365  6421 raft_consensus.cc:359] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.271101  6421 raft_consensus.cc:385] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.271245  6419 tablet_bootstrap.cc:492] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.271457  6421 raft_consensus.cc:740] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.272547  6418 raft_consensus.cc:359] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.273272  6418 raft_consensus.cc:385] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.273540  6418 raft_consensus.cc:740] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.274230  6418 consensus_queue.cc:260] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.276401  6418 ts_tablet_manager.cc:1434] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:57.277325  6418 tablet_bootstrap.cc:492] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.278352  6419 tablet_bootstrap.cc:654] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.280659  6421 consensus_queue.cc:260] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
W20260709 12:26:57.283510  6177 leader_election.cc:343] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.284039  6418 tablet_bootstrap.cc:654] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.285601  6284 raft_consensus.cc:2468] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:57.290657  6421 ts_tablet_manager.cc:1434] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:26:57.293247  6177 leader_election.cc:304] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.295873  6429 raft_consensus.cc:2804] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.296403  6429 raft_consensus.cc:697] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:57.297242  6429 consensus_queue.cc:237] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.297850  6421 tablet_bootstrap.cc:492] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.301795  6418 tablet_bootstrap.cc:492] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.302304  6418 ts_tablet_manager.cc:1403] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.007s
I20260709 12:26:57.305363  6418 raft_consensus.cc:359] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.306087  6418 raft_consensus.cc:385] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.306397  6418 raft_consensus.cc:740] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.306684  6421 tablet_bootstrap.cc:654] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.307147  6418 consensus_queue.cc:260] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.308210  6419 tablet_bootstrap.cc:492] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.308887  6419 ts_tablet_manager.cc:1403] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.017s
I20260709 12:26:57.309626  6418 ts_tablet_manager.cc:1434] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:57.310639  6418 tablet_bootstrap.cc:492] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.312064  6419 raft_consensus.cc:359] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.317782  6419 raft_consensus.cc:385] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.318171  6419 raft_consensus.cc:740] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.319008  6419 consensus_queue.cc:260] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.322784  6421 tablet_bootstrap.cc:492] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.323402  6421 ts_tablet_manager.cc:1403] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 12:26:57.325217  6419 ts_tablet_manager.cc:1434] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.006s
I20260709 12:26:57.326287  6419 tablet_bootstrap.cc:492] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.326059  6421 raft_consensus.cc:359] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.326814  6421 raft_consensus.cc:385] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.327123  6421 raft_consensus.cc:740] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.318241  6418 tablet_bootstrap.cc:654] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.328785  6031 catalog_manager.cc:5697] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.330978  6421 consensus_queue.cc:260] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.332372  6419 tablet_bootstrap.cc:654] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.333346  6421 ts_tablet_manager.cc:1434] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:57.334614  6421 tablet_bootstrap.cc:492] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.338862  6407 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.340674  6421 tablet_bootstrap.cc:654] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.339375  6407 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.343218  6407 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:57.344735  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.345373  6135 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:57.346549  6251 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.348217  6418 tablet_bootstrap.cc:492] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.348721  6418 ts_tablet_manager.cc:1403] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.038s	user 0.001s	sys 0.011s
I20260709 12:26:57.348555  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.349155  6407 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.349314  6209 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:57.349572  6407 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.349965  6407 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.350597  6419 tablet_bootstrap.cc:492] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.351101  6419 ts_tablet_manager.cc:1403] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.009s
I20260709 12:26:57.351447  6418 raft_consensus.cc:359] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.352124  6418 raft_consensus.cc:385] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.352371  6418 raft_consensus.cc:740] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.353042  6418 consensus_queue.cc:260] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.353915  6419 raft_consensus.cc:359] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.354611  6419 raft_consensus.cc:385] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.354908  6419 raft_consensus.cc:740] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.355640  6419 consensus_queue.cc:260] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.355998  6418 ts_tablet_manager.cc:1434] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:57.357159  6418 tablet_bootstrap.cc:492] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03: Bootstrap starting.
I20260709 12:26:57.357467  6419 ts_tablet_manager.cc:1434] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 12:26:57.358402  6419 tablet_bootstrap.cc:492] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.362709  6418 tablet_bootstrap.cc:654] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.363709  6419 tablet_bootstrap.cc:654] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.369765  6445 raft_consensus.cc:493] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.370462  6445 raft_consensus.cc:515] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.373605  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.374384  6405 raft_consensus.cc:493] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.375003  6405 raft_consensus.cc:515] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.375394  6419 tablet_bootstrap.cc:492] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
W20260709 12:26:57.375391  6251 leader_election.cc:343] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.376127  6419 ts_tablet_manager.cc:1403] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:26:57.376840  6445 leader_election.cc:290] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:57.377293  6405 leader_election.cc:290] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.378904  6419 raft_consensus.cc:359] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.379351  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.379621  6419 raft_consensus.cc:385] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.379679  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.380919  6284 raft_consensus.cc:2468] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
W20260709 12:26:57.381804  6249 leader_election.cc:343] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.381542  6407 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.382202  6102 leader_election.cc:304] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.382827  6419 raft_consensus.cc:740] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.382263  6249 leader_election.cc:304] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.380105  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.384123  6405 raft_consensus.cc:2804] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.383647  6419 consensus_queue.cc:260] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.384433  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:57.385149  6135 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.386142  6419 ts_tablet_manager.cc:1434] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:57.387140  6419 tablet_bootstrap.cc:492] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
I20260709 12:26:57.388360  6209 raft_consensus.cc:2468] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:57.384541  6405 raft_consensus.cc:493] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.391587  6405 raft_consensus.cc:3060] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.393098  6419 tablet_bootstrap.cc:654] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.395226  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.395975  6209 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.393263  6135 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:57.410670  6251 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.416097  6445 raft_consensus.cc:2749] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.416862  6445 raft_consensus.cc:493] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.417327  6445 raft_consensus.cc:515] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.421195  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.422016  6211 raft_consensus.cc:2468] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:57.422797  6405 raft_consensus.cc:515] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.423491  6249 leader_election.cc:304] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.425954  6407 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:57.429162  6407 raft_consensus.cc:2804] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.429591  6407 raft_consensus.cc:493] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.431669  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.432027  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.432502  6211 raft_consensus.cc:3060] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.432725  6284 raft_consensus.cc:3060] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.441277  6284 raft_consensus.cc:2468] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:57.443048  6102 leader_election.cc:304] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.419646  6445 leader_election.cc:290] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:57.427533  6449 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.447876  6449 raft_consensus.cc:697] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:57.407615  6209 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:57.449469  6449 consensus_queue.cc:237] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.449445  6405 leader_election.cc:290] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.452683  6405 raft_consensus.cc:493] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.453179  6405 raft_consensus.cc:515] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
W20260709 12:26:57.455024  6251 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.9.1:36341, user_credentials={real_user=slave}} blocked reactor thread for 44459.7us
I20260709 12:26:57.455330  6452 raft_consensus.cc:2804] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.457489  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.459466  6135 raft_consensus.cc:2468] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:57.459868  6419 tablet_bootstrap.cc:492] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.430047  6407 raft_consensus.cc:3060] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.460387  6419 ts_tablet_manager.cc:1403] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.051s
I20260709 12:26:57.460323  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.461140  6210 raft_consensus.cc:2468] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:57.462361  6100 leader_election.cc:304] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:57.463302  6419 raft_consensus.cc:359] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.464030  6419 raft_consensus.cc:385] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.464305  6419 raft_consensus.cc:740] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.464145  6454 raft_consensus.cc:493] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.464968  6419 consensus_queue.cc:260] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.466231  6450 raft_consensus.cc:2804] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.466769  6450 raft_consensus.cc:493] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.465544  6454 raft_consensus.cc:515] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.466958  6419 ts_tablet_manager.cc:1434] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:57.467218  6450 raft_consensus.cc:3060] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.468297  6419 tablet_bootstrap.cc:492] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: Bootstrap starting.
W20260709 12:26:57.471524  6082 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:57.450603  6211 raft_consensus.cc:2468] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:57.472636  6451 raft_consensus.cc:493] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.473232  6451 raft_consensus.cc:515] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.474252  6419 tablet_bootstrap.cc:654] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.474665  6454 leader_election.cc:290] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.474938  6405 leader_election.cc:290] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.475598  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.478173  6421 tablet_bootstrap.cc:492] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.478613  6421 ts_tablet_manager.cc:1403] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.144s	user 0.035s	sys 0.032s
I20260709 12:26:57.480794  6418 tablet_bootstrap.cc:492] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03: No bootstrap required, opened a new log
I20260709 12:26:57.480723  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.481401  6418 ts_tablet_manager.cc:1403] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03: Time spent bootstrapping tablet: real 0.124s	user 0.033s	sys 0.024s
I20260709 12:26:57.481524  6284 raft_consensus.cc:2468] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:57.482023  6421 raft_consensus.cc:359] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.482757  6421 raft_consensus.cc:385] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.483042  6421 raft_consensus.cc:740] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.484221  6285 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:57.484151  6418 raft_consensus.cc:359] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.485139  6418 raft_consensus.cc:385] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.485414  6418 raft_consensus.cc:740] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.486169  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.486049  6418 consensus_queue.cc:260] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.486810  6135 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:57.487696  6102 leader_election.cc:304] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.487906  6251 leader_election.cc:304] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.488137  6418 ts_tablet_manager.cc:1434] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:57.488633  6405 raft_consensus.cc:2804] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.488675  6445 raft_consensus.cc:2804] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.489257  6445 raft_consensus.cc:493] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.489203  6405 raft_consensus.cc:493] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.489679  6445 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.489838  6405 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.490144  6419 tablet_bootstrap.cc:492] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: No bootstrap required, opened a new log
I20260709 12:26:57.490672  6419 ts_tablet_manager.cc:1403] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.005s
I20260709 12:26:57.493310  6419 raft_consensus.cc:359] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.493947  6419 raft_consensus.cc:385] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.494225  6419 raft_consensus.cc:740] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.493996  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.494822  6454 raft_consensus.cc:493] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.495184  6419 consensus_queue.cc:260] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.495452  6454 raft_consensus.cc:515] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.495468  6421 consensus_queue.cc:260] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.497283  6419 ts_tablet_manager.cc:1434] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:57.497618  6454 leader_election.cc:290] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.486518  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.498266  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.494206  6451 leader_election.cc:290] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:57.499526  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.500324  6285 raft_consensus.cc:2393] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39e3ddb0597d49f28bf869098c62c595 in current term 1: Already voted for candidate 21d35f94d504429f9484bf24dc6028d4 in this term.
I20260709 12:26:57.502647  6421 ts_tablet_manager.cc:1434] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:26:57.503942  6421 tablet_bootstrap.cc:492] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.505620  6445 raft_consensus.cc:515] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.501924  6450 raft_consensus.cc:515] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.510159  6405 raft_consensus.cc:515] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.510771  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.510942  6450 leader_election.cc:290] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.511283  6421 tablet_bootstrap.cc:654] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.495442  6209 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 0.
I20260709 12:26:57.511389  6211 raft_consensus.cc:3060] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.502617  6102 leader_election.cc:304] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595; no voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03
I20260709 12:26:57.513628  6450 raft_consensus.cc:3060] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.516706  6429 raft_consensus.cc:493] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.516992  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.517235  6429 raft_consensus.cc:515] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.517621  6285 raft_consensus.cc:3060] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.516997  6452 raft_consensus.cc:697] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:57.519301  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.519901  6209 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.521088  6450 raft_consensus.cc:2749] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.522317  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.522749  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.523034  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:57.522716  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.524451  6284 raft_consensus.cc:2468] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 0.
W20260709 12:26:57.524515  6177 leader_election.cc:343] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.519258  6429 leader_election.cc:290] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.523800  6135 raft_consensus.cc:2393] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a07d9332cd9249b589722f82c519da03 in current term 1: Already voted for candidate 39e3ddb0597d49f28bf869098c62c595 in this term.
I20260709 12:26:57.525657  6177 leader_election.cc:304] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.526120  6283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.526614  6251 leader_election.cc:304] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.526916  6283 raft_consensus.cc:2393] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 39e3ddb0597d49f28bf869098c62c595 in current term 1: Already voted for candidate a07d9332cd9249b589722f82c519da03 in this term.
I20260709 12:26:57.526893  6429 raft_consensus.cc:2804] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.527501  6451 raft_consensus.cc:2749] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.527585  6429 raft_consensus.cc:493] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.528187  6429 raft_consensus.cc:3060] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.519922  6452 consensus_queue.cc:237] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.533829  6209 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:57.534667  6429 raft_consensus.cc:515] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.535032  6100 leader_election.cc:304] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: a07d9332cd9249b589722f82c519da03
I20260709 12:26:57.517640  6445 leader_election.cc:290] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:57.537585  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
W20260709 12:26:57.538941  6177 leader_election.cc:343] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.538882  6283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.539484  6453 raft_consensus.cc:2804] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.539713  6283 raft_consensus.cc:3060] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.540103  6453 raft_consensus.cc:697] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:57.544898  6211 raft_consensus.cc:2468] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:57.546746  6100 leader_election.cc:304] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:57.535591  6407 raft_consensus.cc:515] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.548591  6285 raft_consensus.cc:2468] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:57.550685  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:57.551357  6135 raft_consensus.cc:3060] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.541011  6453 consensus_queue.cc:237] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.550668  6283 raft_consensus.cc:2468] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:57.527776  6405 leader_election.cc:290] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.554114  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.547328  6429 leader_election.cc:290] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.549150  6454 raft_consensus.cc:2804] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.538229  6031 catalog_manager.cc:5697] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.557060  6454 raft_consensus.cc:697] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:57.557907  6454 consensus_queue.cc:237] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.549572  6407 leader_election.cc:290] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:57.556380  6177 leader_election.cc:304] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.559891  6429 raft_consensus.cc:2804] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.561331  6135 raft_consensus.cc:2468] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:57.562005  6429 raft_consensus.cc:697] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:57.562557  6251 leader_election.cc:304] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.562940  6429 consensus_queue.cc:237] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.563486  6407 raft_consensus.cc:2804] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.564178  6407 raft_consensus.cc:697] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:57.566148  6430 raft_consensus.cc:493] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.566686  6430 raft_consensus.cc:515] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.571255  6430 leader_election.cc:290] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.573343  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:26:57.575886  6136 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 0.
I20260709 12:26:57.566273  6034 catalog_manager.cc:5697] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.574662  6283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.577811  6283 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 0.
I20260709 12:26:57.579614  6177 leader_election.cc:304] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.580520  6333 raft_consensus.cc:2804] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.580892  6333 raft_consensus.cc:493] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.581207  6333 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.564965  6407 consensus_queue.cc:237] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.555866  6211 raft_consensus.cc:3060] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.598088  6421 tablet_bootstrap.cc:492] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.598636  6421 ts_tablet_manager.cc:1403] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.012s
I20260709 12:26:57.601538  6421 raft_consensus.cc:359] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.602149  6421 raft_consensus.cc:385] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.602430  6421 raft_consensus.cc:740] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.606437  6333 raft_consensus.cc:515] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.603161  6421 consensus_queue.cc:260] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.613659  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:57.614365  6135 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.615074  6421 ts_tablet_manager.cc:1434] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:26:57.616170  6421 tablet_bootstrap.cc:492] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595: Bootstrap starting.
I20260709 12:26:57.618391  6283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.619100  6283 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.621758  6421 tablet_bootstrap.cc:654] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.623203  6034 catalog_manager.cc:5697] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 0 to 1, leader changed from <none> to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.633674  6031 catalog_manager.cc:5697] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.635403  6031 catalog_manager.cc:5697] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.640901  6333 leader_election.cc:290] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.636088  6283 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:57.642904  6177 leader_election.cc:304] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:57.644109  6333 raft_consensus.cc:2804] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.644882  6333 raft_consensus.cc:697] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:57.645816  6333 consensus_queue.cc:237] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.648990  6135 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:26:57.660204  6421 tablet_bootstrap.cc:492] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595: No bootstrap required, opened a new log
I20260709 12:26:57.606011  6211 raft_consensus.cc:2468] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 1.
I20260709 12:26:57.660758  6421 ts_tablet_manager.cc:1403] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.019s
I20260709 12:26:57.663916  6421 raft_consensus.cc:359] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.664600  6421 raft_consensus.cc:385] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.664901  6421 raft_consensus.cc:740] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.665552  6421 consensus_queue.cc:260] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.667785  6421 ts_tablet_manager.cc:1434] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:57.667043  6034 catalog_manager.cc:5697] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.685874  6031 catalog_manager.cc:5697] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 1 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.698928  6429 consensus_queue.cc:1048] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.708262  6452 raft_consensus.cc:493] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.708822  6452 raft_consensus.cc:515] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.710572  6429 consensus_queue.cc:1048] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.711621  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:57.712396  6211 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:57.713516  6282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:57.714267  6282 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 0.
I20260709 12:26:57.715601  6100 leader_election.cc:304] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:57.716754  6454 raft_consensus.cc:2804] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.717151  6454 raft_consensus.cc:493] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.717481  6454 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.710817  6452 leader_election.cc:290] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.726553  6454 raft_consensus.cc:515] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.730006  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.730229  6454 leader_election.cc:290] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.731403  6211 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.731292  6283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.732108  6283 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.738740  6211 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:57.738744  6283 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:26:57.740183  6100 leader_election.cc:304] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:57.741163  6454 raft_consensus.cc:2804] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:57.741603  6454 raft_consensus.cc:697] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:57.742192  6454 consensus_queue.cc:237] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.749641  6031 catalog_manager.cc:5697] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.784336  6283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:35974
I20260709 12:26:57.784880  6283 raft_consensus.cc:606] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.790251  6283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:35974
I20260709 12:26:57.790730  6283 raft_consensus.cc:606] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.796092  6211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:38680
I20260709 12:26:57.796574  6211 raft_consensus.cc:606] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:26:57.801906  6135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
mode: GRACEFUL
new_leader_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:55472
I20260709 12:26:57.802459  6135 raft_consensus.cc:606] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Received request to transfer leadership to TS 21d35f94d504429f9484bf24dc6028d4
I20260709 12:26:57.810557  6135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
mode: GRACEFUL
new_leader_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:55472
I20260709 12:26:57.811021  6135 raft_consensus.cc:606] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Received request to transfer leadership to TS 21d35f94d504429f9484bf24dc6028d4
I20260709 12:26:57.815462  6135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
mode: GRACEFUL
new_leader_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:55472
I20260709 12:26:57.815961  6135 raft_consensus.cc:606] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Received request to transfer leadership to TS 21d35f94d504429f9484bf24dc6028d4
I20260709 12:26:57.821007  6211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
mode: GRACEFUL
new_leader_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:38680
I20260709 12:26:57.821692  6211 raft_consensus.cc:606] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Received request to transfer leadership to TS a07d9332cd9249b589722f82c519da03
I20260709 12:26:57.888919  6445 consensus_queue.cc:1048] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.900255  6451 consensus_queue.cc:1048] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.908785  6445 raft_consensus.cc:993] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: : Instructing follower 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:57.909226  6445 raft_consensus.cc:1081] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Signalling peer 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:57.910666  6135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:55454
I20260709 12:26:57.911082  6135 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:57.911419  6135 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.915678  6135 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.917200  6135 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:57.918244  6283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:57.918790  6283 raft_consensus.cc:3055] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:57.918994  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:57.919106  6283 raft_consensus.cc:740] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:57.919647  6211 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.920109  6283 consensus_queue.cc:260] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.921902  6283 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.927351  6211 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:57.928591  6100 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:57.929100  6283 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:57.929353  6454 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:57.929944  6454 raft_consensus.cc:697] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:57.930763  6454 consensus_queue.cc:237] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:57.931849  6452 consensus_queue.cc:1048] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.938884  6031 catalog_manager.cc:5697] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 1 to 2, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.945793  6454 consensus_queue.cc:1048] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.026414  6445 consensus_queue.cc:1048] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.038707  6407 raft_consensus.cc:993] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: : Instructing follower 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:58.039553  6451 raft_consensus.cc:1081] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Signalling peer 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:58.043897  6136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:55454
I20260709 12:26:58.044651  6136 raft_consensus.cc:493] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:58.044550  6454 consensus_queue.cc:1048] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.045221  6136 raft_consensus.cc:3060] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.049371  6453 consensus_queue.cc:1048] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.053701  6445 consensus_queue.cc:1048] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.055366  6453 consensus_queue.cc:1048] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.074534  6405 consensus_queue.cc:1048] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.089435  6136 raft_consensus.cc:515] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.093211  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:58.093900  6209 raft_consensus.cc:3060] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.100191  6136 leader_election.cc:290] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:58.101850  6282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:58.102470  6452 raft_consensus.cc:493] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.102610  6282 raft_consensus.cc:3055] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.103039  6282 raft_consensus.cc:740] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:58.103303  6452 raft_consensus.cc:515] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.104396  6282 consensus_queue.cc:260] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.105851  6282 raft_consensus.cc:3060] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.106772  6208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:26:58.107111  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e865bca75e14278a31e10460f861e2f" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:26:58.108454  6285 raft_consensus.cc:2393] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39e3ddb0597d49f28bf869098c62c595 in current term 1: Already voted for candidate 21d35f94d504429f9484bf24dc6028d4 in this term.
I20260709 12:26:58.113210  6100 leader_election.cc:304] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595; no voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03
I20260709 12:26:58.114466  6452 leader_election.cc:290] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:58.114537  6405 raft_consensus.cc:3060] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.114928  6453 raft_consensus.cc:993] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: : Instructing follower 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:58.116006  6453 raft_consensus.cc:1081] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Signalling peer 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:58.124225  6211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:38662
I20260709 12:26:58.125056  6211 raft_consensus.cc:493] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:58.125519  6211 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.107143  6209 raft_consensus.cc:2468] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:58.129930  6452 raft_consensus.cc:993] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: : Instructing follower 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:58.130421  6452 raft_consensus.cc:1081] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Signalling peer 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:58.131834  6429 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.134477  6405 raft_consensus.cc:2749] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.135254  6100 leader_election.cc:304] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:58.137871  6405 raft_consensus.cc:2804] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:58.139165  6430 consensus_queue.cc:1048] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.139520  6405 raft_consensus.cc:697] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:58.140242  6211 raft_consensus.cc:515] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.140725  6405 consensus_queue.cc:237] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.142638  6211 leader_election.cc:290] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:58.143821  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:58.144309  6285 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.137871  6209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:38662
I20260709 12:26:58.145875  6209 raft_consensus.cc:493] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:58.146212  6209 raft_consensus.cc:3060] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.147562  6282 raft_consensus.cc:2468] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:26:58.152823  6209 raft_consensus.cc:515] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.154548  6333 raft_consensus.cc:993] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: : Instructing follower 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:58.155126  6430 raft_consensus.cc:1081] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Signalling peer 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:26:58.157450  6209 leader_election.cc:290] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:58.160918  6285 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:58.161973  6283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:58.162267  6132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:55460
I20260709 12:26:58.163022  6132 raft_consensus.cc:493] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:58.163406  6132 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.163798  6131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55007ce213534b4fb5de84c6b8902bfd" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:58.164516  6131 raft_consensus.cc:3055] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.164809  6131 raft_consensus.cc:740] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:58.165728  6131 consensus_queue.cc:260] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.167120  6131 raft_consensus.cc:3060] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.168130  6283 raft_consensus.cc:3060] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.171372  6453 consensus_queue.cc:1048] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.176156  6131 raft_consensus.cc:2468] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:58.176709  6430 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.177562  6177 leader_election.cc:304] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:58.176394  6132 raft_consensus.cc:515] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.179112  6133 raft_consensus.cc:1240] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Rejecting Update request from peer 21d35f94d504429f9484bf24dc6028d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:58.180675  6430 raft_consensus.cc:2804] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:58.182509  6430 raft_consensus.cc:697] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:58.182789  6429 consensus_queue.cc:1048] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.183676  6430 consensus_queue.cc:237] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.188217  6177 leader_election.cc:304] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:26:58.189446  6333 raft_consensus.cc:2804] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:58.190011  6333 raft_consensus.cc:697] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:58.188685  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:58.190994  6136 raft_consensus.cc:3055] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.196213  6136 raft_consensus.cc:740] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:58.191002  6333 consensus_queue.cc:237] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.194713  6429 consensus_queue.cc:1059] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:58.197824  6132 leader_election.cc:290] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:58.199191  6136 consensus_queue.cc:260] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.200700  6136 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.202451  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:58.193866  6283 raft_consensus.cc:2468] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:58.208588  6031 catalog_manager.cc:5697] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 1 to 2, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:58.212200  6031 catalog_manager.cc:5697] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 1 to 2, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:58.209931  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:58.222013  6136 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:58.226701  6453 raft_consensus.cc:993] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: : Instructing follower 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:58.228044  6453 raft_consensus.cc:1081] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Signalling peer 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:26:58.231843  6210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:38662
I20260709 12:26:58.233079  6211 raft_consensus.cc:3055] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.233511  6211 raft_consensus.cc:740] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:58.234433  6211 consensus_queue.cc:260] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.235961  6211 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.236542  6405 consensus_queue.cc:1048] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.242643  6032 catalog_manager.cc:5697] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 1 to 2, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:58.247452  6211 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
W20260709 12:26:58.248036  6333 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:26:58.248756  6100 leader_election.cc:304] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: a07d9332cd9249b589722f82c519da03
I20260709 12:26:58.249600  6405 raft_consensus.cc:2804] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:58.250008  6405 raft_consensus.cc:697] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:58.250809  6405 consensus_queue.cc:237] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.255839  6210 raft_consensus.cc:493] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:58.256328  6210 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.263666  6210 raft_consensus.cc:515] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.268177  6210 leader_election.cc:290] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:26:58.268959  6031 catalog_manager.cc:5697] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 1 to 2, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:58.269454  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:58.269464  6285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:26:58.270196  6136 raft_consensus.cc:3055] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.270287  6285 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.270514  6136 raft_consensus.cc:740] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:26:58.271332  6136 consensus_queue.cc:260] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.272333  6136 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.276592  6285 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:58.278165  6177 leader_election.cc:304] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:58.278848  6136 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:26:58.278950  6333 raft_consensus.cc:2804] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:58.279600  6333 raft_consensus.cc:697] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:58.280601  6333 consensus_queue.cc:237] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.282244  6491 raft_consensus.cc:993] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: : Instructing follower a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:26:58.282884  6490 raft_consensus.cc:1081] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Signalling peer a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:26:58.284704  6285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:26:58.285175  6285 raft_consensus.cc:493] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:58.285501  6285 raft_consensus.cc:3060] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.288700  6031 catalog_manager.cc:5697] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 1 to 2, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 2 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:58.290721  6285 raft_consensus.cc:515] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.292378  6285 leader_election.cc:290] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:26:58.293052  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:26:58.293643  6136 raft_consensus.cc:3060] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.294700  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d511cc59ba840c5ab6b44db1889c689" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:26:58.295187  6210 raft_consensus.cc:3055] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.295424  6210 raft_consensus.cc:740] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:26:58.296229  6210 consensus_queue.cc:260] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.297551  6210 raft_consensus.cc:3060] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.300519  6136 raft_consensus.cc:2468] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 2.
I20260709 12:26:58.301654  6251 leader_election.cc:304] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:26:58.302405  6449 raft_consensus.cc:2804] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:58.302856  6449 raft_consensus.cc:697] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:26:58.303623  6210 raft_consensus.cc:2468] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 2.
I20260709 12:26:58.303884  6449 consensus_queue.cc:237] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:26:58.310945  6031 catalog_manager.cc:5697] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 1 to 2, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:58.327627  6285 raft_consensus.cc:1275] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.328730  6405 consensus_queue.cc:1048] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.339161  6210 raft_consensus.cc:1275] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.340690  6405 consensus_queue.cc:1048] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.597258  6285 raft_consensus.cc:1275] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.598451  6452 consensus_queue.cc:1048] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.605489  6136 raft_consensus.cc:1275] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.609373  6209 raft_consensus.cc:1275] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.610708  6490 consensus_queue.cc:1048] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:58.611147  6452 consensus_queue.cc:1048] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.621598  6285 raft_consensus.cc:1275] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.623392  6488 consensus_queue.cc:1048] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:58.685357  6285 raft_consensus.cc:1275] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.687927  6333 consensus_queue.cc:1048] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.695595  6135 raft_consensus.cc:1275] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.698053  6490 consensus_queue.cc:1048] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.698100  6136 raft_consensus.cc:1275] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.705663  6490 consensus_queue.cc:1048] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.715664  6285 raft_consensus.cc:1275] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.717530  6491 consensus_queue.cc:1048] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.765218  6209 raft_consensus.cc:1275] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.766470  6452 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.774771  6285 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.782156  6285 raft_consensus.cc:1275] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.783713  6454 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.847486  6209 raft_consensus.cc:1275] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.847488  6135 raft_consensus.cc:1275] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.848913  6449 consensus_queue.cc:1048] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.849543  6494 consensus_queue.cc:1048] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.825331  6034 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38378:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:00.842803  6034 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38378:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:00.895641 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:00.957324  6528 tablet.cc:1724] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:01.006377  6100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39923, user_credentials={real_user=slave}} blocked reactor thread for 70022us
W20260709 12:27:01.044993  6513 log.cc:927] Time spent T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:27:01.048139  6311 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:4d511cc59ba840c5ab6b44db1889c689)
W20260709 12:27:01.120617  6102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:43473, user_credentials={real_user=slave}} blocked reactor thread for 65096.7us
I20260709 12:27:01.181361  6548 tablet.cc:1724] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.186290  6543 tablet.cc:1724] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.234932  6557 tablet.cc:1724] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.233897  6553 tablet.cc:1724] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.247891  6547 tablet.cc:1724] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.270123  6528 tablet.cc:1724] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.241286  6559 tablet.cc:1724] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:01.278127  6237 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:4d511cc59ba840c5ab6b44db1889c689)
I20260709 12:27:01.281667  6543 tablet.cc:1724] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:01.322249  6311 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:4d511cc59ba840c5ab6b44db1889c689)
I20260709 12:27:01.321907  6548 tablet.cc:1724] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.331943  6211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
mode: GRACEFUL
new_leader_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:01.332713  6211 raft_consensus.cc:606] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Received request to transfer leadership to TS a07d9332cd9249b589722f82c519da03
I20260709 12:27:01.333231  6564 tablet.cc:1724] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.335342  6563 tablet.cc:1724] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.315316  6553 tablet.cc:1724] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.357445  6543 tablet.cc:1724] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.360710  6557 tablet.cc:1724] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.380828  6559 tablet.cc:1724] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.371737  6528 tablet.cc:1724] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.414203  6554 raft_consensus.cc:993] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: : Instructing follower a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:01.414826  6554 raft_consensus.cc:1081] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Signalling peer a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:01.417311  6282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:01.417961  6282 raft_consensus.cc:493] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:01.418363  6282 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.433269  6547 tablet.cc:1724] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.444388  6569 tablet.cc:1724] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.454730  6282 raft_consensus.cc:515] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:01.456035  6281 raft_consensus.cc:1240] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Rejecting Update request from peer 21d35f94d504429f9484bf24dc6028d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.465936  6530 consensus_queue.cc:1059] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:01.467017  6530 raft_consensus.cc:3055] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:01.467350  6530 raft_consensus.cc:740] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:01.467603  6528 tablet.cc:1724] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.466239  6569 tablet.cc:1724] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.468230  6530 consensus_queue.cc:260] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:01.470238  6530 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.459534  6570 tablet.cc:1724] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.463503  6557 tablet.cc:1724] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.477087  6553 tablet.cc:1724] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.481812  6282 leader_election.cc:290] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:01.482525  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:01.483122  6136 raft_consensus.cc:3060] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.475143  6563 tablet.cc:1724] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.469944  6568 tablet.cc:1724] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:01.487567  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c4628176c63472cb5232cbda1bf5a6c" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:01.492328  6131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
mode: GRACEFUL
new_leader_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:55484
I20260709 12:27:01.492951  6131 raft_consensus.cc:606] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Received request to transfer leadership to TS a07d9332cd9249b589722f82c519da03
I20260709 12:27:01.494339 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:27:01.494959 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:01.503530  6210 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:01.504541  6136 raft_consensus.cc:2468] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:01.507006  6251 leader_election.cc:304] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:01.508009  6527 raft_consensus.cc:2804] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:01.509328  6131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
mode: GRACEFUL
new_leader_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:55484
I20260709 12:27:01.509977  6131 raft_consensus.cc:606] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Received request to transfer leadership to TS a07d9332cd9249b589722f82c519da03
I20260709 12:27:01.523065  6527 raft_consensus.cc:697] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:01.524534  6527 consensus_queue.cc:237] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.065303  6210 raft_consensus.cc:1275] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:02.070570  6527 consensus_queue.cc:1048] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:02.267159  6577 tablet.cc:1724] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:02.304535  6177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:43473, user_credentials={real_user=slave}} blocked reactor thread for 59504.5us
I20260709 12:27:02.323783  6135 raft_consensus.cc:1275] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:02.325984  6571 consensus_queue.cc:1048] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:02.565392  6032 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.020s	sys 0.000s
W20260709 12:27:02.567155  6032 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.020s	sys 0.000s
I20260709 12:27:02.576186  6584 raft_consensus.cc:493] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21d35f94d504429f9484bf24dc6028d4)
I20260709 12:27:02.579383  6584 raft_consensus.cc:515] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.584059  6584 leader_election.cc:290] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.816129  6579 raft_consensus.cc:493] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.816929  6579 raft_consensus.cc:515] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.819142  6582 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.819655  6582 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.821632  6582 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:02.822593  6579 leader_election.cc:290] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:02.828703  6586 raft_consensus.cc:493] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21d35f94d504429f9484bf24dc6028d4)
I20260709 12:27:02.829335  6586 raft_consensus.cc:515] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.832008  6586 leader_election.cc:290] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
W20260709 12:27:02.861846  6249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.021s	sys 0.000s
W20260709 12:27:02.862277  6249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.021s	sys 0.000s
W20260709 12:27:02.862581  6249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.2:39923, user_credentials={real_user=slave}} blocked reactor thread for 536941us
I20260709 12:27:02.864181  6584 raft_consensus.cc:493] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.864730  6584 raft_consensus.cc:515] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.866756  6584 leader_election.cc:290] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.867089  6584 raft_consensus.cc:493] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.867398  6584 raft_consensus.cc:515] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:27:02.869005  6584 leader_election.cc:290] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.869413  6584 raft_consensus.cc:493] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.869793  6584 raft_consensus.cc:515] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.871604  6584 leader_election.cc:290] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.875949  6582 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.876511  6582 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.878168  6582 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:02.879567  6210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
mode: GRACEFUL
new_leader_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:02.880286  6210 raft_consensus.cc:606] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Received request to transfer leadership to TS a07d9332cd9249b589722f82c519da03
I20260709 12:27:02.881951 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:02.882593 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:02.887869  6207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:02.612505  6032 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97: soft_deleted_table [id=3e98f16e900247eaa888005d53c4a0c0] alter complete (version 1)
I20260709 12:27:02.962263  6034 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56402 (request call id 103) took 1460 ms. Trace:
I20260709 12:27:02.962383  6032 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56396 (request call id 98) took 1459 ms. Trace:
I20260709 12:27:02.962826  6034 rpcz_store.cc:276] 0709 12:27:01.502402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.509266 (+  6864us) service_pool.cc:224] Handling call
0709 12:27:02.962172 (+1452906us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115,"reported_tablets":1}
I20260709 12:27:02.962888  6032 rpcz_store.cc:276] 0709 12:27:01.502944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.503155 (+   211us) service_pool.cc:224] Handling call
0709 12:27:02.567566 (+1064411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:02.567594 (+    28us) write_op.cc:454] Released schema lock
0709 12:27:02.962326 (+394732us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:01.529892 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:01.530455 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:01.530498 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:27:01.530515 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:01.530828 (+   313us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:01.530905 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:01.530930 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:01.531118 (+   188us) tablet.cc:701] Row locks acquired
0709 12:27:01.531135 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:27:01.531256 (+   121us) write_op.cc:270] Start()
0709 12:27:01.531366 (+   110us) write_op.cc:276] Timestamp: P: 1783600021531214 usec, L: 0
0709 12:27:01.531387 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:27:01.538339 (+  6952us) log.cc:844] Serialized 405 byte log entry
0709 12:27:01.851827 (+313488us) op_driver.cc:464] REPLICATION: finished
0709 12:27:01.863955 (+ 12128us) write_op.cc:301] APPLY: starting
0709 12:27:01.864051 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:01.864146 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:01.864258 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:01.864482 (+   224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:01.864649 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:01.864695 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:01.864862 (+   167us) log.cc:844] Serialized 22 byte log entry
0709 12:27:01.865025 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:01.865116 (+    91us) write_op.cc:454] Released schema lock
0709 12:27:01.865161 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":349037,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":11292,"apply.run_cpu_time_us":1527,"apply.run_wall_time_us":1528,"num_ops":1,"prepare.queue_time_us":20825,"prepare.run_cpu_time_us":2567,"prepare.run_wall_time_us":8779,"replication_time_us":316961,"spinlock_wait_cycles":127104,"thread_start_us":1068638,"threads_started":2}]]}
I20260709 12:27:02.971608  6575 raft_consensus.cc:493] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.971956  6588 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.972148  6575 raft_consensus.cc:515] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.972556  6588 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.974296  6575 leader_election.cc:290] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.974826  6588 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.981179  6589 raft_consensus.cc:493] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21d35f94d504429f9484bf24dc6028d4)
I20260709 12:27:02.981267  6527 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.981825  6589 raft_consensus.cc:515] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.981962  6527 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.983057  6031 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56406 (request call id 92) took 1463 ms. Trace:
I20260709 12:27:02.983438  6031 rpcz_store.cc:276] 0709 12:27:01.519604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.519816 (+   212us) service_pool.cc:224] Handling call
0709 12:27:02.982994 (+1463178us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:27:02.984875  6527 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.985754  6588 raft_consensus.cc:493] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.986377  6588 raft_consensus.cc:515] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.986850  6589 leader_election.cc:290] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.987452  6589 raft_consensus.cc:493] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.988006  6589 raft_consensus.cc:515] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.989440  6588 leader_election.cc:290] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:02.991008  6131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:02.991622  6131 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 2.
I20260709 12:27:02.991686  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:02.993216  6131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:02.992467  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:02.996270  6545 raft_consensus.cc:493] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:02.996747  6545 raft_consensus.cc:515] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:02.998049  6251 leader_election.cc:304] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:02.998677  6545 leader_election.cc:290] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:02.998833  6588 raft_consensus.cc:2804] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.000121  6588 raft_consensus.cc:493] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21d35f94d504429f9484bf24dc6028d4)
I20260709 12:27:03.001636  6588 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.004446  6133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.005007  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:03.005649  6278 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:27:03.008121  6132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.011322  6588 raft_consensus.cc:515] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.011957  6279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:03.012956  6279 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:27:03.015976  6586 raft_consensus.cc:993] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: : Instructing follower a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:03.016083  6282 raft_consensus.cc:1240] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Rejecting Update request from peer 21d35f94d504429f9484bf24dc6028d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.016630  6281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:03.017038  6588 leader_election.cc:290] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:03.019053  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:03.019657  6284 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 1.
I20260709 12:27:03.021744  6136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.022511  6133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.022626  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:03.023247  6129 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.023888  6131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.024186  6134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598421c7f9a4ecc96b7edc75ece5861" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.025894  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.026067  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.023185  6130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.029012  6210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.029868  6586 raft_consensus.cc:1081] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Signalling peer a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:03.030545  6129 raft_consensus.cc:2468] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:03.032234  6206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.032961  6251 leader_election.cc:304] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:03.034377  6527 raft_consensus.cc:2804] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.034847  6527 raft_consensus.cc:697] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:03.035780  6206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8cda126fbf641e7aec5e1af3faf6bed" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.035740  6527 consensus_queue.cc:237] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.037420  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.029569  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.040805  6209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6598421c7f9a4ecc96b7edc75ece5861" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.042135  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.040134  6031 catalog_manager.cc:5697] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 2 to 3, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.043264  6206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.041654  6589 leader_election.cc:290] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:03.043505  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.046411  6206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff7c2533db74ba69cb3799babb85d2f" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:03.045560  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ad41becb2240f68d83a0c087cccf2d" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:03.054054  6129 raft_consensus.cc:1240] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Rejecting Update request from peer 21d35f94d504429f9484bf24dc6028d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.054883  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:03.055043  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822bdf7349cd4f258b3c06951a801696" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:03.058223  6249 leader_election.cc:304] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.058333  6102 leader_election.cc:304] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595; no voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03
I20260709 12:27:03.059319  6539 raft_consensus.cc:2749] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.059433  6249 leader_election.cc:304] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.061126  6571 raft_consensus.cc:2749] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.061265  6177 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.061823  6571 raft_consensus.cc:2749] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.062119  6579 raft_consensus.cc:2804] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:03.062554  6579 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:03.062938  6579 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.063818  6278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:35944
I20260709 12:27:03.064391  6278 raft_consensus.cc:493] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.064738  6278 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.065415  6249 leader_election.cc:304] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.066190  6575 raft_consensus.cc:2749] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.067353  6249 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.068529  6249 leader_election.cc:304] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.069239  6575 raft_consensus.cc:2749] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.069857  6575 raft_consensus.cc:2749] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.071107  6249 leader_election.cc:304] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.072322  6249 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.073042  6588 raft_consensus.cc:2749] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.073705  6588 raft_consensus.cc:2749] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.075033  6249 leader_election.cc:304] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.076785  6249 leader_election.cc:304] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a07d9332cd9249b589722f82c519da03; no voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.077744  6589 raft_consensus.cc:2749] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.080436  6579 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.082311  6579 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:03.083906  6278 raft_consensus.cc:515] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.084781  6554 raft_consensus.cc:993] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4: : Instructing follower a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:03.085086  6527 raft_consensus.cc:2749] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.085258  6554 raft_consensus.cc:1081] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Signalling peer a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:03.089694  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:03.090250  6135 raft_consensus.cc:3055] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.090531  6135 raft_consensus.cc:740] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:03.091241  6135 consensus_queue.cc:260] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.091661  6177 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.092388  6135 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.092453  6579 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.091686  6278 leader_election.cc:290] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:03.092934  6579 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:03.093437  6579 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.093724  6031 catalog_manager.cc:5697] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 2 to 3, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.094921  6574 consensus_queue.cc:1059] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:03.096014  6554 raft_consensus.cc:3055] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.096328  6554 raft_consensus.cc:740] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:03.097144  6554 consensus_queue.cc:260] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.098796  6554 raft_consensus.cc:3060] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.099843  6135 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:03.104554  6251 leader_election.cc:304] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:03.106235  6579 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.108182  6579 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:03.109427  6527 raft_consensus.cc:2804] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.109925  6527 raft_consensus.cc:697] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:03.110764  6527 consensus_queue.cc:237] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.115554  6177 leader_election.cc:304] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:03.116416  6554 raft_consensus.cc:2804] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:03.116833  6554 raft_consensus.cc:493] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:03.117237  6554 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.117825  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:03.118530  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:03.121519  6278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:03.122107  6278 raft_consensus.cc:493] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:03.122509  6278 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.124374  6554 raft_consensus.cc:515] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.126677  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:03.128784  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:03.129132  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:03.129670  6211 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.130095  6278 raft_consensus.cc:515] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.129878  6031 catalog_manager.cc:5697] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 2 to 3, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.132174  6278 leader_election.cc:290] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:03.132792  6135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:03.133002  6554 leader_election.cc:290] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:03.133358  6135 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.136638  6177 leader_election.cc:304] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4; no voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03
I20260709 12:27:03.139151  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:03.139319  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:03.140460  6135 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:03.140569  6554 raft_consensus.cc:2749] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.141546  6177 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4; no voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03
I20260709 12:27:03.141659  6251 leader_election.cc:304] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:03.142375  6554 raft_consensus.cc:2749] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.142566  6527 raft_consensus.cc:2804] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.135876  6211 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:03.143085  6527 raft_consensus.cc:697] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:03.143149  6177 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4; no voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03
I20260709 12:27:03.144338  6554 raft_consensus.cc:2749] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.144032  6527 consensus_queue.cc:237] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.145494  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fafa1d27b9d462d9eb54af14d49a46a" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:03.146095  6211 raft_consensus.cc:3055] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.146286  6177 leader_election.cc:304] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4; no voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03
I20260709 12:27:03.146435  6211 raft_consensus.cc:740] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:03.147467  6554 raft_consensus.cc:2749] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:03.147495  6211 consensus_queue.cc:260] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.150490  6211 raft_consensus.cc:3060] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.153656  6031 catalog_manager.cc:5697] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 2 to 3, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.156817  6211 raft_consensus.cc:2468] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:03.181888  6211 raft_consensus.cc:1240] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Rejecting Update request from peer 39e3ddb0597d49f28bf869098c62c595 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.182991  6539 consensus_queue.cc:1059] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.184055  6590 raft_consensus.cc:3055] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.184365  6590 raft_consensus.cc:740] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:03.185094  6590 consensus_queue.cc:260] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.186102  6590 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.406143  6211 raft_consensus.cc:1240] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Rejecting Update request from peer 39e3ddb0597d49f28bf869098c62c595 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.407228  6539 consensus_queue.cc:1059] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:03.408064  6590 raft_consensus.cc:3055] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.408354  6590 raft_consensus.cc:740] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:03.409075  6590 consensus_queue.cc:260] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.410138  6590 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.424978  6211 raft_consensus.cc:1240] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Rejecting Update request from peer 39e3ddb0597d49f28bf869098c62c595 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.426079  6590 consensus_queue.cc:1059] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:03.426908  6539 raft_consensus.cc:3055] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.427240  6539 raft_consensus.cc:740] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:03.428066  6539 consensus_queue.cc:260] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:03.428987  6539 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:03.582041  6157 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7d60 after lost signal to thread 29735
W20260709 12:27:03.583011  6157 debug-util.cc:398] Leaking SignalData structure 0x7b0800142380 after lost signal to thread 6068
W20260709 12:27:03.584043  6157 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0c80 after lost signal to thread 6160
W20260709 12:27:03.584937  6157 debug-util.cc:398] Leaking SignalData structure 0x7b0800205660 after lost signal to thread 6235
W20260709 12:27:03.585955  6157 debug-util.cc:398] Leaking SignalData structure 0x7b08002793a0 after lost signal to thread 6309
I20260709 12:27:03.612022  6211 raft_consensus.cc:1275] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:03.613179  6527 consensus_queue.cc:1048] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:03.637840  6135 raft_consensus.cc:1275] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:03.639412  6588 consensus_queue.cc:1048] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:03.646083  6211 raft_consensus.cc:1275] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:03.647749  6588 consensus_queue.cc:1048] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:03.662495  6135 raft_consensus.cc:1275] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:03.667217  6589 consensus_queue.cc:1048] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:03.689453  6211 raft_consensus.cc:1275] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:03.690650  6589 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:03.699536  6129 raft_consensus.cc:1275] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:03.701323  6527 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:03.883632 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:03.888794 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:03.889189 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:03.896862  6129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
mode: GRACEFUL
new_leader_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:55484
I20260709 12:27:03.897475  6129 raft_consensus.cc:606] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Received request to transfer leadership to TS 21d35f94d504429f9484bf24dc6028d4
I20260709 12:27:03.898726 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:27:03.899155 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:04.297487  6608 raft_consensus.cc:993] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595: : Instructing follower 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:27:04.297953  6539 raft_consensus.cc:1081] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Signalling peer 21d35f94d504429f9484bf24dc6028d4 to start an election
I20260709 12:27:04.299540  6211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
 from {username='slave'} at 127.0.0.1:38662
I20260709 12:27:04.300053  6211 raft_consensus.cc:493] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:04.300328  6211 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.304664  6211 raft_consensus.cc:515] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:27:04.306191  6211 leader_election.cc:290] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 election: Requested vote from peers a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473), 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341)
I20260709 12:27:04.307675  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:04.308043  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:04.308945  6129 raft_consensus.cc:3055] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:04.309058  6278 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.309379  6129 raft_consensus.cc:740] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:04.310262  6129 consensus_queue.cc:260] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:27:04.311538  6129 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.314658  6278 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 3.
I20260709 12:27:04.315689  6177 leader_election.cc:304] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:04.316335  6554 raft_consensus.cc:2804] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.317323  6554 raft_consensus.cc:697] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:04.318483  6554 consensus_queue.cc:237] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:27:04.318589  6129 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 3.
I20260709 12:27:04.326956  6031 catalog_manager.cc:5697] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 2 to 3, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.750347  6539 raft_consensus.cc:493] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.750890  6539 raft_consensus.cc:515] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.752996  6539 leader_election.cc:290] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:04.753031  6588 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:04.754001  6588 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.754371  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:04.753685  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:04.755194  6278 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 1.
I20260709 12:27:04.755326  6211 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 2.
I20260709 12:27:04.755882  6588 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:04.756520  6102 leader_election.cc:304] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:04.757387  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:04.757480  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:04.758249  6129 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:04.757642  6539 raft_consensus.cc:2804] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.758946  6539 raft_consensus.cc:493] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.759305  6539 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.758407  6211 raft_consensus.cc:2393] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07d9332cd9249b589722f82c519da03 in current term 3: Already voted for candidate 21d35f94d504429f9484bf24dc6028d4 in this term.
I20260709 12:27:04.759578  6251 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:04.760548  6588 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.760936  6588 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:04.761277  6588 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.766233  6539 raft_consensus.cc:515] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.768041  6588 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.792342  6606 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:04.783458  6284 raft_consensus.cc:1275] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.772393  6588 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:04.770757  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:04.773311  6206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:04.796844  6206 raft_consensus.cc:2393] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a07d9332cd9249b589722f82c519da03 in current term 3: Already voted for candidate 21d35f94d504429f9484bf24dc6028d4 in this term.
I20260709 12:27:04.795243  6606 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.799360  6554 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.800396  6606 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:04.769065  6539 leader_election.cc:290] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 3 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:04.769214  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:04.801219  6278 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.802119  6130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:04.768898  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5209be04f74c64bbc4bdd79054fc58" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:04.802944  6130 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 2.
I20260709 12:27:04.803313  6211 raft_consensus.cc:3060] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.798449  6135 raft_consensus.cc:1275] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.804401  6251 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:04.806447  6129 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:04.806833  6606 raft_consensus.cc:2804] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:04.807258  6606 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39e3ddb0597d49f28bf869098c62c595)
I20260709 12:27:04.807610  6606 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.807698  6251 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:04.810505  6588 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.810995  6588 raft_consensus.cc:697] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:04.812682  6588 consensus_queue.cc:237] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.816962  6278 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 3.
I20260709 12:27:04.813544  6211 raft_consensus.cc:2468] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 3.
I20260709 12:27:04.818897  6100 leader_election.cc:304] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:27:04.819877  6539 raft_consensus.cc:2804] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:04.821859  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4" is_pre_election: true
I20260709 12:27:04.822611  6211 raft_consensus.cc:2393] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a07d9332cd9249b589722f82c519da03 in current term 2: Already voted for candidate 21d35f94d504429f9484bf24dc6028d4 in this term.
I20260709 12:27:04.823024  6606 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.824208  6539 raft_consensus.cc:697] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 3 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:04.825527  6554 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.825201  6539 consensus_queue.cc:237] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.829985  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:04.844587  6031 catalog_manager.cc:5697] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.851666  6129 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 2.
I20260709 12:27:04.853040  6251 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:04.853916  6588 raft_consensus.cc:2804] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:04.854614  6588 raft_consensus.cc:697] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:04.853873  6034 catalog_manager.cc:5697] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 2 to 3, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.855512  6588 consensus_queue.cc:237] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:04.860359  6606 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 2 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:04.862874  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:04.863750  6211 raft_consensus.cc:2393] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a07d9332cd9249b589722f82c519da03 in current term 2: Already voted for candidate 21d35f94d504429f9484bf24dc6028d4 in this term.
I20260709 12:27:04.898926  6032 catalog_manager.cc:5697] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 1 to 2, leader changed from 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.900183 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:04.936785  6278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:58102
I20260709 12:27:04.937347  6278 raft_consensus.cc:606] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:04.938527 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:27:04.939116 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:04.948345  6278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:58102
I20260709 12:27:04.948887  6278 raft_consensus.cc:606] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:04.950001 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:27:04.950439 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:05.011132  6609 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.011677  6609 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.013700  6609 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:05.015306  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:05.015542  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:05.016228  6129 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 2.
I20260709 12:27:05.017179  6177 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: a07d9332cd9249b589722f82c519da03
I20260709 12:27:05.018106  6609 raft_consensus.cc:2804] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:05.018374  6609 raft_consensus.cc:493] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.018635  6609 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.023563  6609 raft_consensus.cc:515] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.025082  6609 leader_election.cc:290] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:05.025887  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:05.026062  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303b6baaedf745aebea0c25ce41602b6" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:05.026597  6129 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.031474  6129 raft_consensus.cc:2468] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 3.
I20260709 12:27:05.032339  6177 leader_election.cc:304] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: a07d9332cd9249b589722f82c519da03
I20260709 12:27:05.033039  6609 raft_consensus.cc:2804] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:05.033404  6609 raft_consensus.cc:697] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 3 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:05.034144  6609 consensus_queue.cc:237] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.042765  6032 catalog_manager.cc:5697] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 2 to 3, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 3 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.111219  6606 raft_consensus.cc:993] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: : Instructing follower 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:27:05.111708  6588 raft_consensus.cc:1081] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Signalling peer 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:27:05.113191  6129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:55454
I20260709 12:27:05.113636  6129 raft_consensus.cc:493] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:05.113937  6129 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.118836  6129 raft_consensus.cc:515] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.120477  6129 leader_election.cc:290] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 4 election: Requested vote from peers 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:05.121102  6211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:05.121482  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43bf9ca8a07e4e59872a5c6980610544" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:05.121676  6211 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.121946  6284 raft_consensus.cc:3055] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:05.122388  6284 raft_consensus.cc:740] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:05.123142  6284 consensus_queue.cc:260] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.124236  6284 raft_consensus.cc:3060] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.128429  6211 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 4.
I20260709 12:27:05.129460  6100 leader_election.cc:304] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:27:05.130211  6539 raft_consensus.cc:2804] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:05.130681  6539 raft_consensus.cc:697] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 4 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:05.131462  6539 consensus_queue.cc:237] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.132470  6284 raft_consensus.cc:2468] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 4.
I20260709 12:27:05.139462  6032 catalog_manager.cc:5697] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 3 to 4, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 4 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.166030  6609 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.166594  6609 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.168606  6609 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:05.169888  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595" is_pre_election: true
I20260709 12:27:05.170593  6129 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 3.
I20260709 12:27:05.171561  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03" is_pre_election: true
I20260709 12:27:05.171958  6177 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: 
I20260709 12:27:05.172791  6609 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.173156  6609 raft_consensus.cc:493] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.173472  6609 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.178694  6609 raft_consensus.cc:515] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.180325  6609 leader_election.cc:290] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 4 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473)
I20260709 12:27:05.181049  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:05.181249  6284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c366c05985c4c3f9f32b98da4714a16" candidate_uuid: "21d35f94d504429f9484bf24dc6028d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:05.181706  6129 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.188993  6129 raft_consensus.cc:2468] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21d35f94d504429f9484bf24dc6028d4 in term 4.
I20260709 12:27:05.190157  6177 leader_election.cc:304] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21d35f94d504429f9484bf24dc6028d4, 39e3ddb0597d49f28bf869098c62c595; no voters: a07d9332cd9249b589722f82c519da03
I20260709 12:27:05.190785  6609 raft_consensus.cc:2804] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:05.191216  6609 raft_consensus.cc:697] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 4 LEADER]: Becoming Leader. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:05.192026  6609 consensus_queue.cc:237] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.199926  6032 catalog_manager.cc:5697] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 reported cstate change: term changed from 3 to 4, leader changed from a07d9332cd9249b589722f82c519da03 (127.29.9.3) to 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2). New cstate: current_term: 4 leader_uuid: "21d35f94d504429f9484bf24dc6028d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.227960  6129 raft_consensus.cc:1240] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Rejecting Update request from peer a07d9332cd9249b589722f82c519da03 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:05.229384  6588 consensus_queue.cc:1059] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:05.230132  6606 raft_consensus.cc:3055] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:05.230510  6606 raft_consensus.cc:740] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:05.231320  6606 consensus_queue.cc:260] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.232579  6606 raft_consensus.cc:3060] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.257347  6211 raft_consensus.cc:1275] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:05.258498  6619 consensus_queue.cc:1048] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.267660  6284 raft_consensus.cc:1275] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:05.271059  6619 consensus_queue.cc:1048] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.323853  6129 raft_consensus.cc:1240] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Rejecting Update request from peer a07d9332cd9249b589722f82c519da03 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:05.325176  6606 consensus_queue.cc:1059] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.325824  6588 raft_consensus.cc:3055] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:05.326115  6588 raft_consensus.cc:740] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:05.326783  6588 consensus_queue.cc:260] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:05.327705  6588 raft_consensus.cc:3060] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.535951  6129 raft_consensus.cc:1275] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:05.537124  6609 consensus_queue.cc:1048] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.546025  6278 raft_consensus.cc:1275] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:05.546394  6278 pending_rounds.cc:85] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: Aborting all ops after (but not including) 1
I20260709 12:27:05.546617  6278 pending_rounds.cc:107] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:05.546878  6278 raft_consensus.cc:2889] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:05.549007  6609 consensus_queue.cc:1048] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.614457  6206 raft_consensus.cc:1275] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:05.615823  6539 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:05.624974  6278 raft_consensus.cc:1275] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:05.626421  6619 consensus_queue.cc:1048] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:05.736860  6278 raft_consensus.cc:1275] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:27:05.737192  6278 pending_rounds.cc:85] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: Aborting all ops after (but not including) 3
I20260709 12:27:05.737396  6278 pending_rounds.cc:107] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:27:05.737659  6278 raft_consensus.cc:2889] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:05.738983  6639 consensus_queue.cc:1048] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:05.747323  6129 raft_consensus.cc:1275] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Refusing update from remote peer 21d35f94d504429f9484bf24dc6028d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:05.748721  6609 consensus_queue.cc:1048] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:05.951481 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:05.959671  6206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
mode: GRACEFUL
new_leader_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:05.960232  6206 raft_consensus.cc:606] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Received request to transfer leadership to TS a07d9332cd9249b589722f82c519da03
I20260709 12:27:05.961344 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:27:05.961741 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:05.968246  6206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a"
dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
mode: GRACEFUL
new_leader_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:38684
I20260709 12:27:05.968725  6206 raft_consensus.cc:606] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 LEADER]: Received request to transfer leadership to TS 39e3ddb0597d49f28bf869098c62c595
I20260709 12:27:05.969730 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:27:05.970134 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:06.299563  6554 raft_consensus.cc:993] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4: : Instructing follower 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:27:06.300233  6609 raft_consensus.cc:1081] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 LEADER]: Signalling peer 39e3ddb0597d49f28bf869098c62c595 to start an election
I20260709 12:27:06.301991  6129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a"
dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
 from {username='slave'} at 127.0.0.1:55460
I20260709 12:27:06.302625  6129 raft_consensus.cc:493] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.302976  6129 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.309772  6129 raft_consensus.cc:515] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:27:06.311910  6129 leader_election.cc:290] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 4 election: Requested vote from peers a07d9332cd9249b589722f82c519da03 (127.29.9.3:43473), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:06.312170  6278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a07d9332cd9249b589722f82c519da03"
I20260709 12:27:06.312510  6206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db3860758a24ac1bda104782d6e511a" candidate_uuid: "39e3ddb0597d49f28bf869098c62c595" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:06.312907  6278 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.313134  6206 raft_consensus.cc:3055] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:06.313555  6206 raft_consensus.cc:740] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:06.314834  6206 consensus_queue.cc:260] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:27:06.316134  6206 raft_consensus.cc:3060] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.321512  6278 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 4.
I20260709 12:27:06.322871  6102 leader_election.cc:304] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:06.323441  6539 raft_consensus.cc:2804] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:06.323863  6539 raft_consensus.cc:697] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 4 LEADER]: Becoming Leader. State: Replica: 39e3ddb0597d49f28bf869098c62c595, State: Running, Role: LEADER
I20260709 12:27:06.324622  6539 consensus_queue.cc:237] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } }
I20260709 12:27:06.326920  6206 raft_consensus.cc:2468] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e3ddb0597d49f28bf869098c62c595 in term 4.
I20260709 12:27:06.333038  6034 catalog_manager.cc:5697] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 reported cstate change: term changed from 3 to 4, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1). New cstate: current_term: 4 leader_uuid: "39e3ddb0597d49f28bf869098c62c595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:06.484752  6639 raft_consensus.cc:993] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: : Instructing follower a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:06.485271  6609 raft_consensus.cc:1081] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Signalling peer a07d9332cd9249b589722f82c519da03 to start an election
I20260709 12:27:06.486750  6278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841"
dest_uuid: "a07d9332cd9249b589722f82c519da03"
 from {username='slave'} at 127.0.0.1:35958
I20260709 12:27:06.487288  6278 raft_consensus.cc:493] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.487603  6278 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.492324  6278 raft_consensus.cc:515] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:06.493798  6278 leader_election.cc:290] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Requested vote from peers 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341), 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923)
I20260709 12:27:06.494727  6129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "39e3ddb0597d49f28bf869098c62c595"
I20260709 12:27:06.495002  6206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92297cd05e7b4b4b8d8b4514fb502841" candidate_uuid: "a07d9332cd9249b589722f82c519da03" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "21d35f94d504429f9484bf24dc6028d4"
I20260709 12:27:06.495371  6129 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.495553  6206 raft_consensus.cc:3055] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:06.495951  6206 raft_consensus.cc:740] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21d35f94d504429f9484bf24dc6028d4, State: Running, Role: LEADER
I20260709 12:27:06.496673  6206 consensus_queue.cc:260] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:06.497661  6206 raft_consensus.cc:3060] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.501931  6129 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:06.502321  6206 raft_consensus.cc:2468] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a07d9332cd9249b589722f82c519da03 in term 3.
I20260709 12:27:06.503350  6251 leader_election.cc:304] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e3ddb0597d49f28bf869098c62c595, a07d9332cd9249b589722f82c519da03; no voters: 
I20260709 12:27:06.504221  6606 raft_consensus.cc:2804] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:06.506143  6606 raft_consensus.cc:697] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Becoming Leader. State: Replica: a07d9332cd9249b589722f82c519da03, State: Running, Role: LEADER
I20260709 12:27:06.506985  6606 consensus_queue.cc:237] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } }
I20260709 12:27:06.514525  6034 catalog_manager.cc:5697] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 reported cstate change: term changed from 2 to 3, leader changed from 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2) to a07d9332cd9249b589722f82c519da03 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "a07d9332cd9249b589722f82c519da03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.718003  6278 raft_consensus.cc:1275] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:06.720646  6539 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a07d9332cd9249b589722f82c519da03" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:06.731292  6206 raft_consensus.cc:1275] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Refusing update from remote peer 39e3ddb0597d49f28bf869098c62c595: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:06.737818  6539 consensus_queue.cc:1048] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:06.940623  6129 raft_consensus.cc:1275] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:06.941794  6606 consensus_queue.cc:1048] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e3ddb0597d49f28bf869098c62c595" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:06.953095  6206 raft_consensus.cc:1275] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Refusing update from remote peer a07d9332cd9249b589722f82c519da03: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:06.954819  6648 consensus_queue.cc:1048] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21d35f94d504429f9484bf24dc6028d4" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:06.971216 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:06.977262 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:06.977805 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:06.983484 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:06.983898 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:07.984898 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:07.992589 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:07.993180 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:08.000564 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:08.001098 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:09.002305 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:09.008219 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:09.008665 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:09.013262 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:09.013669 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:10.014779 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:10.020788 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:10.021239 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:10.026171 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:10.026613 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:11.027529 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:11.032563 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:11.032996 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:11.037531 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:11.037879 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:12.038760 29732 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:12.046214 29732 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:12.046636 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:12.051306 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:12.051692 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:13.106205 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
W20260709 12:27:13.110755  6251 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 12:27:13.114835  6251 consensus_peers.cc:597] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.119827  6251 consensus_peers.cc:597] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:13.123335  6177 consensus_peers.cc:597] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.146898 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:13.147785 29732 tablet_replica.cc:333] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.148733 29732 raft_consensus.cc:2243] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.149505 29732 raft_consensus.cc:2272] T 2c4628176c63472cb5232cbda1bf5a6c P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.152267 29732 tablet_replica.cc:333] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.152988 29732 raft_consensus.cc:2243] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.153898 29732 raft_consensus.cc:2272] T 43bf9ca8a07e4e59872a5c6980610544 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.156313 29732 tablet_replica.cc:333] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.156896 29732 raft_consensus.cc:2243] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.157382 29732 raft_consensus.cc:2272] T 4d511cc59ba840c5ab6b44db1889c689 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.160168 29732 tablet_replica.cc:333] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.160841 29732 raft_consensus.cc:2243] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.161834 29732 raft_consensus.cc:2272] T d8cda126fbf641e7aec5e1af3faf6bed P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.164229 29732 tablet_replica.cc:333] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.164763 29732 raft_consensus.cc:2243] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.165305 29732 raft_consensus.cc:2272] T 92297cd05e7b4b4b8d8b4514fb502841 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.167479 29732 tablet_replica.cc:333] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.168008 29732 raft_consensus.cc:2243] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.168958 29732 raft_consensus.cc:2272] T 23ad41becb2240f68d83a0c087cccf2d P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.171249 29732 tablet_replica.cc:333] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.171816 29732 raft_consensus.cc:2243] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.172271 29732 raft_consensus.cc:2272] T b5e0a61375ed485bb71eaf0923c495a4 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.174525 29732 tablet_replica.cc:333] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.175071 29732 raft_consensus.cc:2243] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.175506 29732 raft_consensus.cc:2272] T 2c366c05985c4c3f9f32b98da4714a16 P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.178637 29732 tablet_replica.cc:333] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.179520 29732 raft_consensus.cc:2243] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.180193 29732 raft_consensus.cc:2272] T 6598421c7f9a4ecc96b7edc75ece5861 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.180411  6251 consensus_peers.cc:597] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.182572 29732 tablet_replica.cc:333] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.183363 29732 raft_consensus.cc:2243] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.184201 29732 raft_consensus.cc:2272] T 6e865bca75e14278a31e10460f861e2f P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.186864 29732 tablet_replica.cc:333] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.187462 29732 raft_consensus.cc:2243] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.188369 29732 raft_consensus.cc:2272] T 2db3860758a24ac1bda104782d6e511a P 39e3ddb0597d49f28bf869098c62c595 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.190516 29732 tablet_replica.cc:333] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.191186 29732 raft_consensus.cc:2243] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.191691 29732 raft_consensus.cc:2272] T 303b6baaedf745aebea0c25ce41602b6 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.193928 29732 tablet_replica.cc:333] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.194466 29732 raft_consensus.cc:2243] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.194942 29732 raft_consensus.cc:2272] T aff7c2533db74ba69cb3799babb85d2f P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.197356 29732 tablet_replica.cc:333] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.197881 29732 raft_consensus.cc:2243] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.198753 29732 raft_consensus.cc:2272] T 822bdf7349cd4f258b3c06951a801696 P 39e3ddb0597d49f28bf869098c62c595 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.201609 29732 tablet_replica.cc:333] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.202512 29732 raft_consensus.cc:2243] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.203261 29732 raft_consensus.cc:2272] T 55007ce213534b4fb5de84c6b8902bfd P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.204519  6251 consensus_peers.cc:597] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.205780 29732 tablet_replica.cc:333] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.206408 29732 raft_consensus.cc:2243] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.206845 29732 raft_consensus.cc:2272] T d3415d2429cd4be699177d750bbf0d16 P 39e3ddb0597d49f28bf869098c62c595 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.208935 29732 tablet_replica.cc:333] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.209403 29732 raft_consensus.cc:2243] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.209893 29732 raft_consensus.cc:2272] T 8fafa1d27b9d462d9eb54af14d49a46a P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.212359 29732 tablet_replica.cc:333] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595: stopping tablet replica
I20260709 12:27:13.212826 29732 raft_consensus.cc:2243] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.213726 29732 raft_consensus.cc:2272] T 3e5209be04f74c64bbc4bdd79054fc58 P 39e3ddb0597d49f28bf869098c62c595 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.214875  6177 consensus_peers.cc:597] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.285173 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
I20260709 12:27:13.326954 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
I20260709 12:27:13.360149 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:13.360018  6251 consensus_peers.cc:597] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:36341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.361163 29732 tablet_replica.cc:333] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.362159 29732 raft_consensus.cc:2243] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.362954 29732 raft_consensus.cc:2272] T 43bf9ca8a07e4e59872a5c6980610544 P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.364193  6177 consensus_peers.cc:597] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:36341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.365605 29732 tablet_replica.cc:333] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.366294 29732 raft_consensus.cc:2243] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.366799 29732 raft_consensus.cc:2272] T d8cda126fbf641e7aec5e1af3faf6bed P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.369066 29732 tablet_replica.cc:333] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.369625 29732 raft_consensus.cc:2243] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.370048 29732 raft_consensus.cc:2272] T 92297cd05e7b4b4b8d8b4514fb502841 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.372120 29732 tablet_replica.cc:333] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.372658 29732 raft_consensus.cc:2243] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.373468 29732 raft_consensus.cc:2272] T 2c366c05985c4c3f9f32b98da4714a16 P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.375533 29732 tablet_replica.cc:333] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.376087 29732 raft_consensus.cc:2243] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.376549 29732 raft_consensus.cc:2272] T 822bdf7349cd4f258b3c06951a801696 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.378713 29732 tablet_replica.cc:333] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.379213 29732 raft_consensus.cc:2243] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.379739 29732 raft_consensus.cc:2272] T 4d511cc59ba840c5ab6b44db1889c689 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.381896 29732 tablet_replica.cc:333] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.382393 29732 raft_consensus.cc:2243] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.382870 29732 raft_consensus.cc:2272] T b5e0a61375ed485bb71eaf0923c495a4 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.385072 29732 tablet_replica.cc:333] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.385604 29732 raft_consensus.cc:2243] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.386029 29732 raft_consensus.cc:2272] T 23ad41becb2240f68d83a0c087cccf2d P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.388572 29732 tablet_replica.cc:333] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.389241 29732 raft_consensus.cc:2243] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.390239 29732 raft_consensus.cc:2272] T 6e865bca75e14278a31e10460f861e2f P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.391764  6251 consensus_peers.cc:597] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:36341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.392860 29732 tablet_replica.cc:333] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.393500 29732 raft_consensus.cc:2243] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.393884 29732 raft_consensus.cc:2272] T 2db3860758a24ac1bda104782d6e511a P 21d35f94d504429f9484bf24dc6028d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.395951 29732 tablet_replica.cc:333] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.396421 29732 raft_consensus.cc:2243] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.397169 29732 raft_consensus.cc:2272] T 303b6baaedf745aebea0c25ce41602b6 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.399106 29732 tablet_replica.cc:333] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.399622 29732 raft_consensus.cc:2243] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.400072 29732 raft_consensus.cc:2272] T aff7c2533db74ba69cb3799babb85d2f P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.402208 29732 tablet_replica.cc:333] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.402905 29732 raft_consensus.cc:2243] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.403927 29732 raft_consensus.cc:2272] T 6598421c7f9a4ecc96b7edc75ece5861 P 21d35f94d504429f9484bf24dc6028d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.406193 29732 tablet_replica.cc:333] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
W20260709 12:27:13.406455  6177 consensus_peers.cc:597] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 -> Peer 39e3ddb0597d49f28bf869098c62c595 (127.29.9.1:36341): Couldn't send request to peer 39e3ddb0597d49f28bf869098c62c595. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:36341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.406828 29732 raft_consensus.cc:2243] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.407909 29732 raft_consensus.cc:2272] T 55007ce213534b4fb5de84c6b8902bfd P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.410151  6249 consensus_peers.cc:597] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 -> Peer 21d35f94d504429f9484bf24dc6028d4 (127.29.9.2:39923): Couldn't send request to peer 21d35f94d504429f9484bf24dc6028d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.410375 29732 tablet_replica.cc:333] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.410977 29732 raft_consensus.cc:2243] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.411396 29732 raft_consensus.cc:2272] T 8fafa1d27b9d462d9eb54af14d49a46a P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.413504 29732 tablet_replica.cc:333] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.413986 29732 raft_consensus.cc:2243] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.414808 29732 raft_consensus.cc:2272] T d3415d2429cd4be699177d750bbf0d16 P 21d35f94d504429f9484bf24dc6028d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.416838 29732 tablet_replica.cc:333] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.417308 29732 raft_consensus.cc:2243] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.417821 29732 raft_consensus.cc:2272] T 2c4628176c63472cb5232cbda1bf5a6c P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.419951 29732 tablet_replica.cc:333] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4: stopping tablet replica
I20260709 12:27:13.420420 29732 raft_consensus.cc:2243] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.420877 29732 raft_consensus.cc:2272] T 3e5209be04f74c64bbc4bdd79054fc58 P 21d35f94d504429f9484bf24dc6028d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.461941 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
I20260709 12:27:13.498208 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
I20260709 12:27:13.528294 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:13.528973 29732 tablet_replica.cc:333] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.529810 29732 raft_consensus.cc:2243] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.530669 29732 raft_consensus.cc:2272] T 2c4628176c63472cb5232cbda1bf5a6c P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.532879 29732 tablet_replica.cc:333] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.533465 29732 raft_consensus.cc:2243] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.533958 29732 raft_consensus.cc:2272] T 822bdf7349cd4f258b3c06951a801696 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.535988 29732 tablet_replica.cc:333] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.536550 29732 raft_consensus.cc:2243] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.536954 29732 raft_consensus.cc:2272] T 43bf9ca8a07e4e59872a5c6980610544 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.538897 29732 tablet_replica.cc:333] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.539469 29732 raft_consensus.cc:2243] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.540081 29732 raft_consensus.cc:2272] T 2c366c05985c4c3f9f32b98da4714a16 P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.542042 29732 tablet_replica.cc:333] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.542523 29732 raft_consensus.cc:2243] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.543403 29732 raft_consensus.cc:2272] T 4d511cc59ba840c5ab6b44db1889c689 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.545372 29732 tablet_replica.cc:333] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.545881 29732 raft_consensus.cc:2243] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.546350 29732 raft_consensus.cc:2272] T d8cda126fbf641e7aec5e1af3faf6bed P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.548207 29732 tablet_replica.cc:333] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.548723 29732 raft_consensus.cc:2243] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.549484 29732 raft_consensus.cc:2272] T 92297cd05e7b4b4b8d8b4514fb502841 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.551404 29732 tablet_replica.cc:333] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.551955 29732 raft_consensus.cc:2243] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.552436 29732 raft_consensus.cc:2272] T 23ad41becb2240f68d83a0c087cccf2d P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.554488 29732 tablet_replica.cc:333] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.555022 29732 raft_consensus.cc:2243] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.555835 29732 raft_consensus.cc:2272] T b5e0a61375ed485bb71eaf0923c495a4 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.557895 29732 tablet_replica.cc:333] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.558423 29732 raft_consensus.cc:2243] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.558835 29732 raft_consensus.cc:2272] T 6598421c7f9a4ecc96b7edc75ece5861 P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.560796 29732 tablet_replica.cc:333] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.561301 29732 raft_consensus.cc:2243] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.562099 29732 raft_consensus.cc:2272] T aff7c2533db74ba69cb3799babb85d2f P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.564225 29732 tablet_replica.cc:333] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.564718 29732 raft_consensus.cc:2243] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.565155 29732 raft_consensus.cc:2272] T 303b6baaedf745aebea0c25ce41602b6 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.567159 29732 tablet_replica.cc:333] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.567628 29732 raft_consensus.cc:2243] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.568128 29732 raft_consensus.cc:2272] T 55007ce213534b4fb5de84c6b8902bfd P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.570060 29732 tablet_replica.cc:333] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.570550 29732 raft_consensus.cc:2243] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.571305 29732 raft_consensus.cc:2272] T 8fafa1d27b9d462d9eb54af14d49a46a P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.573166 29732 tablet_replica.cc:333] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.573633 29732 raft_consensus.cc:2243] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.574041 29732 raft_consensus.cc:2272] T d3415d2429cd4be699177d750bbf0d16 P a07d9332cd9249b589722f82c519da03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.575963 29732 tablet_replica.cc:333] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.576429 29732 raft_consensus.cc:2243] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.576915 29732 raft_consensus.cc:2272] T 6e865bca75e14278a31e10460f861e2f P a07d9332cd9249b589722f82c519da03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.578869 29732 tablet_replica.cc:333] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.579300 29732 raft_consensus.cc:2243] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.579757 29732 raft_consensus.cc:2272] T 2db3860758a24ac1bda104782d6e511a P a07d9332cd9249b589722f82c519da03 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.581670 29732 tablet_replica.cc:333] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03: stopping tablet replica
I20260709 12:27:13.582104 29732 raft_consensus.cc:2243] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.582542 29732 raft_consensus.cc:2272] T 3e5209be04f74c64bbc4bdd79054fc58 P a07d9332cd9249b589722f82c519da03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.621035 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
I20260709 12:27:13.655165 29732 master.cc:562] Master@127.29.9.62:36679 shutting down...
I20260709 12:27:13.678182 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.678748 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.679049 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P fa3a3d07739d42fdbdf24a7817e49a97: stopping tablet replica
I20260709 12:27:13.699018 29732 master.cc:584] Master@127.29.9.62:36679 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21496 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:27:13.748512 29732 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.9.62:37721
I20260709 12:27:13.749603 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:13.755453  6682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:13.755445  6681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:13.756024  6684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:13.757160 29732 server_base.cc:1061] running on GCE node
I20260709 12:27:13.758034 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:13.758200 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:13.758342 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600033758325 us; error 0 us; skew 500 ppm
I20260709 12:27:13.758823 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:13.760988 29732 webserver.cc:533] Webserver started at http://127.29.9.62:44029/ using document root <none> and password file <none>
I20260709 12:27:13.761426 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:13.761590 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:13.761829 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:13.762936 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/master-0-root/instance:
uuid: "277ba5300fbf44978d650fdc62bc70d9"
format_stamp: "Formatted at 2026-07-09 12:27:13 on dist-test-slave-ftzc"
I20260709 12:27:13.767131 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:13.770320  6689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:13.771096 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:13.771369 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/master-0-root
uuid: "277ba5300fbf44978d650fdc62bc70d9"
format_stamp: "Formatted at 2026-07-09 12:27:13 on dist-test-slave-ftzc"
I20260709 12:27:13.771625 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:13.782531 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:13.783670 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:13.819939 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.62:37721
I20260709 12:27:13.820029  6740 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.62:37721 every 8 connection(s)
I20260709 12:27:13.823633  6741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:13.835031  6741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9: Bootstrap starting.
I20260709 12:27:13.839849  6741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.844095  6741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9: No bootstrap required, opened a new log
I20260709 12:27:13.846295  6741 raft_consensus.cc:359] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "277ba5300fbf44978d650fdc62bc70d9" member_type: VOTER }
I20260709 12:27:13.846694  6741 raft_consensus.cc:385] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.846908  6741 raft_consensus.cc:740] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 277ba5300fbf44978d650fdc62bc70d9, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.847450  6741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "277ba5300fbf44978d650fdc62bc70d9" member_type: VOTER }
I20260709 12:27:13.847918  6741 raft_consensus.cc:399] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:13.848130  6741 raft_consensus.cc:493] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:13.848373  6741 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.852923  6741 raft_consensus.cc:515] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "277ba5300fbf44978d650fdc62bc70d9" member_type: VOTER }
I20260709 12:27:13.853435  6741 leader_election.cc:304] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 277ba5300fbf44978d650fdc62bc70d9; no voters: 
I20260709 12:27:13.854627  6741 leader_election.cc:290] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:13.854948  6744 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.856318  6744 raft_consensus.cc:697] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 1 LEADER]: Becoming Leader. State: Replica: 277ba5300fbf44978d650fdc62bc70d9, State: Running, Role: LEADER
I20260709 12:27:13.857023  6744 consensus_queue.cc:237] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "277ba5300fbf44978d650fdc62bc70d9" member_type: VOTER }
I20260709 12:27:13.857432  6741 sys_catalog.cc:565] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:13.861763  6746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 277ba5300fbf44978d650fdc62bc70d9. Latest consensus state: current_term: 1 leader_uuid: "277ba5300fbf44978d650fdc62bc70d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "277ba5300fbf44978d650fdc62bc70d9" member_type: VOTER } }
I20260709 12:27:13.862449  6746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:13.862903  6745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "277ba5300fbf44978d650fdc62bc70d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "277ba5300fbf44978d650fdc62bc70d9" member_type: VOTER } }
I20260709 12:27:13.863336  6745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:13.864403  6751 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:13.869191  6751 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:13.873172 29732 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:13.878232  6751 catalog_manager.cc:1383] Generated new cluster ID: 9b39e5580eb04cc7999327f19c1ed0c9
I20260709 12:27:13.878517  6751 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:13.912573  6751 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:13.913779  6751 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:13.926729  6751 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9: Generated new TSK 0
I20260709 12:27:13.927264  6751 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:13.939517 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:13.945114  6762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:13.945868  6763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:13.947912  6765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:13.948237 29732 server_base.cc:1061] running on GCE node
I20260709 12:27:13.949205 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:13.949383 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:13.949538 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600033949520 us; error 0 us; skew 500 ppm
I20260709 12:27:13.950038 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:13.952200 29732 webserver.cc:533] Webserver started at http://127.29.9.1:34765/ using document root <none> and password file <none>
I20260709 12:27:13.952641 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:13.952811 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:13.953042 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:13.954069 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-0-root/instance:
uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
format_stamp: "Formatted at 2026-07-09 12:27:13 on dist-test-slave-ftzc"
I20260709 12:27:13.958353 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:13.961606  6770 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:13.962333 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:13.962623 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-0-root
uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
format_stamp: "Formatted at 2026-07-09 12:27:13 on dist-test-slave-ftzc"
I20260709 12:27:13.962888 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:13.976166 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:13.977293 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:13.978636 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:13.980739 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:13.980926 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:13.981145 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:13.981303 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:14.020345 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.1:43867
I20260709 12:27:14.020460  6832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.1:43867 every 8 connection(s)
I20260709 12:27:14.025146 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:14.032233  6838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:14.033042  6837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:14.034559  6840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:14.037186 29732 server_base.cc:1061] running on GCE node
I20260709 12:27:14.037547  6833 heartbeater.cc:344] Connected to a master server at 127.29.9.62:37721
I20260709 12:27:14.037964  6833 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:14.038201 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:14.038476 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:14.038631 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600034038614 us; error 0 us; skew 500 ppm
I20260709 12:27:14.038693  6833 heartbeater.cc:507] Master 127.29.9.62:37721 requested a full tablet report, sending...
I20260709 12:27:14.039186 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:14.041047  6706 ts_manager.cc:194] Registered new tserver with Master: 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867)
I20260709 12:27:14.041677 29732 webserver.cc:533] Webserver started at http://127.29.9.2:36293/ using document root <none> and password file <none>
I20260709 12:27:14.042197 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:14.042372 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:14.042618 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:14.042915  6706 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46000
I20260709 12:27:14.043844 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-1-root/instance:
uuid: "f4a5591702044cabac2e3d0e0c7683de"
format_stamp: "Formatted at 2026-07-09 12:27:14 on dist-test-slave-ftzc"
I20260709 12:27:14.048454 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:14.051967  6845 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:14.052701 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:14.053006 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-1-root
uuid: "f4a5591702044cabac2e3d0e0c7683de"
format_stamp: "Formatted at 2026-07-09 12:27:14 on dist-test-slave-ftzc"
I20260709 12:27:14.053274 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:14.068436 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:14.069577 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:14.071005 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:14.073300 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:14.073495 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:14.073711 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:14.073873 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:14.113633 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.2:43519
I20260709 12:27:14.113740  6907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.2:43519 every 8 connection(s)
I20260709 12:27:14.118434 29732 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:14.125079  6911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:14.126794  6912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:14.129609 29732 server_base.cc:1061] running on GCE node
W20260709 12:27:14.129809  6914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:14.130828  6908 heartbeater.cc:344] Connected to a master server at 127.29.9.62:37721
I20260709 12:27:14.130890 29732 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:14.131306 29732 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:14.131341  6908 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:14.131486 29732 hybrid_clock.cc:648] HybridClock initialized: now 1783600034131470 us; error 0 us; skew 500 ppm
I20260709 12:27:14.132268 29732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:14.132270  6908 heartbeater.cc:507] Master 127.29.9.62:37721 requested a full tablet report, sending...
I20260709 12:27:14.134974 29732 webserver.cc:533] Webserver started at http://127.29.9.3:46779/ using document root <none> and password file <none>
I20260709 12:27:14.134989  6706 ts_manager.cc:194] Registered new tserver with Master: f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:14.135602 29732 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:14.135859 29732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:14.136119 29732 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:14.136706  6706 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46012
I20260709 12:27:14.137328 29732 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-2-root/instance:
uuid: "2bd1c1645d1947d28d4652041bce39c8"
format_stamp: "Formatted at 2026-07-09 12:27:14 on dist-test-slave-ftzc"
I20260709 12:27:14.142545 29732 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:27:14.146190  6919 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:14.146925 29732 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:14.147212 29732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-2-root
uuid: "2bd1c1645d1947d28d4652041bce39c8"
format_stamp: "Formatted at 2026-07-09 12:27:14 on dist-test-slave-ftzc"
I20260709 12:27:14.147490 29732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzMcFdo/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599741059956-29732-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:14.178777 29732 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:14.180001 29732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:14.181438 29732 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:14.183583 29732 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:14.183796 29732 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:14.184046 29732 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:14.184194 29732 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:14.222263 29732 rpc_server.cc:307] RPC server started. Bound to: 127.29.9.3:36481
I20260709 12:27:14.222368  6981 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.9.3:36481 every 8 connection(s)
I20260709 12:27:14.235476  6982 heartbeater.cc:344] Connected to a master server at 127.29.9.62:37721
I20260709 12:27:14.235937  6982 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:14.236650  6982 heartbeater.cc:507] Master 127.29.9.62:37721 requested a full tablet report, sending...
I20260709 12:27:14.238588  6706 ts_manager.cc:194] Registered new tserver with Master: 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.239675 29732 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014472767s
I20260709 12:27:14.239913  6706 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46014
I20260709 12:27:14.263898  6706 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46022:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:14.266628  6706 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:14.334194  6872 tablet_service.cc:1511] Processing CreateTablet for tablet 1880578ebd254aecbb480bca936aea7b (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:14.334370  6871 tablet_service.cc:1511] Processing CreateTablet for tablet 317e859f439b422cb0c01d34e5c50975 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:14.335692  6871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317e859f439b422cb0c01d34e5c50975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.335413  6873 tablet_service.cc:1511] Processing CreateTablet for tablet da2ae8230af54606ba0ac552d2afcda0 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:14.336733  6873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2ae8230af54606ba0ac552d2afcda0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.336809  6870 tablet_service.cc:1511] Processing CreateTablet for tablet 334bcf8ddd1d49b38969ea2bab062062 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:14.338161  6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334bcf8ddd1d49b38969ea2bab062062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.338815  6869 tablet_service.cc:1511] Processing CreateTablet for tablet 383656a55f204d10ba97e89f81eff725 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:14.340068  6869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383656a55f204d10ba97e89f81eff725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.345677  6868 tablet_service.cc:1511] Processing CreateTablet for tablet 95d2f06b2fd1415a8fd120cde94743d1 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:14.346928  6872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1880578ebd254aecbb480bca936aea7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.349946  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d2f06b2fd1415a8fd120cde94743d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.351905  6798 tablet_service.cc:1511] Processing CreateTablet for tablet da2ae8230af54606ba0ac552d2afcda0 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:14.353201  6798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2ae8230af54606ba0ac552d2afcda0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.354936  6792 tablet_service.cc:1511] Processing CreateTablet for tablet 69a5fc3402494c718fd85c5ec581181d (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:14.356840  6797 tablet_service.cc:1511] Processing CreateTablet for tablet 1880578ebd254aecbb480bca936aea7b (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:14.357637  6947 tablet_service.cc:1511] Processing CreateTablet for tablet da2ae8230af54606ba0ac552d2afcda0 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:14.358911  6947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2ae8230af54606ba0ac552d2afcda0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.358754  6796 tablet_service.cc:1511] Processing CreateTablet for tablet 317e859f439b422cb0c01d34e5c50975 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:14.360819  6944 tablet_service.cc:1511] Processing CreateTablet for tablet 334bcf8ddd1d49b38969ea2bab062062 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:14.362134  6944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334bcf8ddd1d49b38969ea2bab062062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.361843  6946 tablet_service.cc:1511] Processing CreateTablet for tablet 1880578ebd254aecbb480bca936aea7b (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:14.362686  6791 tablet_service.cc:1511] Processing CreateTablet for tablet f140010db0f947a5869cf9ef47b7025f (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:14.363175  6946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1880578ebd254aecbb480bca936aea7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.365713  6794 tablet_service.cc:1511] Processing CreateTablet for tablet 383656a55f204d10ba97e89f81eff725 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:14.366869  6945 tablet_service.cc:1511] Processing CreateTablet for tablet 317e859f439b422cb0c01d34e5c50975 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:14.367489  6942 tablet_service.cc:1511] Processing CreateTablet for tablet 95d2f06b2fd1415a8fd120cde94743d1 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:14.368237  6945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317e859f439b422cb0c01d34e5c50975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.372602  6943 tablet_service.cc:1511] Processing CreateTablet for tablet 383656a55f204d10ba97e89f81eff725 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:14.373975  6943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383656a55f204d10ba97e89f81eff725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.373834  6867 tablet_service.cc:1511] Processing CreateTablet for tablet 69a5fc3402494c718fd85c5ec581181d (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:14.365808  6793 tablet_service.cc:1511] Processing CreateTablet for tablet 95d2f06b2fd1415a8fd120cde94743d1 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:14.375159  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a5fc3402494c718fd85c5ec581181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.376803  6941 tablet_service.cc:1511] Processing CreateTablet for tablet 69a5fc3402494c718fd85c5ec581181d (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:14.378075  6941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a5fc3402494c718fd85c5ec581181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.382208  6942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d2f06b2fd1415a8fd120cde94743d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.385506  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1880578ebd254aecbb480bca936aea7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.389422  6795 tablet_service.cc:1511] Processing CreateTablet for tablet 334bcf8ddd1d49b38969ea2bab062062 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:14.393831  6792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a5fc3402494c718fd85c5ec581181d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.400082  6794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383656a55f204d10ba97e89f81eff725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.409963  6873 tablet_service.cc:1511] Processing CreateTablet for tablet f140010db0f947a5869cf9ef47b7025f (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:14.412453  6940 tablet_service.cc:1511] Processing CreateTablet for tablet f140010db0f947a5869cf9ef47b7025f (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:14.413789  6940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f140010db0f947a5869cf9ef47b7025f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.414644  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f140010db0f947a5869cf9ef47b7025f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.415977  6796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317e859f439b422cb0c01d34e5c50975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.416567  6793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d2f06b2fd1415a8fd120cde94743d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.411422  6873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f140010db0f947a5869cf9ef47b7025f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.418128  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334bcf8ddd1d49b38969ea2bab062062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.428751  6790 tablet_service.cc:1511] Processing CreateTablet for tablet a533385133264ec58a7246b78f3521c0 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:14.430189  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a533385133264ec58a7246b78f3521c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.436945  6999 tablet_bootstrap.cc:492] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.472548  6997 tablet_bootstrap.cc:492] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.480261  6997 tablet_bootstrap.cc:654] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.489442  6939 tablet_service.cc:1511] Processing CreateTablet for tablet a533385133264ec58a7246b78f3521c0 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:14.490826  6939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a533385133264ec58a7246b78f3521c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.506848  6869 tablet_service.cc:1511] Processing CreateTablet for tablet a533385133264ec58a7246b78f3521c0 (DEFAULT_TABLE table=test-workload [id=d3e4040efa3e48e9a3cacccb366253bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:14.508213  6869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a533385133264ec58a7246b78f3521c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.518427  6998 tablet_bootstrap.cc:492] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.527287  6998 tablet_bootstrap.cc:654] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.533253  6997 tablet_bootstrap.cc:492] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:14.533735  6997 ts_tablet_manager.cc:1403] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.021s
I20260709 12:27:14.538965  6998 tablet_bootstrap.cc:492] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.539552  6998 ts_tablet_manager.cc:1403] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 12:27:14.541644  6999 tablet_bootstrap.cc:654] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.548770  6997 raft_consensus.cc:359] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.549057  6998 raft_consensus.cc:359] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.549736  6997 raft_consensus.cc:385] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.549943  6998 raft_consensus.cc:385] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.550447  6998 raft_consensus.cc:740] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.550055  6997 raft_consensus.cc:740] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.551244  6998 consensus_queue.cc:260] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.551609  6997 consensus_queue.cc:260] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.552747  6999 tablet_bootstrap.cc:492] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.553324  6999 ts_tablet_manager.cc:1403] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.117s	user 0.005s	sys 0.013s
I20260709 12:27:14.553431  6982 heartbeater.cc:499] Master 127.29.9.62:37721 was elected leader, sending a full tablet report...
I20260709 12:27:14.554183  6998 ts_tablet_manager.cc:1434] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:27:14.555197  6998 tablet_bootstrap.cc:492] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.556486  6999 raft_consensus.cc:359] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.557205  6999 raft_consensus.cc:385] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.557482  6999 raft_consensus.cc:740] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.558404  6999 consensus_queue.cc:260] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.561579  6998 tablet_bootstrap.cc:654] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.568046  6999 ts_tablet_manager.cc:1434] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 12:27:14.569089  6833 heartbeater.cc:499] Master 127.29.9.62:37721 was elected leader, sending a full tablet report...
I20260709 12:27:14.573958  6999 tablet_bootstrap.cc:492] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.580345  6998 tablet_bootstrap.cc:492] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.580513  6999 tablet_bootstrap.cc:654] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.581913  6908 heartbeater.cc:499] Master 127.29.9.62:37721 was elected leader, sending a full tablet report...
I20260709 12:27:14.582432  6997 ts_tablet_manager.cc:1434] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.048s	user 0.017s	sys 0.016s
I20260709 12:27:14.583200  6998 ts_tablet_manager.cc:1403] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.001s
I20260709 12:27:14.583560  6997 tablet_bootstrap.cc:492] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.586261  6998 raft_consensus.cc:359] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.587047  6998 raft_consensus.cc:385] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.587379  6998 raft_consensus.cc:740] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.588284  6998 consensus_queue.cc:260] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.589902  6997 tablet_bootstrap.cc:654] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.590454  6998 ts_tablet_manager.cc:1434] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:14.591516  6998 tablet_bootstrap.cc:492] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.597615  6998 tablet_bootstrap.cc:654] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.598989  6999 tablet_bootstrap.cc:492] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.599575  6999 ts_tablet_manager.cc:1403] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:27:14.601097  6997 tablet_bootstrap.cc:492] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:14.601679  6997 ts_tablet_manager.cc:1403] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:27:14.602924  6999 raft_consensus.cc:359] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.603844  6999 raft_consensus.cc:385] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.604203  6999 raft_consensus.cc:740] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.604499  6997 raft_consensus.cc:359] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.605216  6999 consensus_queue.cc:260] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.605237  6997 raft_consensus.cc:385] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.607261  6997 raft_consensus.cc:740] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.608017  6997 consensus_queue.cc:260] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.608947  6999 ts_tablet_manager.cc:1434] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:14.609969  6999 tablet_bootstrap.cc:492] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.610028  6997 ts_tablet_manager.cc:1434] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 12:27:14.611599  6997 tablet_bootstrap.cc:492] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.614125  7005 raft_consensus.cc:493] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.614645  7005 raft_consensus.cc:515] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.617661  6997 tablet_bootstrap.cc:654] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.621698  6998 tablet_bootstrap.cc:492] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.622192  7005 leader_election.cc:290] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
W20260709 12:27:14.622709  6909 tablet.cc:2406] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:14.622238  6998 ts_tablet_manager.cc:1403] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.005s
I20260709 12:27:14.628686  6998 raft_consensus.cc:359] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.631330  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:14.629426  6998 raft_consensus.cc:385] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.632267  6998 raft_consensus.cc:740] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
W20260709 12:27:14.633313  6772 leader_election.cc:343] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.633181  6998 consensus_queue.cc:260] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.635998  6999 tablet_bootstrap.cc:654] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.636500  6997 tablet_bootstrap.cc:492] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:14.636763  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
W20260709 12:27:14.638418  6771 leader_election.cc:343] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.638813  6998 ts_tablet_manager.cc:1434] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:27:14.638860  6771 leader_election.cc:304] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:14.639909  7005 raft_consensus.cc:2749] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:14.640105  6998 tablet_bootstrap.cc:492] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.637048  6997 ts_tablet_manager.cc:1403] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 12:27:14.643119  6999 tablet_bootstrap.cc:492] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.643776  6999 ts_tablet_manager.cc:1403] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.003s
I20260709 12:27:14.644738  6997 raft_consensus.cc:359] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.645656  6997 raft_consensus.cc:385] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.645994  6997 raft_consensus.cc:740] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.646752  6997 consensus_queue.cc:260] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.646919  6999 raft_consensus.cc:359] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.647341  6998 tablet_bootstrap.cc:654] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.647670  6999 raft_consensus.cc:385] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.648002  6999 raft_consensus.cc:740] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.648715  6999 consensus_queue.cc:260] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.648945  6997 ts_tablet_manager.cc:1434] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:14.650322  6997 tablet_bootstrap.cc:492] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.653205  6999 ts_tablet_manager.cc:1434] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:27:14.654278  6999 tablet_bootstrap.cc:492] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.655063  6998 tablet_bootstrap.cc:492] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.655707  6998 ts_tablet_manager.cc:1403] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:27:14.656374  6997 tablet_bootstrap.cc:654] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.658679  6998 raft_consensus.cc:359] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.661448  6999 tablet_bootstrap.cc:654] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.659498  6998 raft_consensus.cc:385] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.662776  6998 raft_consensus.cc:740] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.663607  6998 consensus_queue.cc:260] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.665817  6998 ts_tablet_manager.cc:1434] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:27:14.670449  6998 tablet_bootstrap.cc:492] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.671211  6997 tablet_bootstrap.cc:492] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:14.671773  6997 ts_tablet_manager.cc:1403] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:27:14.674629  6997 raft_consensus.cc:359] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.675230  6999 tablet_bootstrap.cc:492] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.675316  6997 raft_consensus.cc:385] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.675868  6997 raft_consensus.cc:740] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.675959  6999 ts_tablet_manager.cc:1403] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 12:27:14.677083  6998 tablet_bootstrap.cc:654] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.676719  6997 consensus_queue.cc:260] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.679296  6997 ts_tablet_manager.cc:1434] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:27:14.679203  6999 raft_consensus.cc:359] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.680176  6999 raft_consensus.cc:385] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.680522  6999 raft_consensus.cc:740] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.680794  6997 tablet_bootstrap.cc:492] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.681371  6999 consensus_queue.cc:260] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.683326  6999 ts_tablet_manager.cc:1434] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:27:14.684333  6999 tablet_bootstrap.cc:492] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.686753  6998 tablet_bootstrap.cc:492] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.687315  6997 tablet_bootstrap.cc:654] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.687362  6998 ts_tablet_manager.cc:1403] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.008s
I20260709 12:27:14.690230  6999 tablet_bootstrap.cc:654] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.691761  6998 raft_consensus.cc:359] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.693666  6998 raft_consensus.cc:385] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.694023  6998 raft_consensus.cc:740] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.694993  6998 consensus_queue.cc:260] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.700189  6998 ts_tablet_manager.cc:1434] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:27:14.701231  6998 tablet_bootstrap.cc:492] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.702140  7004 raft_consensus.cc:493] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.702665  7004 raft_consensus.cc:515] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.705231  7004 leader_election.cc:290] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.707296  6998 tablet_bootstrap.cc:654] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.701856  6999 tablet_bootstrap.cc:492] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.709357  7005 raft_consensus.cc:493] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.710256  7005 raft_consensus.cc:515] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.712230  7005 leader_election.cc:290] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.713330  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ae8230af54606ba0ac552d2afcda0" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:14.713732  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ae8230af54606ba0ac552d2afcda0" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:14.714026  6957 raft_consensus.cc:2468] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:14.714449  6883 raft_consensus.cc:2468] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:14.715564  6772 leader_election.cc:304] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:14.716382  7005 raft_consensus.cc:2804] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.713755  6999 ts_tablet_manager.cc:1403] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.005s
I20260709 12:27:14.716799  7005 raft_consensus.cc:493] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.717444  7005 raft_consensus.cc:3060] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.719863  6999 raft_consensus.cc:359] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.720633  6999 raft_consensus.cc:385] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.720911  6999 raft_consensus.cc:740] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.721649  6999 consensus_queue.cc:260] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.725355  6997 tablet_bootstrap.cc:492] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:14.725687  6998 tablet_bootstrap.cc:492] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.726349  6998 ts_tablet_manager.cc:1403] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.012s
I20260709 12:27:14.728204  6997 ts_tablet_manager.cc:1403] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.014s
I20260709 12:27:14.725359  7005 raft_consensus.cc:515] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.729686  6998 raft_consensus.cc:359] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.730473  6998 raft_consensus.cc:385] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.730755  6998 raft_consensus.cc:740] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.731642  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ae8230af54606ba0ac552d2afcda0" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:14.732262  6883 raft_consensus.cc:3060] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.732568  6998 consensus_queue.cc:260] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.731084  6997 raft_consensus.cc:359] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.733560  6997 raft_consensus.cc:385] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.733978  6997 raft_consensus.cc:740] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.734666  6997 consensus_queue.cc:260] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.736357  6999 ts_tablet_manager.cc:1434] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 12:27:14.736805  6997 ts_tablet_manager.cc:1434] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:27:14.737546  6999 tablet_bootstrap.cc:492] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.737718  6997 tablet_bootstrap.cc:492] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.739938  6883 raft_consensus.cc:2468] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:14.741228  6771 leader_election.cc:304] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:14.742221  7022 raft_consensus.cc:2804] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:14.742362  6998 ts_tablet_manager.cc:1434] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:27:14.743432  6998 tablet_bootstrap.cc:492] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.749636  6998 tablet_bootstrap.cc:654] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.750973  7022 raft_consensus.cc:697] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:14.751979  7022 consensus_queue.cc:237] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.757812  6997 tablet_bootstrap.cc:654] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.753445  6999 tablet_bootstrap.cc:654] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.754899  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2ae8230af54606ba0ac552d2afcda0" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:14.758536  6957 raft_consensus.cc:3060] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.755820  7005 leader_election.cc:290] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.766335  6999 tablet_bootstrap.cc:492] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.766938  6999 ts_tablet_manager.cc:1403] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:27:14.770309  7003 raft_consensus.cc:493] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.770112  6999 raft_consensus.cc:359] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.770779  7003 raft_consensus.cc:515] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.766973  6957 raft_consensus.cc:2468] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:14.777526  7003 leader_election.cc:290] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:14.770793  6999 raft_consensus.cc:385] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.780387  6999 raft_consensus.cc:740] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.781322  6999 consensus_queue.cc:260] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.781896  6998 tablet_bootstrap.cc:492] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.782503  6998 ts_tablet_manager.cc:1403] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.009s
I20260709 12:27:14.784286  6999 ts_tablet_manager.cc:1434] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:27:14.785418  6999 tablet_bootstrap.cc:492] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.787211  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f140010db0f947a5869cf9ef47b7025f" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
W20260709 12:27:14.789080  6847 leader_election.cc:343] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.785594  6998 raft_consensus.cc:359] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.790226  6998 raft_consensus.cc:385] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.790511  6998 raft_consensus.cc:740] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.793190  6998 consensus_queue.cc:260] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.793838  6704 catalog_manager.cc:5697] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.795471  6998 ts_tablet_manager.cc:1434] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:27:14.796139  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f140010db0f947a5869cf9ef47b7025f" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:14.802062  6957 raft_consensus.cc:2468] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:14.802569  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:14.803222  6808 raft_consensus.cc:2468] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:14.803388  6847 leader_election.cc:304] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:14.804731  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:14.797366  7022 raft_consensus.cc:493] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.805871  6921 leader_election.cc:304] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:14.806085  7004 raft_consensus.cc:2804] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.806520  7004 raft_consensus.cc:493] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.805867  7022 raft_consensus.cc:515] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.806824  7003 raft_consensus.cc:2804] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.807390  7003 raft_consensus.cc:493] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.807746  7003 raft_consensus.cc:3060] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.807977  6998 tablet_bootstrap.cc:492] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.808498  7022 leader_election.cc:290] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.799271  6997 tablet_bootstrap.cc:492] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:14.806881  7004 raft_consensus.cc:3060] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.810863  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e859f439b422cb0c01d34e5c50975" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:14.811515  6883 raft_consensus.cc:2468] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:14.812719  6771 leader_election.cc:304] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:14.796880  6999 tablet_bootstrap.cc:654] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:14.814051  6920 leader_election.cc:343] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.817162  6997 ts_tablet_manager.cc:1403] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.005s
I20260709 12:27:14.814970  7003 raft_consensus.cc:515] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.824239  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:14.824802  6808 raft_consensus.cc:3060] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.817091  7004 raft_consensus.cc:515] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.815780  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e859f439b422cb0c01d34e5c50975" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:14.814685  7022 raft_consensus.cc:2804] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.826742  7022 raft_consensus.cc:493] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.827126  7022 raft_consensus.cc:3060] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:14.827764  6772 leader_election.cc:343] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.819537  6998 tablet_bootstrap.cc:654] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.832306  7003 leader_election.cc:290] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:14.833863  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
W20260709 12:27:14.835386  6920 leader_election.cc:343] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.835270  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f140010db0f947a5869cf9ef47b7025f" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:14.836961  6808 raft_consensus.cc:2468] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
W20260709 12:27:14.837109  6847 leader_election.cc:343] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.838225  6921 leader_election.cc:304] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:14.838842  7004 leader_election.cc:290] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.839051  7022 raft_consensus.cc:515] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.839934  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f140010db0f947a5869cf9ef47b7025f" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:14.840548  6957 raft_consensus.cc:3060] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.824936  6997 raft_consensus.cc:359] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.841881  6997 raft_consensus.cc:385] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.842191  6997 raft_consensus.cc:740] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.842731  6998 tablet_bootstrap.cc:492] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.842842  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e859f439b422cb0c01d34e5c50975" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:14.843596  6998 ts_tablet_manager.cc:1403] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.012s
I20260709 12:27:14.843199  6997 consensus_queue.cc:260] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.845598  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e859f439b422cb0c01d34e5c50975" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:14.846858  6997 ts_tablet_manager.cc:1434] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 12:27:14.847162  6998 raft_consensus.cc:359] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.848055  6998 raft_consensus.cc:385] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.848153  6997 tablet_bootstrap.cc:492] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.848453  6998 raft_consensus.cc:740] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.849553  6998 consensus_queue.cc:260] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
W20260709 12:27:14.847846  6772 leader_election.cc:343] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:14.843487  6883 raft_consensus.cc:3060] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.847251  7022 leader_election.cc:290] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.852654  7003 raft_consensus.cc:2804] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:14.865656  6999 tablet_bootstrap.cc:492] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.866309  6999 ts_tablet_manager.cc:1403] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.081s	user 0.029s	sys 0.028s
I20260709 12:27:14.868963  6883 raft_consensus.cc:2468] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:14.869132  6999 raft_consensus.cc:359] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.869968  6999 raft_consensus.cc:385] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.870294  6999 raft_consensus.cc:740] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.870216  6771 leader_election.cc:304] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:14.871403  6957 raft_consensus.cc:2468] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 1.
I20260709 12:27:14.871332  6999 consensus_queue.cc:260] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.871886  7022 raft_consensus.cc:2804] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:14.869634  6754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:14.872749  6847 leader_election.cc:304] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:14.873853  7004 raft_consensus.cc:2804] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:14.873799  7022 raft_consensus.cc:697] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:14.873999  6999 ts_tablet_manager.cc:1434] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:27:14.876255  6999 tablet_bootstrap.cc:492] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:14.875844  7022 consensus_queue.cc:237] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.877789  6997 tablet_bootstrap.cc:654] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.888731  7003 raft_consensus.cc:697] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:14.890332  7004 raft_consensus.cc:697] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:14.891515  7036 raft_consensus.cc:493] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.891436  7004 consensus_queue.cc:237] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.892396  6998 ts_tablet_manager.cc:1434] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.048s	user 0.016s	sys 0.019s
I20260709 12:27:14.893283  6998 tablet_bootstrap.cc:492] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:14.893448  7003 consensus_queue.cc:237] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.895735  7034 raft_consensus.cc:493] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.892122  7036 raft_consensus.cc:515] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.899338  6998 tablet_bootstrap.cc:654] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.899365  6997 tablet_bootstrap.cc:492] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:14.900115  6997 ts_tablet_manager.cc:1403] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.011s
I20260709 12:27:14.900759  7034 raft_consensus.cc:515] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.901746  7036 leader_election.cc:290] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.903286  7034 leader_election.cc:290] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:14.904500  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:14.904560  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:14.904893  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:14.905220  6957 raft_consensus.cc:2468] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:14.905319  6808 raft_consensus.cc:2468] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:14.906237  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:14.906446  6847 leader_election.cc:304] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:14.906890  6883 raft_consensus.cc:2468] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:14.904018  6997 raft_consensus.cc:359] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.910049  7036 raft_consensus.cc:2804] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.908277  6997 raft_consensus.cc:385] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.909690  6920 leader_election.cc:304] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:14.912712  7034 raft_consensus.cc:2804] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.911437  6704 catalog_manager.cc:5697] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 0 to 1, leader changed from <none> to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.913113  7034 raft_consensus.cc:493] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.915047  6999 tablet_bootstrap.cc:654] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.915666  7034 raft_consensus.cc:3060] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.913535  6997 raft_consensus.cc:740] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.923172  7036 raft_consensus.cc:493] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.923628  7036 raft_consensus.cc:3060] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.917273  6997 consensus_queue.cc:260] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.930718  6997 ts_tablet_manager.cc:1434] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:27:14.931677  6997 tablet_bootstrap.cc:492] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:14.935695  7034 raft_consensus.cc:515] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.939615  7036 raft_consensus.cc:515] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.942739  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:14.943333  6808 raft_consensus.cc:3060] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.944348  6998 tablet_bootstrap.cc:492] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:14.946455  6998 ts_tablet_manager.cc:1403] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.017s
I20260709 12:27:14.946542  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:14.946923  6997 tablet_bootstrap.cc:654] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:14.947628  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:14.948415  6957 raft_consensus.cc:2393] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4a5591702044cabac2e3d0e0c7683de in current term 1: Already voted for candidate 2bd1c1645d1947d28d4652041bce39c8 in this term.
I20260709 12:27:14.947945  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:14.945832  7034 leader_election.cc:290] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:14.945180  6999 tablet_bootstrap.cc:492] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:14.949445  6883 raft_consensus.cc:2393] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2bd1c1645d1947d28d4652041bce39c8 in current term 1: Already voted for candidate f4a5591702044cabac2e3d0e0c7683de in this term.
I20260709 12:27:14.949563  6999 ts_tablet_manager.cc:1403] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.074s	user 0.006s	sys 0.008s
I20260709 12:27:14.949661  6998 raft_consensus.cc:359] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.945745  7036 leader_election.cc:290] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.950488  6998 raft_consensus.cc:385] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.950917  6998 raft_consensus.cc:740] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.951638  6998 consensus_queue.cc:260] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.951977  6999 raft_consensus.cc:359] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.952728  6999 raft_consensus.cc:385] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:14.953027  6999 raft_consensus.cc:740] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:14.952296  7034 raft_consensus.cc:493] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.954162  6998 ts_tablet_manager.cc:1434] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:14.953817  7034 raft_consensus.cc:515] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.955195  6920 leader_election.cc:304] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8; no voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:14.955982  7035 raft_consensus.cc:2749] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:14.940938  6704 catalog_manager.cc:5697] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:14.954586  6808 raft_consensus.cc:2468] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 1.
I20260709 12:27:14.957849  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:14.958582  6807 raft_consensus.cc:2468] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:14.958824  7036 raft_consensus.cc:493] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.958848  6847 leader_election.cc:304] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:14.959481  7036 raft_consensus.cc:515] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.959779  6921 leader_election.cc:304] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:14.959971  7037 raft_consensus.cc:2804] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:14.960601  7035 raft_consensus.cc:2804] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.960723  7037 raft_consensus.cc:697] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:14.961184  7035 raft_consensus.cc:493] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.961488  7036 leader_election.cc:290] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:14.961555  7035 raft_consensus.cc:3060] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.963526  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:14.964197  6957 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:14.965027  6807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:14.966935  6706 catalog_manager.cc:5697] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.971488  7035 raft_consensus.cc:515] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.974766  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:14.975030  6847 leader_election.cc:304] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:14.975440  6806 raft_consensus.cc:3060] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.961671  7037 consensus_queue.cc:237] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.983754  6806 raft_consensus.cc:2468] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:14.984599  7036 raft_consensus.cc:2804] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.984938  7036 raft_consensus.cc:493] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.985205  7036 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.985093  6921 leader_election.cc:304] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:14.986306  7003 raft_consensus.cc:2804] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:14.987648  7003 raft_consensus.cc:697] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:14.988612  7003 consensus_queue.cc:237] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.991053  7036 raft_consensus.cc:515] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.954612  6999 consensus_queue.cc:260] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:14.993302  6807 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:14.996862  7034 leader_election.cc:290] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:14.997949  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:14.998808  6999 ts_tablet_manager.cc:1434] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.000s
I20260709 12:27:15.000005  6999 tablet_bootstrap.cc:492] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
W20260709 12:27:15.000473  6920 leader_election.cc:343] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:15.002063  7036 leader_election.cc:290] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.002533  7037 raft_consensus.cc:493] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.003304  7037 raft_consensus.cc:515] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.002777  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:15.004756  6808 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.005043  6997 tablet_bootstrap.cc:492] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:15.005355  7037 leader_election.cc:290] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.005582  6997 ts_tablet_manager.cc:1403] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.024s
I20260709 12:27:15.007099  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:15.008080  7035 leader_election.cc:290] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:15.008399  6997 raft_consensus.cc:359] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.009115  6997 raft_consensus.cc:385] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:15.009380  6997 raft_consensus.cc:740] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:15.010048  6997 consensus_queue.cc:260] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.010286  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:15.010888  6883 raft_consensus.cc:3060] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.012073  6999 tablet_bootstrap.cc:654] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:15.012276  6997 ts_tablet_manager.cc:1434] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:15.012676  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:15.013217  6997 tablet_bootstrap.cc:492] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:15.013867  6808 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 1.
I20260709 12:27:15.015147  6847 leader_election.cc:304] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:15.015921  7037 raft_consensus.cc:2804] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:15.016394  7037 raft_consensus.cc:697] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:15.013265  6957 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.017397  7037 consensus_queue.cc:237] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.019364  6997 tablet_bootstrap.cc:654] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:15.005836  6704 catalog_manager.cc:5697] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 0 to 1, leader changed from <none> to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.025172  6957 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 1.
I20260709 12:27:15.028223  6883 raft_consensus.cc:2468] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:15.029001  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:15.030206  6806 raft_consensus.cc:2393] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4a5591702044cabac2e3d0e0c7683de in current term 1: Already voted for candidate 2bd1c1645d1947d28d4652041bce39c8 in this term.
I20260709 12:27:15.033422  6847 leader_election.cc:304] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:15.034505  7036 raft_consensus.cc:3060] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.035689  6999 tablet_bootstrap.cc:492] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:15.036230  6999 ts_tablet_manager.cc:1403] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.002s
I20260709 12:27:15.038869  6999 raft_consensus.cc:359] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.039507  6999 raft_consensus.cc:385] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:15.039768  6999 raft_consensus.cc:740] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:15.041270  6999 consensus_queue.cc:260] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.040508  6706 catalog_manager.cc:5697] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.042019  7036 raft_consensus.cc:2749] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:15.047260  6999 ts_tablet_manager.cc:1434] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:15.047391  6997 tablet_bootstrap.cc:492] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:15.048038  6997 ts_tablet_manager.cc:1403] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.009s
I20260709 12:27:15.049027  7003 raft_consensus.cc:493] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.049525  7003 raft_consensus.cc:515] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.051337  6997 raft_consensus.cc:359] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.052119  6997 raft_consensus.cc:385] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:15.052449  6997 raft_consensus.cc:740] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:15.052597  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a533385133264ec58a7246b78f3521c0" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:15.053293  6806 raft_consensus.cc:2468] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:15.053256  6997 consensus_queue.cc:260] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.053848  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a533385133264ec58a7246b78f3521c0" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:15.054512  6883 raft_consensus.cc:2468] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:15.054667  6921 leader_election.cc:304] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:15.055636  7035 raft_consensus.cc:2804] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:15.055898  7003 leader_election.cc:290] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:15.056380  7035 raft_consensus.cc:493] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.055660  6997 ts_tablet_manager.cc:1434] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:15.056777  7035 raft_consensus.cc:3060] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.059001  6704 catalog_manager.cc:5697] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 0 to 1, leader changed from <none> to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.063055  7035 raft_consensus.cc:515] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.064946  7035 leader_election.cc:290] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:15.065409  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a533385133264ec58a7246b78f3521c0" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:15.065929  6806 raft_consensus.cc:3060] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.066125  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a533385133264ec58a7246b78f3521c0" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:15.066696  6883 raft_consensus.cc:3060] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.072992  6806 raft_consensus.cc:2468] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:15.073403  6883 raft_consensus.cc:2468] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:15.074354  6921 leader_election.cc:304] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:15.075251  7035 raft_consensus.cc:2804] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:15.075613  7035 raft_consensus.cc:697] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:15.076347  7035 consensus_queue.cc:237] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.081233  7022 raft_consensus.cc:493] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.081645  7022 raft_consensus.cc:515] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.083250  7022 leader_election.cc:290] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.083936  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383656a55f204d10ba97e89f81eff725" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:15.084388  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383656a55f204d10ba97e89f81eff725" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:15.084589  6883 raft_consensus.cc:2468] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:15.085049  6957 raft_consensus.cc:2468] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:15.086084  6772 leader_election.cc:304] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:15.086813  7022 raft_consensus.cc:2804] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:15.086215  6704 catalog_manager.cc:5697] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.087193  7022 raft_consensus.cc:493] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.087519  7022 raft_consensus.cc:3060] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.093410  7022 raft_consensus.cc:515] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.095399  7022 leader_election.cc:290] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.096006  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383656a55f204d10ba97e89f81eff725" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:15.096380  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383656a55f204d10ba97e89f81eff725" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:15.096562  6883 raft_consensus.cc:3060] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.096886  6957 raft_consensus.cc:3060] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.101529  6883 raft_consensus.cc:2468] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:15.101756  6957 raft_consensus.cc:2468] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:15.102588  6771 leader_election.cc:304] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:15.103335  7022 raft_consensus.cc:2804] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:15.103701  7022 raft_consensus.cc:697] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:15.104315  7022 consensus_queue.cc:237] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.111114  6704 catalog_manager.cc:5697] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.198642  7022 consensus_queue.cc:1048] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.209697  7022 consensus_queue.cc:1048] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.259122  6957 raft_consensus.cc:3060] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.266930  7022 consensus_queue.cc:1048] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.277295  7005 consensus_queue.cc:1048] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.285586  6957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
mode: GRACEFUL
new_leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:27:15.286352  6957 raft_consensus.cc:606] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Received request to transfer leadership to TS 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:15.298187  7035 consensus_queue.cc:1048] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.304870  7003 raft_consensus.cc:993] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8: : Instructing follower 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:15.305325  7003 raft_consensus.cc:1081] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Signalling peer 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:15.305614  6883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
mode: GRACEFUL
new_leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:40634
I20260709 12:27:15.306233  6883 raft_consensus.cc:606] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Received request to transfer leadership to TS 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:15.307533  6808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:44420
I20260709 12:27:15.310616  6808 raft_consensus.cc:493] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.311012  6808 raft_consensus.cc:3060] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.321731  7035 consensus_queue.cc:1048] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.322070  6808 raft_consensus.cc:515] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.323629  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "383656a55f204d10ba97e89f81eff725"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
mode: GRACEFUL
new_leader_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:44432
I20260709 12:27:15.324301  6806 raft_consensus.cc:606] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Received request to transfer leadership to TS f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:15.326983  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:15.331537  6808 leader_election.cc:290] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.333853  6956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
mode: GRACEFUL
new_leader_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:27:15.334446  6956 raft_consensus.cc:606] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Received request to transfer leadership to TS f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:15.334406  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1880578ebd254aecbb480bca936aea7b" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:15.334998  6957 raft_consensus.cc:3055] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.335304  6957 raft_consensus.cc:740] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:15.336190  6957 consensus_queue.cc:260] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.337411  6957 raft_consensus.cc:3060] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.343505  6957 raft_consensus.cc:2468] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:15.344494  6772 leader_election.cc:304] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:15.345181  7005 raft_consensus.cc:2804] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.345577  7005 raft_consensus.cc:697] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:15.346163  7005 consensus_queue.cc:237] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.352537  6704 catalog_manager.cc:5697] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 1 to 2, leader changed from 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3) to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.412897  7036 consensus_queue.cc:1048] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.421936  6808 raft_consensus.cc:3060] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:15.430019  7004 consensus_queue.cc:1048] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.454619  7035 consensus_queue.cc:1048] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.464785  7035 consensus_queue.cc:1048] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.471662  7046 raft_consensus.cc:993] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8: : Instructing follower f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:15.472167  7035 raft_consensus.cc:1081] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Signalling peer f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:15.473523  6883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:40632
I20260709 12:27:15.474100  6883 raft_consensus.cc:493] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.474364  6883 raft_consensus.cc:3060] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.479339  6883 raft_consensus.cc:515] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.480953  6883 leader_election.cc:290] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.482275  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:15.482539  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fc3402494c718fd85c5ec581181d" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:15.482909  6808 raft_consensus.cc:3060] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.483295  6957 raft_consensus.cc:3055] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.483677  6957 raft_consensus.cc:740] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:15.484568  6957 consensus_queue.cc:260] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.486400  6957 raft_consensus.cc:3060] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.489617  6808 raft_consensus.cc:2468] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:15.490671  6847 leader_election.cc:304] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:15.491421  7004 raft_consensus.cc:2804] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.491784  6957 raft_consensus.cc:2468] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:15.491844  7004 raft_consensus.cc:697] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:15.492892  7004 consensus_queue.cc:237] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.498660  6704 catalog_manager.cc:5697] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 1 to 2, leader changed from 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3) to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.541415  7004 consensus_queue.cc:1048] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.552559  7036 consensus_queue.cc:1048] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.556903  7036 consensus_queue.cc:1048] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.557837  7035 consensus_queue.cc:1048] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.571293  7035 consensus_queue.cc:1048] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.575181  7004 consensus_queue.cc:1048] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.585776  7036 raft_consensus.cc:993] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de: : Instructing follower 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:15.586259  7004 raft_consensus.cc:1081] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Signalling peer 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:15.587889  6808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:44404
I20260709 12:27:15.588413  6808 raft_consensus.cc:493] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.588701  6808 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.593554  6808 raft_consensus.cc:515] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.595202  6808 leader_election.cc:290] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.595917  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:15.596180  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:15.596472  6883 raft_consensus.cc:3055] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.596733  6956 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.596763  6883 raft_consensus.cc:740] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:15.597517  6883 consensus_queue.cc:260] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.598440  6883 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.601823  6956 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:15.602885  6772 leader_election.cc:304] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:15.603386  6883 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:15.603636  7005 raft_consensus.cc:2804] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.604188  7005 raft_consensus.cc:697] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:15.604856  7005 consensus_queue.cc:237] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.610689  6706 catalog_manager.cc:5697] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 1 to 2, leader changed from f4a5591702044cabac2e3d0e0c7683de (127.29.9.2) to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.615945  7005 consensus_queue.cc:1048] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.622766  7023 raft_consensus.cc:993] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73: : Instructing follower f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:15.623234  7022 raft_consensus.cc:1081] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Signalling peer f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:15.624862  6882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "383656a55f204d10ba97e89f81eff725"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:40622
I20260709 12:27:15.626021  6882 raft_consensus.cc:493] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.626336  6882 raft_consensus.cc:3060] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.628769  7005 consensus_queue.cc:1048] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:15.634428  6882 raft_consensus.cc:515] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.638747  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383656a55f204d10ba97e89f81eff725" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:15.639333  6808 raft_consensus.cc:3055] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.639663  6808 raft_consensus.cc:740] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:15.640460  6882 leader_election.cc:290] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:15.640475  6808 consensus_queue.cc:260] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.641494  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383656a55f204d10ba97e89f81eff725" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:15.642012  6808 raft_consensus.cc:3060] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.642108  6956 raft_consensus.cc:3060] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.647796  6808 raft_consensus.cc:2468] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:15.648661  6956 raft_consensus.cc:2468] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:15.648936  6847 leader_election.cc:304] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:15.649797  7004 raft_consensus.cc:2804] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.650205  7004 raft_consensus.cc:697] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:15.650992  7004 consensus_queue.cc:237] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:15.657826  6704 catalog_manager.cc:5697] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 1 to 2, leader changed from 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1) to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.772738  6956 raft_consensus.cc:1275] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.774015  7005 consensus_queue.cc:1048] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.783578  6882 raft_consensus.cc:3060] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.790165  6882 raft_consensus.cc:1275] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.791389  7076 consensus_queue.cc:1048] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.965833  6808 raft_consensus.cc:1275] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.967110  7004 consensus_queue.cc:1048] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.976126  6956 raft_consensus.cc:1275] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:15.977576  7037 consensus_queue.cc:1048] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.030073  6806 raft_consensus.cc:1275] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.031255  7004 consensus_queue.cc:1048] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.038720  6957 raft_consensus.cc:1275] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.040298  7077 consensus_queue.cc:1048] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.095669  6957 raft_consensus.cc:1275] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.096961  7076 consensus_queue.cc:1048] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.104229  6882 raft_consensus.cc:1275] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.105762  7076 consensus_queue.cc:1048] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:17.508198  6737 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff3a0 after lost signal to thread 29735
W20260709 12:27:17.509166  6737 debug-util.cc:398] Leaking SignalData structure 0x7b08000edba0 after lost signal to thread 6740
W20260709 12:27:17.510172  6737 debug-util.cc:398] Leaking SignalData structure 0x7b0800307240 after lost signal to thread 6832
W20260709 12:27:17.511061  6737 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1be0 after lost signal to thread 6907
W20260709 12:27:17.511972  6737 debug-util.cc:398] Leaking SignalData structure 0x7b080007f7a0 after lost signal to thread 6981
I20260709 12:27:18.482986  6704 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46026:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:18.486086  6704 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:18.547186  6791 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70530b024b4444835664e0aa398348 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:18.548653  6869 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70530b024b4444835664e0aa398348 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:18.550304  6869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70530b024b4444835664e0aa398348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.551980  6795 tablet_service.cc:1511] Processing CreateTablet for tablet d3a719f022a548578e7f58ce6743a1ea (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:18.552979  6940 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70530b024b4444835664e0aa398348 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:18.549247  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70530b024b4444835664e0aa398348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.554513  6940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70530b024b4444835664e0aa398348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.559130  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a719f022a548578e7f58ce6743a1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.562310  6867 tablet_service.cc:1511] Processing CreateTablet for tablet d3a719f022a548578e7f58ce6743a1ea (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:18.563901  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a719f022a548578e7f58ce6743a1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.575373  6939 tablet_service.cc:1511] Processing CreateTablet for tablet d3a719f022a548578e7f58ce6743a1ea (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:18.576849  6939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a719f022a548578e7f58ce6743a1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.590641  6790 tablet_service.cc:1511] Processing CreateTablet for tablet 93724e4ed6f844f9a9d04df23cd8a637 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:18.592152  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93724e4ed6f844f9a9d04df23cd8a637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.604396  6872 tablet_service.cc:1511] Processing CreateTablet for tablet 93724e4ed6f844f9a9d04df23cd8a637 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:18.605913  6872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93724e4ed6f844f9a9d04df23cd8a637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.613639  6945 tablet_service.cc:1511] Processing CreateTablet for tablet 93724e4ed6f844f9a9d04df23cd8a637 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:18.615047  6945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93724e4ed6f844f9a9d04df23cd8a637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.626037  7091 tablet_bootstrap.cc:492] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:18.636683  6796 tablet_service.cc:1511] Processing CreateTablet for tablet d611f0ff9fe14e0f808abac8eaf8f01b (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:18.638887  6796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d611f0ff9fe14e0f808abac8eaf8f01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.639153  7091 tablet_bootstrap.cc:654] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.652237  6868 tablet_service.cc:1511] Processing CreateTablet for tablet d611f0ff9fe14e0f808abac8eaf8f01b (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:18.653739  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d611f0ff9fe14e0f808abac8eaf8f01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.657622  6870 tablet_service.cc:1511] Processing CreateTablet for tablet e124c203f868468d8ac35b644fb141c5 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:18.659165  6870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e124c203f868468d8ac35b644fb141c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.659770  6797 tablet_service.cc:1511] Processing CreateTablet for tablet e124c203f868468d8ac35b644fb141c5 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:18.661183  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e124c203f868468d8ac35b644fb141c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.668093  6941 tablet_service.cc:1511] Processing CreateTablet for tablet e124c203f868468d8ac35b644fb141c5 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:18.669561  6941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e124c203f868468d8ac35b644fb141c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.673934  7092 tablet_bootstrap.cc:492] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:18.684228  6790 tablet_service.cc:1511] Processing CreateTablet for tablet 9885261bbb024513942abcdb9501e46c (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:18.685726  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9885261bbb024513942abcdb9501e46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.689347  6867 tablet_service.cc:1511] Processing CreateTablet for tablet 50c83b5ab9fa47ba97834d22114c95ac (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:18.690862  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c83b5ab9fa47ba97834d22114c95ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.712425  7092 tablet_bootstrap.cc:654] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.696159  6795 tablet_service.cc:1511] Processing CreateTablet for tablet 50c83b5ab9fa47ba97834d22114c95ac (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:18.722750  6795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c83b5ab9fa47ba97834d22114c95ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.726238  7093 tablet_bootstrap.cc:492] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:18.709142  6939 tablet_service.cc:1511] Processing CreateTablet for tablet 50c83b5ab9fa47ba97834d22114c95ac (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:18.727533  6939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c83b5ab9fa47ba97834d22114c95ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.730700  7091 tablet_bootstrap.cc:492] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:18.731336  7091 ts_tablet_manager.cc:1403] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.009s
I20260709 12:27:18.734920  7091 raft_consensus.cc:359] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.736131  7091 raft_consensus.cc:385] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.736508  7091 raft_consensus.cc:740] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.737390  7091 consensus_queue.cc:260] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.738667  6940 tablet_service.cc:1511] Processing CreateTablet for tablet 9885261bbb024513942abcdb9501e46c (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:18.740236  6940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9885261bbb024513942abcdb9501e46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.720784  6945 tablet_service.cc:1511] Processing CreateTablet for tablet d611f0ff9fe14e0f808abac8eaf8f01b (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:18.741271  6945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d611f0ff9fe14e0f808abac8eaf8f01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.751140  6791 tablet_service.cc:1511] Processing CreateTablet for tablet bb4b7ee27e674ed38154df6db1103ebf (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:18.734917  6872 tablet_service.cc:1511] Processing CreateTablet for tablet 9885261bbb024513942abcdb9501e46c (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:18.752630  6791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4b7ee27e674ed38154df6db1103ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.757131  6872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9885261bbb024513942abcdb9501e46c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.767033  6867 tablet_service.cc:1511] Processing CreateTablet for tablet bb4b7ee27e674ed38154df6db1103ebf (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:18.768589  6867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4b7ee27e674ed38154df6db1103ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.769934  7091 ts_tablet_manager.cc:1434] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.005s
I20260709 12:27:18.778075  7092 tablet_bootstrap.cc:492] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:18.785882  7092 ts_tablet_manager.cc:1403] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.112s	user 0.007s	sys 0.008s
I20260709 12:27:18.786078  7036 raft_consensus.cc:493] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.786664  7036 raft_consensus.cc:515] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.788900  7036 leader_election.cc:290] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:18.778349  6946 tablet_service.cc:1511] Processing CreateTablet for tablet bb4b7ee27e674ed38154df6db1103ebf (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:18.790189  6946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4b7ee27e674ed38154df6db1103ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.790494  7092 raft_consensus.cc:359] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.791285  7092 raft_consensus.cc:385] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.780368  6790 tablet_service.cc:1511] Processing CreateTablet for tablet b12285b5acd34f34ada2f40bfd56a1f4 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:18.772943  7093 tablet_bootstrap.cc:654] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.795258  7091 tablet_bootstrap.cc:492] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:18.796234  6790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12285b5acd34f34ada2f40bfd56a1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.791580  7092 raft_consensus.cc:740] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.803543  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:18.803710  7092 consensus_queue.cc:260] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
W20260709 12:27:18.805936  6847 leader_election.cc:343] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:18.806825  7092 ts_tablet_manager.cc:1434] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:27:18.807943  7092 tablet_bootstrap.cc:492] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:18.801285  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:18.815034  7092 tablet_bootstrap.cc:654] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:18.815330  6847 leader_election.cc:343] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:18.815888  6847 leader_election.cc:304] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:18.817111  7036 raft_consensus.cc:2749] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:18.823505  6940 tablet_service.cc:1511] Processing CreateTablet for tablet b12285b5acd34f34ada2f40bfd56a1f4 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:18.828369  7093 tablet_bootstrap.cc:492] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:18.829083  7093 ts_tablet_manager.cc:1403] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.024s
I20260709 12:27:18.830317  6940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12285b5acd34f34ada2f40bfd56a1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.830410  7091 tablet_bootstrap.cc:654] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.832324  7093 raft_consensus.cc:359] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.833340  7093 raft_consensus.cc:385] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.833721  7093 raft_consensus.cc:740] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.834623  7093 consensus_queue.cc:260] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.840692  6872 tablet_service.cc:1511] Processing CreateTablet for tablet b12285b5acd34f34ada2f40bfd56a1f4 (DEFAULT_TABLE table=soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:18.843742  6872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12285b5acd34f34ada2f40bfd56a1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:18.845186  7093 ts_tablet_manager.cc:1434] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:27:18.849680  7093 tablet_bootstrap.cc:492] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:18.855479  7092 tablet_bootstrap.cc:492] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:18.856232  7092 ts_tablet_manager.cc:1403] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.006s
I20260709 12:27:18.856753  7093 tablet_bootstrap.cc:654] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.857741  7091 tablet_bootstrap.cc:492] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:18.858187  7091 ts_tablet_manager.cc:1403] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.001s
I20260709 12:27:18.859534  7092 raft_consensus.cc:359] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.860636  7092 raft_consensus.cc:385] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.861284  7092 raft_consensus.cc:740] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.862335  7092 consensus_queue.cc:260] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.866417  7091 raft_consensus.cc:359] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.866972  7092 ts_tablet_manager.cc:1434] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:18.868204  7092 tablet_bootstrap.cc:492] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:18.867292  7091 raft_consensus.cc:385] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.870230  7091 raft_consensus.cc:740] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.871191  7091 consensus_queue.cc:260] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.873803  7091 ts_tablet_manager.cc:1434] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:27:18.874897  7091 tablet_bootstrap.cc:492] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:18.881551  7091 tablet_bootstrap.cc:654] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.883774  7093 tablet_bootstrap.cc:492] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:18.884450  7093 ts_tablet_manager.cc:1403] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.008s
I20260709 12:27:18.887682  7093 raft_consensus.cc:359] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.888595  7093 raft_consensus.cc:385] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.888950  7093 raft_consensus.cc:740] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.889842  7093 consensus_queue.cc:260] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.891084  7092 tablet_bootstrap.cc:654] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.892318  7093 ts_tablet_manager.cc:1434] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:27:18.893389  7093 tablet_bootstrap.cc:492] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:18.900781  7093 tablet_bootstrap.cc:654] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:18.908699  6754 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:18.909941  7093 tablet_bootstrap.cc:492] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:18.910522  7093 ts_tablet_manager.cc:1403] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 12:27:18.911988  7092 tablet_bootstrap.cc:492] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:18.912593  7092 ts_tablet_manager.cc:1403] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:27:18.913581  7091 tablet_bootstrap.cc:492] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:18.913658  7093 raft_consensus.cc:359] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.914223  7091 ts_tablet_manager.cc:1403] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.019s
I20260709 12:27:18.914542  7093 raft_consensus.cc:385] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.914860  7093 raft_consensus.cc:740] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.915642  7093 consensus_queue.cc:260] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.915707  7092 raft_consensus.cc:359] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.917656  7091 raft_consensus.cc:359] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.918473  7093 ts_tablet_manager.cc:1434] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:27:18.918497  7091 raft_consensus.cc:385] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.919240  7091 raft_consensus.cc:740] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.920208  7091 consensus_queue.cc:260] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.921010  7093 tablet_bootstrap.cc:492] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:18.923677  7091 ts_tablet_manager.cc:1434] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:18.924887  7091 tablet_bootstrap.cc:492] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:18.928164  7093 tablet_bootstrap.cc:654] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.931293  7091 tablet_bootstrap.cc:654] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.939275  7091 tablet_bootstrap.cc:492] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:18.939882  7091 ts_tablet_manager.cc:1403] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:27:18.943596  7091 raft_consensus.cc:359] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.945494  7091 raft_consensus.cc:385] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.945850  7091 raft_consensus.cc:740] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.947013  7093 tablet_bootstrap.cc:492] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:18.946635  7091 consensus_queue.cc:260] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.947652  7093 ts_tablet_manager.cc:1403] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.013s
I20260709 12:27:18.949200  7091 ts_tablet_manager.cc:1434] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:18.950309  7091 tablet_bootstrap.cc:492] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:18.950755  7093 raft_consensus.cc:359] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.951573  7093 raft_consensus.cc:385] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.951923  7093 raft_consensus.cc:740] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.952713  7093 consensus_queue.cc:260] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.956436  7034 raft_consensus.cc:493] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.956977  7034 raft_consensus.cc:515] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.957273  7093 ts_tablet_manager.cc:1434] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:18.957316  7091 tablet_bootstrap.cc:654] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.958626  7093 tablet_bootstrap.cc:492] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:18.965804  7093 tablet_bootstrap.cc:654] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:18.969062  7034 leader_election.cc:290] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:18.974109  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:18.916620  7092 raft_consensus.cc:385] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:18.977787  7092 raft_consensus.cc:740] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:18.976310  7034 raft_consensus.cc:493] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.974912  6808 raft_consensus.cc:2468] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:18.981756  7092 consensus_queue.cc:260] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.981432  7034 raft_consensus.cc:515] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:18.978502  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:18.984321  6921 leader_election.cc:304] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:18.984841  6883 raft_consensus.cc:2468] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:18.991545  7034 leader_election.cc:290] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:18.992419  7034 raft_consensus.cc:2804] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:18.992802  7034 raft_consensus.cc:493] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.993145  7034 raft_consensus.cc:3060] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:18.997192  7091 tablet_bootstrap.cc:492] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:18.998045  7091 ts_tablet_manager.cc:1403] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.004s
I20260709 12:27:18.994884  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.001273  6808 raft_consensus.cc:2468] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:19.002308  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.002998  6883 raft_consensus.cc:2468] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:19.004590  6920 leader_election.cc:304] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:19.005574  7109 raft_consensus.cc:2804] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.005926  7109 raft_consensus.cc:493] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.006196  7109 raft_consensus.cc:3060] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.010329  7093 tablet_bootstrap.cc:492] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:19.010914  7093 ts_tablet_manager.cc:1403] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.012s
I20260709 12:27:19.011200  7091 raft_consensus.cc:359] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.011828  7092 ts_tablet_manager.cc:1434] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.099s	user 0.026s	sys 0.005s
I20260709 12:27:19.011996  7091 raft_consensus.cc:385] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.012382  7091 raft_consensus.cc:740] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.013104  7091 consensus_queue.cc:260] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.013834  7093 raft_consensus.cc:359] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.014547  7093 raft_consensus.cc:385] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.014809  7093 raft_consensus.cc:740] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.015374  7091 ts_tablet_manager.cc:1434] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 12:27:19.015511  7093 consensus_queue.cc:260] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.016626  7091 tablet_bootstrap.cc:492] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:19.025058  7093 ts_tablet_manager.cc:1434] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:19.010306  7034 raft_consensus.cc:515] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.031073  7093 tablet_bootstrap.cc:492] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:19.030915  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:19.034147  6808 raft_consensus.cc:3060] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.036160  7091 tablet_bootstrap.cc:654] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.032907  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:19.037550  6883 raft_consensus.cc:3060] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.040232  7093 tablet_bootstrap.cc:654] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.029772  7092 tablet_bootstrap.cc:492] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:19.044057  6808 raft_consensus.cc:2468] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:19.046252  6921 leader_election.cc:304] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:19.031612  7034 leader_election.cc:290] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:19.047492  7034 raft_consensus.cc:2804] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.048169  7034 raft_consensus.cc:697] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:19.049312  7034 consensus_queue.cc:237] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.047432  7092 tablet_bootstrap.cc:654] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.053829  7109 raft_consensus.cc:515] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.055243  6883 raft_consensus.cc:2468] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:19.060142  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:19.060863  6806 raft_consensus.cc:3060] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.062530  7108 raft_consensus.cc:493] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.063128  7108 raft_consensus.cc:515] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.065456  7108 leader_election.cc:290] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:19.068096  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.068936  6808 raft_consensus.cc:2468] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:19.070132  6921 leader_election.cc:304] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:19.071086  7108 raft_consensus.cc:2804] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.071502  7108 raft_consensus.cc:493] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.071962  7108 raft_consensus.cc:3060] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.073839  7109 leader_election.cc:290] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:19.072106  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.074203  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:19.074918  6882 raft_consensus.cc:3060] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.095280  6703 catalog_manager.cc:5697] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.071573  6806 raft_consensus.cc:2468] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:19.074860  6883 raft_consensus.cc:2468] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 0.
I20260709 12:27:19.101898  6921 leader_election.cc:304] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:19.104177  6882 raft_consensus.cc:2468] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:19.105551  7034 raft_consensus.cc:2804] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.110817  7034 raft_consensus.cc:697] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:19.111747  7034 consensus_queue.cc:237] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.109727  7108 raft_consensus.cc:515] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.121306  7093 tablet_bootstrap.cc:492] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:19.123219  7092 tablet_bootstrap.cc:492] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:19.123396  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:19.124104  7092 ts_tablet_manager.cc:1403] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.026s
I20260709 12:27:19.124207  6806 raft_consensus.cc:3060] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.125244  7108 leader_election.cc:290] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:19.126325  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:19.127000  6882 raft_consensus.cc:3060] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.127660  7091 tablet_bootstrap.cc:492] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:19.128249  7091 ts_tablet_manager.cc:1403] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.112s	user 0.043s	sys 0.026s
I20260709 12:27:19.128465  7036 raft_consensus.cc:493] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.128973  7036 raft_consensus.cc:515] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.131047  7036 leader_election.cc:290] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.131289  7091 raft_consensus.cc:359] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.132112  7091 raft_consensus.cc:385] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.132444  7091 raft_consensus.cc:740] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.132709  6806 raft_consensus.cc:2468] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:19.133390  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:19.133693  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.133936  6921 leader_election.cc:304] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:19.124454  7093 ts_tablet_manager.cc:1403] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.028s
W20260709 12:27:19.134965  6847 leader_election.cc:343] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:19.135715  6847 leader_election.cc:343] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:19.136143  6847 leader_election.cc:304] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:19.136294  7092 raft_consensus.cc:359] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.137161  7092 raft_consensus.cc:385] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.134436  6882 raft_consensus.cc:2468] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 1.
I20260709 12:27:19.137245  7108 raft_consensus.cc:2804] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.137984  7108 raft_consensus.cc:697] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:19.133364  7091 consensus_queue.cc:260] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.137528  7092 raft_consensus.cc:740] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.139030  7108 consensus_queue.cc:237] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.139669  7092 consensus_queue.cc:260] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.140280  7091 ts_tablet_manager.cc:1434] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:27:19.136899  7036 raft_consensus.cc:2749] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:19.141456  7091 tablet_bootstrap.cc:492] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:19.142068  7092 ts_tablet_manager.cc:1434] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:27:19.143409  7092 tablet_bootstrap.cc:492] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:19.137925  7093 raft_consensus.cc:359] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.144640  7093 raft_consensus.cc:385] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.145370  7093 raft_consensus.cc:740] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.147004  7093 consensus_queue.cc:260] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.149078  7091 tablet_bootstrap.cc:654] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.150759  7092 tablet_bootstrap.cc:654] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.154134  7093 ts_tablet_manager.cc:1434] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:27:19.155393  7093 tablet_bootstrap.cc:492] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:19.163560  7092 tablet_bootstrap.cc:492] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:19.164283  7092 ts_tablet_manager.cc:1403] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 12:27:19.167235  7093 tablet_bootstrap.cc:654] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.167469  7092 raft_consensus.cc:359] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.170302  7091 tablet_bootstrap.cc:492] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:19.170630  7092 raft_consensus.cc:385] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.170986  7091 ts_tablet_manager.cc:1403] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 12:27:19.171028  7092 raft_consensus.cc:740] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.172539  7093 tablet_bootstrap.cc:492] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:19.172147  7092 consensus_queue.cc:260] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.173107  7093 ts_tablet_manager.cc:1403] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:27:19.174201  7091 raft_consensus.cc:359] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.174827  7092 ts_tablet_manager.cc:1434] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:19.174975  7091 raft_consensus.cc:385] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.175424  7091 raft_consensus.cc:740] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.176146  7092 tablet_bootstrap.cc:492] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:19.176129  7093 raft_consensus.cc:359] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.176995  7093 raft_consensus.cc:385] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.176244  7091 consensus_queue.cc:260] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.177292  7093 raft_consensus.cc:740] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.178166  7093 consensus_queue.cc:260] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.179108  7091 ts_tablet_manager.cc:1434] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:27:19.180155  7091 tablet_bootstrap.cc:492] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:19.183535  7092 tablet_bootstrap.cc:654] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.183615  7093 ts_tablet_manager.cc:1434] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:27:19.184821  7093 tablet_bootstrap.cc:492] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:19.187141  7091 tablet_bootstrap.cc:654] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.191165  7093 tablet_bootstrap.cc:654] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.200700  7114 raft_consensus.cc:493] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.201357  7114 raft_consensus.cc:515] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.202833  7076 raft_consensus.cc:493] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.203436  7076 raft_consensus.cc:515] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.205559  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:19.207003  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9885261bbb024513942abcdb9501e46c" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.207685  6882 raft_consensus.cc:2468] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:19.208071  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9885261bbb024513942abcdb9501e46c" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
W20260709 12:27:19.208281  6847 leader_election.cc:343] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:19.208791  6956 raft_consensus.cc:2468] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:19.205864  7076 leader_election.cc:290] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.203642  7114 leader_election.cc:290] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.209982  6771 leader_election.cc:304] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:19.205889  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.211253  6806 raft_consensus.cc:2468] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:19.212670  6847 leader_election.cc:304] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:19.213995  7114 raft_consensus.cc:2804] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.214440  7114 raft_consensus.cc:493] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.214823  7114 raft_consensus.cc:3060] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.217008  7076 raft_consensus.cc:2804] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.217504  7076 raft_consensus.cc:493] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.217840  7076 raft_consensus.cc:3060] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.218145  7091 tablet_bootstrap.cc:492] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:19.218773  7091 ts_tablet_manager.cc:1403] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.008s
I20260709 12:27:19.221900  7091 raft_consensus.cc:359] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.227986  7091 raft_consensus.cc:385] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.228385  7091 raft_consensus.cc:740] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.229312  7091 consensus_queue.cc:260] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.232411  7093 tablet_bootstrap.cc:492] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:19.232913  7093 ts_tablet_manager.cc:1403] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.048s	user 0.031s	sys 0.010s
I20260709 12:27:19.234293  7091 ts_tablet_manager.cc:1434] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:27:19.235296  7091 tablet_bootstrap.cc:492] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: Bootstrap starting.
I20260709 12:27:19.235833  7093 raft_consensus.cc:359] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.236527  7093 raft_consensus.cc:385] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.236807  7093 raft_consensus.cc:740] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.237661  7093 consensus_queue.cc:260] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.230963  7076 raft_consensus.cc:515] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.231438  7114 raft_consensus.cc:515] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.241158  7114 leader_election.cc:290] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.241978  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:19.243649  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:19.244287  6806 raft_consensus.cc:3060] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.244899  7076 leader_election.cc:290] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.245488  7076 raft_consensus.cc:493] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.248309  7076 raft_consensus.cc:515] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
W20260709 12:27:19.248646  6847 leader_election.cc:343] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:19.250348  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9885261bbb024513942abcdb9501e46c" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:19.247927  7091 tablet_bootstrap.cc:654] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.250936  6882 raft_consensus.cc:3060] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.255018  7076 leader_election.cc:290] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.256109  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.256743  6883 raft_consensus.cc:2468] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:19.256729  6806 raft_consensus.cc:2468] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 1.
I20260709 12:27:19.251577  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9885261bbb024513942abcdb9501e46c" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:19.259310  6956 raft_consensus.cc:3060] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.259876  7093 ts_tablet_manager.cc:1434] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:27:19.260950  7093 tablet_bootstrap.cc:492] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73: Bootstrap starting.
I20260709 12:27:19.261898  6771 leader_election.cc:304] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:19.252856  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:19.263902  7076 raft_consensus.cc:2804] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.264041  6957 raft_consensus.cc:2468] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:19.265165  6847 leader_election.cc:304] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:19.266381  7114 raft_consensus.cc:2804] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.266891  7114 raft_consensus.cc:697] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:19.267132  6882 raft_consensus.cc:2468] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:19.268318  6771 leader_election.cc:304] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:19.269172  7104 raft_consensus.cc:2804] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.268775  7114 consensus_queue.cc:237] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.264350  7076 raft_consensus.cc:493] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.273918  7076 raft_consensus.cc:3060] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.280339  6956 raft_consensus.cc:2468] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:19.282819  7093 tablet_bootstrap.cc:654] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.286084  7091 tablet_bootstrap.cc:492] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: No bootstrap required, opened a new log
I20260709 12:27:19.286700  7091 ts_tablet_manager.cc:1403] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.015s
I20260709 12:27:19.287381  7104 raft_consensus.cc:697] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:19.288316  7104 consensus_queue.cc:237] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.289865  7091 raft_consensus.cc:359] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.290695  7091 raft_consensus.cc:385] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.291044  7091 raft_consensus.cc:740] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.291960  7091 consensus_queue.cc:260] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.292403  7127 raft_consensus.cc:493] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.292959  7127 raft_consensus.cc:515] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.293038  6705 catalog_manager.cc:5697] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.294795  7091 ts_tablet_manager.cc:1434] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:19.296030  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.296700  6882 raft_consensus.cc:2468] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:19.298038  6771 leader_election.cc:304] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:19.298385  7093 tablet_bootstrap.cc:492] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73: No bootstrap required, opened a new log
I20260709 12:27:19.298868  7093 ts_tablet_manager.cc:1403] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.002s
I20260709 12:27:19.299714  7127 leader_election.cc:290] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.300844  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:19.301528  7093 raft_consensus.cc:359] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.302205  7093 raft_consensus.cc:385] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.302474  7093 raft_consensus.cc:740] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.303156  7093 consensus_queue.cc:260] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.304862  7093 ts_tablet_manager.cc:1434] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:19.306181  6706 catalog_manager.cc:5697] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 0 to 1, leader changed from <none> to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:19.307619  6772 leader_election.cc:343] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:19.285959  7076 raft_consensus.cc:515] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.310878  7130 raft_consensus.cc:2804] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.311357  7130 raft_consensus.cc:493] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.311751  7130 raft_consensus.cc:3060] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.313476  7092 tablet_bootstrap.cc:492] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:19.314042  7092 ts_tablet_manager.cc:1403] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.138s	user 0.033s	sys 0.048s
I20260709 12:27:19.314111  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:19.314726  6882 raft_consensus.cc:3060] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.316304  7076 leader_election.cc:290] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.317559  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:19.318157  6956 raft_consensus.cc:3060] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.317230  6705 catalog_manager.cc:5697] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 1 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.324016  7130 raft_consensus.cc:515] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.325670  6956 raft_consensus.cc:2468] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:19.327659  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:19.328389  6883 raft_consensus.cc:3060] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.330034  6772 leader_election.cc:304] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:19.331141  7104 raft_consensus.cc:2804] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.331529  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:19.331604  7104 raft_consensus.cc:697] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:19.326658  7130 leader_election.cc:290] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
W20260709 12:27:19.334268  6772 leader_election.cc:343] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:19.334749  7092 raft_consensus.cc:359] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.335244  7104 consensus_queue.cc:237] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.342643  6883 raft_consensus.cc:2468] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:19.335312  7092 raft_consensus.cc:385] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.343878  6771 leader_election.cc:304] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:19.344091  7092 raft_consensus.cc:740] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.344888  7092 consensus_queue.cc:260] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.346293  7130 raft_consensus.cc:2804] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.346808  7130 raft_consensus.cc:697] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:19.347160  7092 ts_tablet_manager.cc:1434] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 12:27:19.347570  7130 consensus_queue.cc:237] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.348184  7092 tablet_bootstrap.cc:492] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:19.348444  7076 raft_consensus.cc:493] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.348941  7076 raft_consensus.cc:515] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.351009  7076 leader_election.cc:290] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.352914  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
W20260709 12:27:19.354357  6772 leader_election.cc:343] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:19.352720  6703 catalog_manager.cc:5697] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.358946  7092 tablet_bootstrap.cc:654] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.365351  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.366107  6883 raft_consensus.cc:2468] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 0.
I20260709 12:27:19.367280  6771 leader_election.cc:304] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:19.368211  7104 raft_consensus.cc:2804] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.368566  7104 raft_consensus.cc:493] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.368878  7104 raft_consensus.cc:3060] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.375161  6882 raft_consensus.cc:2468] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:19.376096  7104 raft_consensus.cc:515] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.378767  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:19.379308  6883 raft_consensus.cc:3060] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.379988  7104 leader_election.cc:290] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.381047  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
W20260709 12:27:19.382436  6772 leader_election.cc:343] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:19.392385  6703 catalog_manager.cc:5697] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.394243  6703 catalog_manager.cc:5697] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.396023  7092 tablet_bootstrap.cc:492] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:19.396265  6883 raft_consensus.cc:2468] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 1.
I20260709 12:27:19.396574  7092 ts_tablet_manager.cc:1403] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.016s
I20260709 12:27:19.397746  6771 leader_election.cc:304] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:19.399681  7130 raft_consensus.cc:2804] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.399431  7092 raft_consensus.cc:359] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.400297  7092 raft_consensus.cc:385] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.400354  7130 raft_consensus.cc:697] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:19.400902  7092 raft_consensus.cc:740] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.401690  7130 consensus_queue.cc:237] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.401818  7092 consensus_queue.cc:260] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.407557  7092 ts_tablet_manager.cc:1434] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:27:19.409897  7092 tablet_bootstrap.cc:492] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:19.420922  7092 tablet_bootstrap.cc:654] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.420318  6703 catalog_manager.cc:5697] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 1 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.427505  7092 tablet_bootstrap.cc:492] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:19.428006  7092 ts_tablet_manager.cc:1403] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:27:19.430331  7092 raft_consensus.cc:359] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.430948  7092 raft_consensus.cc:385] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.431156  7092 raft_consensus.cc:740] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.431702  7092 consensus_queue.cc:260] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.433423  7092 ts_tablet_manager.cc:1434] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:27:19.434613  7092 tablet_bootstrap.cc:492] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8: Bootstrap starting.
I20260709 12:27:19.435046  7108 raft_consensus.cc:493] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.435560  7108 raft_consensus.cc:515] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.437628  7108 leader_election.cc:290] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:19.439393  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.440106  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.440315  6882 raft_consensus.cc:2393] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bd1c1645d1947d28d4652041bce39c8 in current term 1: Already voted for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in this term.
I20260709 12:27:19.442866  6920 leader_election.cc:304] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8; no voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:19.444051  7092 tablet_bootstrap.cc:654] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:19.446138  7108 raft_consensus.cc:3060] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.453307  7108 raft_consensus.cc:2749] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:19.456238  7092 tablet_bootstrap.cc:492] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8: No bootstrap required, opened a new log
I20260709 12:27:19.456727  7092 ts_tablet_manager.cc:1403] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:27:19.458976  7092 raft_consensus.cc:359] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.459606  7092 raft_consensus.cc:385] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:19.459846  7092 raft_consensus.cc:740] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.460383  7092 consensus_queue.cc:260] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.462423  7092 ts_tablet_manager.cc:1434] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:19.494067  7108 consensus_queue.cc:1048] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.500555  7108 consensus_queue.cc:1048] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.520439  7108 consensus_queue.cc:1048] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.539788  7108 consensus_queue.cc:1048] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.540616  7143 raft_consensus.cc:493] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.541127  7143 raft_consensus.cc:515] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.543139  7143 leader_election.cc:290] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:19.545343  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.546255  6808 raft_consensus.cc:2393] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bd1c1645d1947d28d4652041bce39c8 in current term 1: Already voted for candidate f4a5591702044cabac2e3d0e0c7683de in this term.
I20260709 12:27:19.549311  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.557854  6920 leader_election.cc:304] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8; no voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:19.558820  7143 raft_consensus.cc:3060] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.576632  7143 raft_consensus.cc:2749] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:19.626250  7143 raft_consensus.cc:493] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.626703  7143 raft_consensus.cc:515] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.628371  7143 leader_election.cc:290] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:19.629215  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.629475  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4a5591702044cabac2e3d0e0c7683de" is_pre_election: true
I20260709 12:27:19.630650  6882 raft_consensus.cc:2393] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bd1c1645d1947d28d4652041bce39c8 in current term 1: Already voted for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in this term.
I20260709 12:27:19.631536  6920 leader_election.cc:304] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8; no voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:19.632174  7143 raft_consensus.cc:3060] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.639168  7143 raft_consensus.cc:2749] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:19.651023  7114 raft_consensus.cc:493] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.651624  7114 raft_consensus.cc:515] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.653704  7114 leader_election.cc:290] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.654448  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" is_pre_election: true
I20260709 12:27:19.654736  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8" is_pre_election: true
I20260709 12:27:19.655200  6806 raft_consensus.cc:2468] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:19.655315  6957 raft_consensus.cc:2468] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 0.
I20260709 12:27:19.656417  6847 leader_election.cc:304] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:19.657208  7114 raft_consensus.cc:2804] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:19.657586  7114 raft_consensus.cc:493] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.657908  7114 raft_consensus.cc:3060] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.657819  7143 consensus_queue.cc:1048] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:19.665652  7114 raft_consensus.cc:515] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.668812  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:19.669500  6806 raft_consensus.cc:3060] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.674190  7130 consensus_queue.cc:1048] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.674800  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:19.675350  6957 raft_consensus.cc:3060] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:19.684244  7143 consensus_queue.cc:1048] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.685740  7114 leader_election.cc:290] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:19.686810  6957 raft_consensus.cc:2468] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 1.
I20260709 12:27:19.687613  6806 raft_consensus.cc:2468] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 1.
I20260709 12:27:19.691063  6847 leader_election.cc:304] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:19.692972  7036 raft_consensus.cc:2804] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:19.693501  7036 raft_consensus.cc:697] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:19.694329  7036 consensus_queue.cc:237] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:19.735766  7127 consensus_queue.cc:1048] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.739465  6703 catalog_manager.cc:5697] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 0 to 1, leader changed from <none> to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 1 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.745049  7076 consensus_queue.cc:1048] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.760115  7130 consensus_queue.cc:1048] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.770526  7036 consensus_queue.cc:1048] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.801252  7114 consensus_queue.cc:1048] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.843377  7130 consensus_queue.cc:1048] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.856665  7104 consensus_queue.cc:1048] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.871611  7076 consensus_queue.cc:1048] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.884126  7104 consensus_queue.cc:1048] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:19.981839  6957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f70530b024b4444835664e0aa398348"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
mode: GRACEFUL
new_leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:27:19.982558  6957 raft_consensus.cc:606] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Received request to transfer leadership to TS 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:19.988798  6957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
mode: GRACEFUL
new_leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:27:19.989395  6957 raft_consensus.cc:606] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Received request to transfer leadership to TS 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:19.995499  6957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
mode: GRACEFUL
new_leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:59282
I20260709 12:27:19.996191  6957 raft_consensus.cc:606] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Received request to transfer leadership to TS 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:20.001056  6883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
mode: GRACEFUL
new_leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:40634
I20260709 12:27:20.001549  6883 raft_consensus.cc:606] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Received request to transfer leadership to TS 2c9cdabf34e341aeb2a3fd330cf77d73
I20260709 12:27:20.006289  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
mode: GRACEFUL
new_leader_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:44432
I20260709 12:27:20.006910  6806 raft_consensus.cc:606] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Received request to transfer leadership to TS f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:20.012135  6808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
mode: GRACEFUL
new_leader_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:44432
I20260709 12:27:20.012741  6808 raft_consensus.cc:606] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Received request to transfer leadership to TS f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:20.017079  7034 raft_consensus.cc:993] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: : Instructing follower 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.017793  7143 raft_consensus.cc:1081] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Signalling peer 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.018972  6808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9885261bbb024513942abcdb9501e46c"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
mode: GRACEFUL
new_leader_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:44432
I20260709 12:27:20.019749  6808 raft_consensus.cc:606] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Received request to transfer leadership to TS f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:20.019692  6806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:44420
I20260709 12:27:20.020725  6806 raft_consensus.cc:493] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.021117  6806 raft_consensus.cc:3060] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.030328  6806 raft_consensus.cc:515] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.032449  6808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
mode: GRACEFUL
new_leader_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:44432
I20260709 12:27:20.033044  6806 leader_election.cc:290] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.034075  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:20.033197  6808 raft_consensus.cc:606] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Received request to transfer leadership to TS f4a5591702044cabac2e3d0e0c7683de
I20260709 12:27:20.034076  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93724e4ed6f844f9a9d04df23cd8a637" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.034709  6883 raft_consensus.cc:3060] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.035012  6957 raft_consensus.cc:3055] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.035316  6957 raft_consensus.cc:740] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:20.036041  6957 consensus_queue.cc:260] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.037174  6957 raft_consensus.cc:3060] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.040221  6882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
mode: GRACEFUL
new_leader_uuid: "2bd1c1645d1947d28d4652041bce39c8"
 from {username='slave'} at 127.0.0.1:40634
I20260709 12:27:20.040892  6882 raft_consensus.cc:606] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Received request to transfer leadership to TS 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:20.041365  6883 raft_consensus.cc:2468] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.042629  6771 leader_election.cc:304] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:20.043800  7130 raft_consensus.cc:2804] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.044363  7130 raft_consensus.cc:697] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.046291  7130 consensus_queue.cc:237] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.047396  6957 raft_consensus.cc:2468] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.053273  6706 catalog_manager.cc:5697] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 1 to 2, leader changed from 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3) to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.140865  7104 raft_consensus.cc:993] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: : Instructing follower f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.141392  7104 raft_consensus.cc:1081] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Signalling peer f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.143328  6883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9885261bbb024513942abcdb9501e46c"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:40622
I20260709 12:27:20.143925  6883 raft_consensus.cc:493] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.144274  6883 raft_consensus.cc:3060] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.151049  6883 raft_consensus.cc:515] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.153024  6883 leader_election.cc:290] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.153867  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9885261bbb024513942abcdb9501e46c" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:20.154140  6957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9885261bbb024513942abcdb9501e46c" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.154598  6808 raft_consensus.cc:3055] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.154686  6957 raft_consensus.cc:3060] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.154968  6808 raft_consensus.cc:740] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.155769  6808 consensus_queue.cc:260] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.156910  6808 raft_consensus.cc:3060] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.161455  6957 raft_consensus.cc:2468] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.162776  6847 leader_election.cc:304] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:20.163385  6808 raft_consensus.cc:2468] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.163585  7114 raft_consensus.cc:2804] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.164458  7114 raft_consensus.cc:697] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:20.165369  7114 consensus_queue.cc:237] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.173944  7114 consensus_queue.cc:1048] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:20.174389  6706 catalog_manager.cc:5697] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 1 to 2, leader changed from 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1) to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.185868  7157 consensus_queue.cc:1048] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:20.196031  7157 raft_consensus.cc:993] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: : Instructing follower 2bd1c1645d1947d28d4652041bce39c8 to start an election
I20260709 12:27:20.196480  7036 raft_consensus.cc:1081] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Signalling peer 2bd1c1645d1947d28d4652041bce39c8 to start an election
I20260709 12:27:20.198698  6956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
 from {username='slave'} at 127.0.0.1:59278
I20260709 12:27:20.199615  6956 raft_consensus.cc:493] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.200011  6956 raft_consensus.cc:3060] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.204679  7157 raft_consensus.cc:993] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: : Instructing follower 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.205210  7156 raft_consensus.cc:1081] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Signalling peer 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.207008  6808 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:44404
I20260709 12:27:20.207607  6808 raft_consensus.cc:493] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.207990  6808 raft_consensus.cc:3060] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.206776  6956 raft_consensus.cc:515] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.213004  6806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:20.213608  6806 raft_consensus.cc:3060] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.217736  6956 leader_election.cc:290] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:20.220449  6883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12285b5acd34f34ada2f40bfd56a1f4" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:20.221036  6883 raft_consensus.cc:3055] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.221329  6883 raft_consensus.cc:740] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:20.221711  6806 raft_consensus.cc:2468] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 2.
I20260709 12:27:20.222023  6883 consensus_queue.cc:260] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.223016  6921 leader_election.cc:304] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:20.223367  6883 raft_consensus.cc:3060] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.223928  7143 raft_consensus.cc:2804] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.224413  7143 raft_consensus.cc:697] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:20.225210  7143 consensus_queue.cc:237] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.230912  6883 raft_consensus.cc:2468] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 2.
I20260709 12:27:20.235121  6808 raft_consensus.cc:515] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.234717  6703 catalog_manager.cc:5697] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 1 to 2, leader changed from f4a5591702044cabac2e3d0e0c7683de (127.29.9.2) to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.236825  6808 leader_election.cc:290] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.237529  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:20.238147  6882 raft_consensus.cc:3055] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.238428  6882 raft_consensus.cc:740] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:20.238830  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d611f0ff9fe14e0f808abac8eaf8f01b" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.239370  6956 raft_consensus.cc:3060] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.239187  6882 consensus_queue.cc:260] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.251598  6882 raft_consensus.cc:3060] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.259219  6882 raft_consensus.cc:2468] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.259863  7130 raft_consensus.cc:993] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: : Instructing follower f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.260370  7104 raft_consensus.cc:1081] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Signalling peer f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.260360  6771 leader_election.cc:304] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:20.260720  6956 raft_consensus.cc:2468] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.261420  7130 raft_consensus.cc:2804] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.261891  7130 raft_consensus.cc:697] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.262667  7130 consensus_queue.cc:237] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.264590  6882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:40622
I20260709 12:27:20.265151  6882 raft_consensus.cc:493] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.265511  6882 raft_consensus.cc:3060] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.270860  6703 catalog_manager.cc:5697] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 1 to 2, leader changed from f4a5591702044cabac2e3d0e0c7683de (127.29.9.2) to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.271706  6882 raft_consensus.cc:515] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.274205  7108 raft_consensus.cc:993] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: : Instructing follower 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.274717  7143 raft_consensus.cc:1081] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Signalling peer 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.275092  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:20.276113  6808 raft_consensus.cc:3055] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.276378  6808 raft_consensus.cc:740] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.276305  6806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f70530b024b4444835664e0aa398348"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:44420
I20260709 12:27:20.277066  6806 raft_consensus.cc:493] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.277437  6806 raft_consensus.cc:3060] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.277230  6808 consensus_queue.cc:260] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.278342  6808 raft_consensus.cc:3060] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.281562  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c83b5ab9fa47ba97834d22114c95ac" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.282009  6882 leader_election.cc:290] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.282181  6956 raft_consensus.cc:3060] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.286612  6808 raft_consensus.cc:2468] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.287856  6847 leader_election.cc:304] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:20.287897  6806 raft_consensus.cc:515] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.288857  7114 raft_consensus.cc:2804] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.288913  6956 raft_consensus.cc:2468] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.289425  7114 raft_consensus.cc:697] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:20.290351  6806 leader_election.cc:290] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.290264  7114 consensus_queue.cc:237] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.293200  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:20.293252  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70530b024b4444835664e0aa398348" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.293828  6882 raft_consensus.cc:3060] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.293964  6956 raft_consensus.cc:3055] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.294458  6956 raft_consensus.cc:740] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:20.295405  6956 consensus_queue.cc:260] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.296700  6956 raft_consensus.cc:3060] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.300845  6882 raft_consensus.cc:2468] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.301959  6771 leader_election.cc:304] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c9cdabf34e341aeb2a3fd330cf77d73, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:20.301496  6703 catalog_manager.cc:5697] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 1 to 2, leader changed from 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1) to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.306973  7130 raft_consensus.cc:2804] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.310614  7130 raft_consensus.cc:697] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.311407  7130 consensus_queue.cc:237] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.308115  7104 raft_consensus.cc:993] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: : Instructing follower f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.304580  6956 raft_consensus.cc:2468] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.312373  7127 raft_consensus.cc:1081] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Signalling peer f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.313989  6883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:40622
I20260709 12:27:20.316193  6883 raft_consensus.cc:493] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.316521  6883 raft_consensus.cc:3060] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.320852  6706 catalog_manager.cc:5697] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 1 to 2, leader changed from 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3) to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.322937  6883 raft_consensus.cc:515] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.324680  6883 leader_election.cc:290] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.325990  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:20.326133  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4b7ee27e674ed38154df6db1103ebf" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.326572  6808 raft_consensus.cc:3055] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.326740  6956 raft_consensus.cc:3060] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.327633  6808 raft_consensus.cc:740] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.328394  6808 consensus_queue.cc:260] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.329514  6808 raft_consensus.cc:3060] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.335088  7127 raft_consensus.cc:993] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: : Instructing follower f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.335457  6956 raft_consensus.cc:2468] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.335565  7130 raft_consensus.cc:1081] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Signalling peer f4a5591702044cabac2e3d0e0c7683de to start an election
I20260709 12:27:20.336825  6847 leader_election.cc:304] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:20.337591  6882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
 from {username='slave'} at 127.0.0.1:40622
I20260709 12:27:20.337656  7114 raft_consensus.cc:2804] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.338306  6882 raft_consensus.cc:493] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.338390  7114 raft_consensus.cc:697] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:20.338699  6882 raft_consensus.cc:3060] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.339406  6808 raft_consensus.cc:2468] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.339365  7114 consensus_queue.cc:237] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.346693  6882 raft_consensus.cc:515] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.348289  6882 leader_election.cc:290] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.347918  6706 catalog_manager.cc:5697] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 1 to 2, leader changed from 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1) to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.350026  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:20.350102  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e124c203f868468d8ac35b644fb141c5" candidate_uuid: "f4a5591702044cabac2e3d0e0c7683de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.350600  6808 raft_consensus.cc:3055] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.350665  6956 raft_consensus.cc:3060] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.350975  6808 raft_consensus.cc:740] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.351897  6808 consensus_queue.cc:260] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.353196  6808 raft_consensus.cc:3060] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.357563  6956 raft_consensus.cc:2468] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.358783  6847 leader_election.cc:304] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:20.359548  7114 raft_consensus.cc:2804] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.360261  7114 raft_consensus.cc:697] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Becoming Leader. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:20.360327  6808 raft_consensus.cc:2468] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4a5591702044cabac2e3d0e0c7683de in term 2.
I20260709 12:27:20.361130  7114 consensus_queue.cc:237] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.368848  6706 catalog_manager.cc:5697] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de reported cstate change: term changed from 1 to 2, leader changed from 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1) to f4a5591702044cabac2e3d0e0c7683de (127.29.9.2). New cstate: current_term: 2 leader_uuid: "f4a5591702044cabac2e3d0e0c7683de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.465835  6882 raft_consensus.cc:1275] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.466966  7130 consensus_queue.cc:1048] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.474715  6956 raft_consensus.cc:1275] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.477278  7104 consensus_queue.cc:1048] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.558529  6808 raft_consensus.cc:1275] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.559643  7114 consensus_queue.cc:1048] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.570269  7108 raft_consensus.cc:993] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: : Instructing follower 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.570716  7108 raft_consensus.cc:1081] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Signalling peer 2c9cdabf34e341aeb2a3fd330cf77d73 to start an election
I20260709 12:27:20.572616  6806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
 from {username='slave'} at 127.0.0.1:44420
I20260709 12:27:20.573248  6806 raft_consensus.cc:493] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.573625  6806 raft_consensus.cc:3060] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.571362  6956 raft_consensus.cc:1275] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.577214  7036 consensus_queue.cc:1048] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.582165  6806 raft_consensus.cc:515] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.584861  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:20.586331  6882 raft_consensus.cc:3060] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.586499  6956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3a719f022a548578e7f58ce6743a1ea" candidate_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
I20260709 12:27:20.587137  6956 raft_consensus.cc:3055] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.587447  6956 raft_consensus.cc:740] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:20.588343  6956 consensus_queue.cc:260] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.585448  6806 leader_election.cc:290] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Requested vote from peers f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519), 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3:36481)
I20260709 12:27:20.589341  6956 raft_consensus.cc:3060] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.595695  6956 raft_consensus.cc:2468] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.595896  6882 raft_consensus.cc:2468] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9cdabf34e341aeb2a3fd330cf77d73 in term 2.
I20260709 12:27:20.596698  6772 leader_election.cc:304] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:20.597506  7104 raft_consensus.cc:2804] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.597988  7104 raft_consensus.cc:697] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Becoming Leader. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:20.598781  7104 consensus_queue.cc:237] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:20.606788  6706 catalog_manager.cc:5697] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 reported cstate change: term changed from 1 to 2, leader changed from 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3) to 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1). New cstate: current_term: 2 leader_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.650707  6882 raft_consensus.cc:1275] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2bd1c1645d1947d28d4652041bce39c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.651993  7108 consensus_queue.cc:1048] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.660043  6806 raft_consensus.cc:1275] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer 2bd1c1645d1947d28d4652041bce39c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.661615  7034 consensus_queue.cc:1048] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.719457  6806 raft_consensus.cc:1275] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.720826  7036 consensus_queue.cc:1048] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.728479  6956 raft_consensus.cc:1275] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.729702  7156 consensus_queue.cc:1048] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.747190  6956 raft_consensus.cc:1275] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.748194  7156 consensus_queue.cc:1048] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.767975  6806 raft_consensus.cc:1275] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.773309  7036 consensus_queue.cc:1048] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.788841  6882 raft_consensus.cc:1275] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.790378  7104 consensus_queue.cc:1048] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.800649  6956 raft_consensus.cc:1275] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.802151  7127 consensus_queue.cc:1048] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.818697  6806 raft_consensus.cc:1275] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.819811  7036 consensus_queue.cc:1048] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.830103  6956 raft_consensus.cc:1275] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer f4a5591702044cabac2e3d0e0c7683de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.831553  7156 consensus_queue.cc:1048] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.839548  6956 raft_consensus.cc:1275] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.841015  7104 consensus_queue.cc:1048] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.853621  6882 raft_consensus.cc:1275] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.856315  7104 consensus_queue.cc:1048] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.083881  6957 raft_consensus.cc:1275] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.085033  7104 consensus_queue.cc:1048] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.103509  6882 raft_consensus.cc:1275] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2c9cdabf34e341aeb2a3fd330cf77d73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.110780  7127 consensus_queue.cc:1048] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.044281  6703 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46026:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:23.063984  6703 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46026:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:23.130288 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.169282  7209 tablet.cc:1724] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.171257  7210 tablet.cc:1724] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.183379  7211 tablet.cc:1724] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.218036  7211 tablet.cc:1724] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.229255  7212 tablet.cc:1724] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.238226  7222 tablet.cc:1724] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.311128  7227 tablet.cc:1724] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.324312  7220 tablet.cc:1724] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.336092  7210 tablet.cc:1724] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.339432  7209 tablet.cc:1724] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:23.355315  6772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.9.3:36481, user_credentials={real_user=slave}} blocked reactor thread for 50074.7us
I20260709 12:27:23.370661  7220 tablet.cc:1724] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.377190  7211 tablet.cc:1724] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.387741  7231 tablet.cc:1724] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.398149  6806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062"
dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
mode: GRACEFUL
new_leader_uuid: "2bd1c1645d1947d28d4652041bce39c8"
 from {username='slave'} at 127.0.0.1:44334
I20260709 12:27:23.398871  6806 raft_consensus.cc:606] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Received request to transfer leadership to TS 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:23.407238  7212 tablet.cc:1724] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.418377  7209 tablet.cc:1724] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.436396  7235 tablet.cc:1724] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.461229  7210 tablet.cc:1724] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.464121  7240 tablet.cc:1724] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.431666  7227 tablet.cc:1724] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.471768  7241 tablet.cc:1724] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.483533  7235 tablet.cc:1724] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.496538  7240 tablet.cc:1724] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.504207  7211 tablet.cc:1724] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.508010  7238 tablet.cc:1724] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.510370  7222 tablet.cc:1724] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.511582  7209 tablet.cc:1724] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.520205  7231 tablet.cc:1724] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:23.546423  6882 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1"
dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
mode: GRACEFUL
new_leader_uuid: "2bd1c1645d1947d28d4652041bce39c8"
 from {username='slave'} at 127.0.0.1:47836
I20260709 12:27:23.547021  6882 raft_consensus.cc:606] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Received request to transfer leadership to TS 2bd1c1645d1947d28d4652041bce39c8
I20260709 12:27:23.548826 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:23.549458 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:23.557682  6706 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9: soft_deleted_table [id=a8841e46351a4c6c84de72c44de3221f] alter complete (version 1)
I20260709 12:27:23.562623  7229 raft_consensus.cc:993] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73: : Instructing follower 2bd1c1645d1947d28d4652041bce39c8 to start an election
I20260709 12:27:23.563196  7172 raft_consensus.cc:1081] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Signalling peer 2bd1c1645d1947d28d4652041bce39c8 to start an election
I20260709 12:27:23.569252  6954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
 from {username='slave'} at 127.0.0.1:59264
I20260709 12:27:23.569682  6954 raft_consensus.cc:493] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.569922  6954 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.575088  6954 raft_consensus.cc:515] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:23.576678  6954 leader_election.cc:290] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 3 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:23.577521  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:23.577710  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bcf8ddd1d49b38969ea2bab062062" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:23.578061  6808 raft_consensus.cc:3055] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:23.578280  6882 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.578362  6808 raft_consensus.cc:740] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c9cdabf34e341aeb2a3fd330cf77d73, State: Running, Role: LEADER
I20260709 12:27:23.579115  6808 consensus_queue.cc:260] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:23.580021  6808 raft_consensus.cc:3060] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.582849  6882 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 3.
I20260709 12:27:23.583930  6920 leader_election.cc:304] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, f4a5591702044cabac2e3d0e0c7683de; no voters: 
I20260709 12:27:23.584468  6808 raft_consensus.cc:2468] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 3.
I20260709 12:27:23.584651  7208 raft_consensus.cc:2804] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:23.585139  7208 raft_consensus.cc:697] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 3 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:23.585922  7208 consensus_queue.cc:237] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:23.594066  6705 catalog_manager.cc:5697] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 2 to 3, leader changed from 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1) to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 3 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.701512  7221 raft_consensus.cc:993] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de: : Instructing follower 2bd1c1645d1947d28d4652041bce39c8 to start an election
I20260709 12:27:23.702008  7218 raft_consensus.cc:1081] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Signalling peer 2bd1c1645d1947d28d4652041bce39c8 to start an election
I20260709 12:27:23.703349  6954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1"
dest_uuid: "2bd1c1645d1947d28d4652041bce39c8"
 from {username='slave'} at 127.0.0.1:59278
I20260709 12:27:23.703821  6954 raft_consensus.cc:493] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.704116  6954 raft_consensus.cc:3060] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.708866  6954 raft_consensus.cc:515] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:23.710417  6954 leader_election.cc:290] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 2 election: Requested vote from peers 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867), f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519)
I20260709 12:27:23.711048  6808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73"
I20260709 12:27:23.711277  6882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d2f06b2fd1415a8fd120cde94743d1" candidate_uuid: "2bd1c1645d1947d28d4652041bce39c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4a5591702044cabac2e3d0e0c7683de"
I20260709 12:27:23.711618  6808 raft_consensus.cc:3060] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.711827  6882 raft_consensus.cc:3055] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:23.712124  6882 raft_consensus.cc:740] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4a5591702044cabac2e3d0e0c7683de, State: Running, Role: LEADER
I20260709 12:27:23.712718  6882 consensus_queue.cc:260] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:23.713558  6882 raft_consensus.cc:3060] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.715929  6808 raft_consensus.cc:2468] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 2.
I20260709 12:27:23.716805  6921 leader_election.cc:304] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd1c1645d1947d28d4652041bce39c8, 2c9cdabf34e341aeb2a3fd330cf77d73; no voters: 
I20260709 12:27:23.717433  7208 raft_consensus.cc:2804] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:23.717876  7208 raft_consensus.cc:697] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 LEADER]: Becoming Leader. State: Replica: 2bd1c1645d1947d28d4652041bce39c8, State: Running, Role: LEADER
I20260709 12:27:23.718150  6882 raft_consensus.cc:2468] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bd1c1645d1947d28d4652041bce39c8 in term 2.
I20260709 12:27:23.718694  7208 consensus_queue.cc:237] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } }
I20260709 12:27:23.725674  6705 catalog_manager.cc:5697] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 reported cstate change: term changed from 1 to 2, leader changed from f4a5591702044cabac2e3d0e0c7683de (127.29.9.2) to 2bd1c1645d1947d28d4652041bce39c8 (127.29.9.3). New cstate: current_term: 2 leader_uuid: "2bd1c1645d1947d28d4652041bce39c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bd1c1645d1947d28d4652041bce39c8" member_type: VOTER last_known_addr { host: "127.29.9.3" port: 36481 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.983409  6882 raft_consensus.cc:1275] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 3 FOLLOWER]: Refusing update from remote peer 2bd1c1645d1947d28d4652041bce39c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.984613  7208 consensus_queue.cc:1048] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.998924  6808 raft_consensus.cc:1275] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 3 FOLLOWER]: Refusing update from remote peer 2bd1c1645d1947d28d4652041bce39c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:24.000797  7034 consensus_queue.cc:1048] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.255515  6808 raft_consensus.cc:1275] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Refusing update from remote peer 2bd1c1645d1947d28d4652041bce39c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.256577  7034 consensus_queue.cc:1048] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c9cdabf34e341aeb2a3fd330cf77d73" member_type: VOTER last_known_addr { host: "127.29.9.1" port: 43867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.267069  6882 raft_consensus.cc:1275] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Refusing update from remote peer 2bd1c1645d1947d28d4652041bce39c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.269068  7251 consensus_queue.cc:1048] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4a5591702044cabac2e3d0e0c7683de" member_type: VOTER last_known_addr { host: "127.29.9.2" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.550465 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.555456 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:24.555862 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:25.556780 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:25.561898 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:25.562331 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:26.563254 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:26.568948 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:26.569515 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:27.570516 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:27.575714 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:27.576161 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:28.577356 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:28.585143 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:28.585553 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:29.586572 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:29.591444 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:29.591895 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:30.592808 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:30.598179 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:30.598585 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:31.599431 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:31.604297 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:31.604710 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:32.605558 29732 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:32.611267 29732 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:32.611713 29732 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:33.666923 29732 tablet_server.cc:179] TabletServer@127.29.9.1:0 shutting down...
W20260709 12:27:33.689884  6921 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 12:27:33.694343  6921 consensus_peers.cc:597] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:33.694725  6847 consensus_peers.cc:597] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:33.704357  6847 consensus_peers.cc:597] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.712113 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:33.713122 29732 tablet_replica.cc:333] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.714223 29732 raft_consensus.cc:2243] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:33.714762  6847 consensus_peers.cc:597] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.715268 29732 raft_consensus.cc:2272] T e124c203f868468d8ac35b644fb141c5 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.717911 29732 tablet_replica.cc:333] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.718539 29732 raft_consensus.cc:2243] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.719046 29732 raft_consensus.cc:2272] T bb4b7ee27e674ed38154df6db1103ebf P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.721824 29732 tablet_replica.cc:333] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.722548 29732 raft_consensus.cc:2243] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.723451 29732 raft_consensus.cc:2272] T d611f0ff9fe14e0f808abac8eaf8f01b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.725709 29732 tablet_replica.cc:333] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.726293 29732 raft_consensus.cc:2243] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.726791 29732 raft_consensus.cc:2272] T 50c83b5ab9fa47ba97834d22114c95ac P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.729148 29732 tablet_replica.cc:333] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.729815 29732 raft_consensus.cc:2243] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.730372 29732 raft_consensus.cc:2272] T 9885261bbb024513942abcdb9501e46c P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.732671 29732 tablet_replica.cc:333] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.733198 29732 raft_consensus.cc:2243] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.734010 29732 raft_consensus.cc:2272] T d3a719f022a548578e7f58ce6743a1ea P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.736289 29732 tablet_replica.cc:333] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.736794 29732 raft_consensus.cc:2243] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.737615 29732 raft_consensus.cc:2272] T 93724e4ed6f844f9a9d04df23cd8a637 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.740231 29732 tablet_replica.cc:333] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.740828 29732 raft_consensus.cc:2243] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.741308 29732 raft_consensus.cc:2272] T a533385133264ec58a7246b78f3521c0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.743569 29732 tablet_replica.cc:333] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.744135 29732 raft_consensus.cc:2243] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.745007 29732 raft_consensus.cc:2272] T da2ae8230af54606ba0ac552d2afcda0 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.747258 29732 tablet_replica.cc:333] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.747828 29732 raft_consensus.cc:2243] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.748654 29732 raft_consensus.cc:2272] T 1880578ebd254aecbb480bca936aea7b P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.750865 29732 tablet_replica.cc:333] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.751407 29732 raft_consensus.cc:2243] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.752305 29732 raft_consensus.cc:2272] T 317e859f439b422cb0c01d34e5c50975 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.754736 29732 tablet_replica.cc:333] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.755290 29732 raft_consensus.cc:2243] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.756142 29732 raft_consensus.cc:2272] T 3f70530b024b4444835664e0aa398348 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.758715 29732 tablet_replica.cc:333] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.759290 29732 raft_consensus.cc:2243] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.759799 29732 raft_consensus.cc:2272] T 334bcf8ddd1d49b38969ea2bab062062 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.762184 29732 tablet_replica.cc:333] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.762689 29732 raft_consensus.cc:2243] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.763167 29732 raft_consensus.cc:2272] T f140010db0f947a5869cf9ef47b7025f P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.765390 29732 tablet_replica.cc:333] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.765894 29732 raft_consensus.cc:2243] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.766396 29732 raft_consensus.cc:2272] T 383656a55f204d10ba97e89f81eff725 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.768718 29732 tablet_replica.cc:333] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.769220 29732 raft_consensus.cc:2243] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.769932 29732 raft_consensus.cc:2272] T b12285b5acd34f34ada2f40bfd56a1f4 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.773403 29732 tablet_replica.cc:333] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.774108 29732 raft_consensus.cc:2243] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.774722 29732 raft_consensus.cc:2272] T 95d2f06b2fd1415a8fd120cde94743d1 P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.777254 29732 tablet_replica.cc:333] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73: stopping tablet replica
I20260709 12:27:33.777688 29732 raft_consensus.cc:2243] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.778118 29732 raft_consensus.cc:2272] T 69a5fc3402494c718fd85c5ec581181d P 2c9cdabf34e341aeb2a3fd330cf77d73 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:33.794018  6847 consensus_peers.cc:597] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.814029 29732 tablet_server.cc:196] TabletServer@127.29.9.1:0 shutdown complete.
I20260709 12:27:33.854598 29732 tablet_server.cc:179] TabletServer@127.29.9.2:0 shutting down...
I20260709 12:27:33.884388 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:33.885274 29732 tablet_replica.cc:333] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
W20260709 12:27:33.885568  6847 consensus_peers.cc:597] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:43867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:33.886085  6847 consensus_peers.cc:597] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:43867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.886420 29732 raft_consensus.cc:2243] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.887609 29732 raft_consensus.cc:2272] T bb4b7ee27e674ed38154df6db1103ebf P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.889884 29732 tablet_replica.cc:333] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.890457 29732 raft_consensus.cc:2243] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.890916 29732 raft_consensus.cc:2272] T d611f0ff9fe14e0f808abac8eaf8f01b P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.893110 29732 tablet_replica.cc:333] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.893685 29732 raft_consensus.cc:2243] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.894570 29732 raft_consensus.cc:2272] T 9885261bbb024513942abcdb9501e46c P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.896850 29732 tablet_replica.cc:333] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.897442 29732 raft_consensus.cc:2243] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.898226 29732 raft_consensus.cc:2272] T 50c83b5ab9fa47ba97834d22114c95ac P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.900321 29732 tablet_replica.cc:333] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.900877 29732 raft_consensus.cc:2243] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.901350 29732 raft_consensus.cc:2272] T 93724e4ed6f844f9a9d04df23cd8a637 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.903478 29732 tablet_replica.cc:333] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.904227 29732 raft_consensus.cc:2243] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.905038 29732 raft_consensus.cc:2272] T e124c203f868468d8ac35b644fb141c5 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.907173 29732 tablet_replica.cc:333] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.907708 29732 raft_consensus.cc:2243] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.908200 29732 raft_consensus.cc:2272] T a533385133264ec58a7246b78f3521c0 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.911576 29732 tablet_replica.cc:333] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.912367 29732 raft_consensus.cc:2243] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.913385 29732 raft_consensus.cc:2272] T 69a5fc3402494c718fd85c5ec581181d P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:33.914413  6920 consensus_peers.cc:597] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 -> Peer f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519): Couldn't send request to peer f4a5591702044cabac2e3d0e0c7683de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.915948 29732 tablet_replica.cc:333] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.916651 29732 raft_consensus.cc:2243] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.917121 29732 raft_consensus.cc:2272] T da2ae8230af54606ba0ac552d2afcda0 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.919330 29732 tablet_replica.cc:333] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.919950 29732 raft_consensus.cc:2243] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.920406 29732 raft_consensus.cc:2272] T 1880578ebd254aecbb480bca936aea7b P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.922541 29732 tablet_replica.cc:333] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.923030 29732 raft_consensus.cc:2243] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.923489 29732 raft_consensus.cc:2272] T b12285b5acd34f34ada2f40bfd56a1f4 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.925498 29732 tablet_replica.cc:333] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.925936 29732 raft_consensus.cc:2243] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.926344 29732 raft_consensus.cc:2272] T 95d2f06b2fd1415a8fd120cde94743d1 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.928253 29732 tablet_replica.cc:333] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.928700 29732 raft_consensus.cc:2243] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.929481 29732 raft_consensus.cc:2272] T f140010db0f947a5869cf9ef47b7025f P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.931443 29732 tablet_replica.cc:333] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.931951 29732 raft_consensus.cc:2243] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.932449 29732 raft_consensus.cc:2272] T 334bcf8ddd1d49b38969ea2bab062062 P f4a5591702044cabac2e3d0e0c7683de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.934480 29732 tablet_replica.cc:333] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.934938 29732 raft_consensus.cc:2243] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.935329 29732 raft_consensus.cc:2272] T 317e859f439b422cb0c01d34e5c50975 P f4a5591702044cabac2e3d0e0c7683de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.937309 29732 tablet_replica.cc:333] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.937712 29732 raft_consensus.cc:2243] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.938172 29732 raft_consensus.cc:2272] T 3f70530b024b4444835664e0aa398348 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.940131 29732 tablet_replica.cc:333] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.940646 29732 raft_consensus.cc:2243] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.941452 29732 raft_consensus.cc:2272] T 383656a55f204d10ba97e89f81eff725 P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.943354 29732 tablet_replica.cc:333] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de: stopping tablet replica
I20260709 12:27:33.943820 29732 raft_consensus.cc:2243] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.944330 29732 raft_consensus.cc:2272] T d3a719f022a548578e7f58ce6743a1ea P f4a5591702044cabac2e3d0e0c7683de [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:33.969014  6921 consensus_peers.cc:597] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:43867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:33.988708 29732 tablet_server.cc:196] TabletServer@127.29.9.2:0 shutdown complete.
W20260709 12:27:34.009599  6921 consensus_peers.cc:597] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 -> Peer 2c9cdabf34e341aeb2a3fd330cf77d73 (127.29.9.1:43867): Couldn't send request to peer 2c9cdabf34e341aeb2a3fd330cf77d73. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.1:43867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.027446 29732 tablet_server.cc:179] TabletServer@127.29.9.3:0 shutting down...
I20260709 12:27:34.053764 29732 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:34.054483 29732 tablet_replica.cc:333] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.055143 29732 raft_consensus.cc:2243] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.055683 29732 raft_consensus.cc:2272] T bb4b7ee27e674ed38154df6db1103ebf P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.057883 29732 tablet_replica.cc:333] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.058462 29732 raft_consensus.cc:2243] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.058947 29732 raft_consensus.cc:2272] T 50c83b5ab9fa47ba97834d22114c95ac P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.061043 29732 tablet_replica.cc:333] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.061645 29732 raft_consensus.cc:2243] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.062136 29732 raft_consensus.cc:2272] T d611f0ff9fe14e0f808abac8eaf8f01b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.064167 29732 tablet_replica.cc:333] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.064664 29732 raft_consensus.cc:2243] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.065122 29732 raft_consensus.cc:2272] T e124c203f868468d8ac35b644fb141c5 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.067536 29732 tablet_replica.cc:333] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.068125 29732 raft_consensus.cc:2243] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.068697 29732 raft_consensus.cc:2272] T 9885261bbb024513942abcdb9501e46c P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:34.070608  6920 consensus_peers.cc:597] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 -> Peer f4a5591702044cabac2e3d0e0c7683de (127.29.9.2:43519): Couldn't send request to peer f4a5591702044cabac2e3d0e0c7683de. Status: Network error: Client connection negotiation failed: client connection to 127.29.9.2:43519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.071046 29732 tablet_replica.cc:333] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.071662 29732 raft_consensus.cc:2243] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.072213 29732 raft_consensus.cc:2272] T 93724e4ed6f844f9a9d04df23cd8a637 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.074342 29732 tablet_replica.cc:333] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.074826 29732 raft_consensus.cc:2243] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:34.075629 29732 raft_consensus.cc:2272] T a533385133264ec58a7246b78f3521c0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.077775 29732 tablet_replica.cc:333] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.078312 29732 raft_consensus.cc:2243] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.078756 29732 raft_consensus.cc:2272] T 69a5fc3402494c718fd85c5ec581181d P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.080878 29732 tablet_replica.cc:333] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.081426 29732 raft_consensus.cc:2243] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.081892 29732 raft_consensus.cc:2272] T 3f70530b024b4444835664e0aa398348 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.083983 29732 tablet_replica.cc:333] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.084530 29732 raft_consensus.cc:2243] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.084970 29732 raft_consensus.cc:2272] T 317e859f439b422cb0c01d34e5c50975 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.087018 29732 tablet_replica.cc:333] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.087529 29732 raft_consensus.cc:2243] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:34.088404 29732 raft_consensus.cc:2272] T 334bcf8ddd1d49b38969ea2bab062062 P 2bd1c1645d1947d28d4652041bce39c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.090507 29732 tablet_replica.cc:333] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.091032 29732 raft_consensus.cc:2243] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.091481 29732 raft_consensus.cc:2272] T f140010db0f947a5869cf9ef47b7025f P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.093454 29732 tablet_replica.cc:333] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.093921 29732 raft_consensus.cc:2243] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.094357 29732 raft_consensus.cc:2272] T 383656a55f204d10ba97e89f81eff725 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.096355 29732 tablet_replica.cc:333] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.096828 29732 raft_consensus.cc:2243] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:34.097601 29732 raft_consensus.cc:2272] T b12285b5acd34f34ada2f40bfd56a1f4 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.099483 29732 tablet_replica.cc:333] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.099987 29732 raft_consensus.cc:2243] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:34.100773 29732 raft_consensus.cc:2272] T 95d2f06b2fd1415a8fd120cde94743d1 P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.103140 29732 tablet_replica.cc:333] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.103597 29732 raft_consensus.cc:2243] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.104115 29732 raft_consensus.cc:2272] T d3a719f022a548578e7f58ce6743a1ea P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.106236 29732 tablet_replica.cc:333] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.106704 29732 raft_consensus.cc:2243] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.107139 29732 raft_consensus.cc:2272] T da2ae8230af54606ba0ac552d2afcda0 P 2bd1c1645d1947d28d4652041bce39c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.109040 29732 tablet_replica.cc:333] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8: stopping tablet replica
I20260709 12:27:34.109479 29732 raft_consensus.cc:2243] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:34.109910 29732 raft_consensus.cc:2272] T 1880578ebd254aecbb480bca936aea7b P 2bd1c1645d1947d28d4652041bce39c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.148874 29732 tablet_server.cc:196] TabletServer@127.29.9.3:0 shutdown complete.
I20260709 12:27:34.194841 29732 master.cc:562] Master@127.29.9.62:37721 shutting down...
I20260709 12:27:34.214936 29732 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:34.215562 29732 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:34.215903 29732 tablet_replica.cc:333] T 00000000000000000000000000000000 P 277ba5300fbf44978d650fdc62bc70d9: stopping tablet replica
I20260709 12:27:34.254978 29732 master.cc:584] Master@127.29.9.62:37721 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20555 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (42051 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (313082 ms total)
[  PASSED  ] 8 tests.
I20260709 12:27:34.306926 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2317 messages since previous log ~32 seconds ago
I20260709 12:27:34.307157 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2320 messages since previous log ~33 seconds ago
I20260709 12:27:34.307328 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2321 messages since previous log ~33 seconds ago
I20260709 12:27:34.307507 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:27:34.307713 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:27:34.307940 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~172 seconds ago
I20260709 12:27:34.308192 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:27:34.308467 29732 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
